geohotstan/dsh-computer-use

README excerpt

@zibokapi/dsh-codex-computer-use English 中文 A standalone plugin for the DeepSeek Harness: desktop computer use on macOS — app listing, key-window capture as a screenshot plus model-readable accessibility tree, and synthesized mouse and keyboard input — cloned from OpenAI's Codex Computer Use window API. Input delivery is background-first like Codex's own execution model: semantic AX actions need no focus, and raw events ride the private SkyLight path ( SLEventPostToPid with the keyboard authentication envelope, field stamps, and focus-without-raise records, ported from the MIT-licensed trycua/cua project) with a public CGEvent.postToPid fallback per symbol, so the user's foreground never changes. It needs no OpenAI components. The design is accessibility-tree-first: computer use get app state returns a numbered, tab-indented element tree; the model acts on element indexes, with window-relative coordinates as a fallback, and later captures of the same app return diffs instead of the full tree. Everything ships in this one package: the seam, the local Swift-daemon provider, the computer use tools, the approval policy, and a standalone MCP server. The complete feature delta against Op…

Category