ZRui-C/dsh-computer-use

README excerpt

DSH Computer Use Text-first browser and background macOS control for DSH. Target the right process and window without taking over the user's pointer. 简体中文 · Architecture · Distribution · Security Install Homebrew DMG 1. Download the latest DSH-Computer-Use- -universal.dmg from Releases. 2. Drag DSH Computer Use into Applications and open it. With either method, authorize Accessibility and Screen Recording , select Install under DSH Plugin , then restart the running DSH Host. The Homebrew Cask and official DMG install the same Universal 2, Developer ID signed, Apple-notarized app. Users do not need Xcode, Swift, or this source checkout. DSH and Google Chrome must already be installed. What it does Surface Perception Input Chromium Playwright, CDP accessibility/DOM, frames, tabs, optional OCR Ref-pinned navigation, pointer, keyboard, forms, scroll, drag, upload macOS Accessibility tree first, Vision OCR for semantic gaps, independent window capture AX actions, targeted SkyLight/CoreGraphics, global HID only without a target Every action returns a fresh bounded text observation. The model works with roles, names, values, state, geometry, and stable snapshot refs instead of assuming it…

Category