PerryLink/dsh-click

README excerpt

🖱️ dsh-click Cross-platform native desktop control for DeepSeek Harness — Windows first. Look at the screen, then act — every click gated, every action audited. English · 简体中文 · Español · Português · हिन्दी Compatibility Surface Status Harness DeepSeek Harness 0.1.0-rc.6 (compat declared for 0.1.0-rc.5 – 0.1.0-rc.6 ) Node ^22.19.0 \ \ =24.0.0 Platforms Windows first (UIAutomation + Win32 input, via a bundled PowerShell helper); macOS/Linux backends are reserved and fail closed with a clear reason Model Text-only models fully supported ( screen read returns structured text); vision models additionally get screen shot images What you get dsh-click gives the harness a complete observe → act loop over native desktop applications: - screen shot — screenshot of a window (or the primary screen), downscaled to a configurable bound. With a vision-capable model the result carries the image; otherwise a text description keeps text-only models working. - screen read — the structured observation: the window's accessibility tree (element ids, types, names, rectangles, supported patterns) plus pixel-location hints with colors — plain text, no image model required. - click / type / scroll / key —…

Category