ciky20171114/dsh-plugin-midscene

README 摘要

dsh-plugin-midscene English 中文 AI-driven UI automation for DeepSeek Harness (DSH), powered by Midscene. The model sees the screen, locates elements by natural-language description, and acts on real targets — a real Android device or a real Chrome browser. One capability seam ( ctx.midscene ), two providers, two tools: Provider entry Tool Target Android dsh-plugin-midscene/android android ui one ADB-connected device Web dsh-plugin-midscene/web web ui the active page of an already-running Chrome Each tool is a single tool with an action parameter (like str replace editor ): the model picks an action ( tap / act / input / query / assert / boolean / back ) and the tool dispatches internally — no tool-surface bloat. Requirements - DSH ( dsh CLI) with a profile - Android: adb devices shows the device - Web: Chrome started with --remote-debugging-port=9222 --user-data-dir= ; the provider connects, never launches - A Midscene-compatible vision model, configured through environment variables (see Model configuration) Install The bundle's default layer registers the two tools. They read ctx.midscene opportunistically, so they appear even before a provider is configured — calling one without …

分类