Einskyle/dsh-llm-vision-bridge

README 摘要

dsh-llm-vision-bridge English 中文 Let text-only LLMs (DeepSeek) "see" images in the dsh web GUI: paste an image into the chat and the plugin automatically routes it to a vision model (Qwen3-VL via your existing pi-ai / llama.cpp route), then feeds the resulting text description to DeepSeek, which continues the conversation as if it were a native multimodal model. Features - Native LLM provider — registers deepseek-vision on the DSH LlmAdapter seam. Image admission, request routing, and session compaction all run through harness-native mechanisms; no UI changes, no front-end interception. - Zero overhead without images — image-free requests pass straight through to the fallback provider (default deepseek-official ). - Vision-assisted replies — each image block is described by the vision model (attached user text is included in the prompt), then replaced with a [图片 N 描述] text block before the request reaches DeepSeek. - LRU description cache — the same image + prompt is never re-described; history replay and compaction do not re-run the vision model. - 503/429 auto-retry — tolerates the desktop GPU's single-card exclusive scheduling (vision gateway returns 503 while other tools occupy…

分类