nnbw-liu/deepseek-ai-dsh-llm-local
nnbw-liu★ 1TypeScript最后同步: 2026-08-15
基于本地的ollma的模型推理
README 摘要
@deepseek-ai/dsh-llm-local English 中文 OpenAI-compatible local model adapter for the harness LLM seam: direct fetch + SSE (framed by eventsource-parser ) against any server that speaks the OpenAI chat-completions dialect — Ollama ( /v1 ), the llama.cpp server ( /v1 ), Microsoft Foundry Local , LM Studio, vLLM, and OpenAI-compatible gateways, local or remote. No DeepSeek-specific wire fields are sent, so the same adapter serves every endpoint; reasoning-capable servers that emit reasoning content still stream it as harness reasoning blocks. The package owns the provider routes ollama , llamacpp , and foundry-local as shipped presets, plus every route you declare by hand. The plugin is mounted dormant in the product: it shows up on the Models page, but zero routes serve requests until a llm-local: settings section (written by the web Models page or by hand) supplies provider profiles. About this repository — this is a standalone source snapshot of the @deepseek-ai/dsh-llm-local plugin, extracted from the DeepSeek Harness monorepo ( packages/llm/llm-local ). It is a Cordis plugin for the harness and is built and tested inside that monorepo; the package.json dependencies and tsconfig.js…
在 GitHub 查看完整 README →