Asong6824/dsh-llm-rate-limit

README 摘要

dsh-llm-rate-limit English 中文 A DeepSeek Harness (DSH) plugin that prevents avoidable API rate-limit errors by pacing LLM requests before they reach the provider. It provides per-provider RPM limits, optional token budgets, concurrency control, bounded FIFO queuing, and adaptive cooldown for DeepSeek API, Volcengine Ark, and other DSH providers. Use it when parallel agents, subagents, retries, or background requests are producing HTTP 429 errors, provider throttling, or traffic bursts. Install from npm Install the latest release into the Web profile: Pin a version for reproducible environments: Install separately for Headless: GitHub installation is also supported: The bundled default protects deepseek-official with 30 requests per minute, burst 1, two concurrent requests, and a bounded queue. Features - Provider-scoped requests-per-minute token buckets with configurable burst capacity. - Optional estimated-token-per-minute budgets with actual-usage reconciliation. - Concurrency limits and bounded FIFO queues with timeout and cancellation. - Adaptive cooldown for provider error codes, HTTP statuses, and Retry-After . - Explicit auxiliary-request shedding so background traffic does …

分类