toby-bridges/api-relay-audit

toby-bridges★ 798PythonLast synced: 2026-08-15

Open on GitHub

Local security audit for AI API relays and LLM proxies: detects prompt injection, model substitution, tool-call rewriting, SSE anomalies, error leakage, and Web3 wallet risks.

README excerpt

API Relay Audit Local security audit for AI API relays and LLM proxies. DSH Plugin What Is API Relay Audit? API Relay Audit is a local security audit tool for AI API relays and LLM proxies. It keeps API relay audit, prompt injection audit, model substitution signals, and Web3 relay audit as separate query families so each result keeps a clean evidence boundary. Your API key is sent only to the relay URL you choose. Use it when you rely on a third-party AI API relay, OpenAI-compatible proxy, Claude-compatible proxy, or Web3 agent workflow and want a repeatable Markdown report before trusting that relay with production or wallet-related traffic. AI API Relay Security Audit - Detect relay tampering: prompt injection, prompt extraction, identity consistency signals, context truncation, tool-call rewriting, error-response leakage, and SSE stream anomalies. - Run locally: the standalone audit.py uses only Python stdlib plus curl ; your API key is sent only to the relay URL you choose. - Produce reviewable evidence: each run generates a structured Markdown report with per-step findings and a final LOW / MEDIUM / HIGH verdict. Quick Start See a public-safe fixture report: sanitized audit r…

View full README on GitHub →
Tools / Devai-agentsai-auditai-securityanthropicapi-gatewayclaudedsh-pluginllm-audit

Category