orchestral-media/orchestral

orchestral-media★ 1TypeScript最后同步: 2026-08-21

在 GitHub 打开

TypeScript library for building multimedia-generation agents: text-to-image, video, speech and audio pipelines with capability-based model routing, automatic cross-model fallback, and BYOK direct provider calls (no gateway). 27 built-in patterns, provider-SDK-free core.

README 摘要

Orchestral A TypeScript orchestration layer for media generation — text-to-image, image-to-video, text-to-speech, speech recognition — built for local-first, BYOK apps: capability routing, opt-in semantic fallback, and an asset-handle protocol. You describe what a step needs ( text-to-image , image-to-video , automatic-speech-recognition , …), not which model to call. Orchestral routes that capability to a model you supplied, retries inside the router, knows the semantically equivalent paths a capability without a model could degrade through (reporting them on failure by default; redirecting automatically is opt-in), and passes generated media between steps as opaque handles the host resolves. It ships no provider SDK and no API keys — calling a model is a 15-line adapter you write, over whichever SDK you already use. Everything runs in your process; there is no hosted control plane. How it relates to the AI SDK / LangChain Different layers, and Orchestral expects you to keep using the others: - A provider SDK (the Vercel AI SDK, an official vendor SDK) owns one model call — auth, request shape, streaming, transport retries. Your Orchestral call adapter is usually a dozen lines ove…

在 GitHub 查看完整 README →
Agent/智能体aiai-agentsbyokdsh-pluginfallbackgenerative-aiimage-generationllm

分类