Integrations
Works with the infrastructure you already run
OrchVynt is designed to fit into existing stacks without requiring migration. Add it alongside the model providers, observability backends, and deployment infrastructure your team already uses.
Model Providers
Route across any combination of providers
OrchVynt abstracts away the provider API differences. Write one routing config and route across OpenAI, Anthropic, Mistral, Google, Cohere, and any custom endpoint exposing an OpenAI-compatible API — including local models via Ollama.
OpenAI
GPT-4o, GPT-4o-mini, o1-mini, GPT-3.5
Anthropic
Claude 3.5 Sonnet, Claude 3 Haiku, Claude 3 Opus
Mistral AI
Mistral Large, Mistral 7B, Mixtral 8x7B
Google Gemini
Gemini 1.5 Pro, Gemini 1.5 Flash, Gemini Pro
Cohere
Command R+, Command R, Embed
Ollama
Any local model — Llama 3, Phi-3, Gemma, Mistral 7B local
AWS Bedrock
Titan, Jurassic, Claude on Bedrock, Llama on Bedrock
Azure OpenAI
GPT-4 on Azure, GPT-35-turbo on Azure
Custom endpoint
Any OpenAI-compatible API endpoint via custom provider config
Observability
Drop telemetry into the backend you already use
OrchVynt emits structured telemetry in OpenTelemetry format — compatible with every major observability backend. Prometheus scrape endpoint included for metrics-first teams.
Datadog
Via OTLP export or Datadog Agent receiver
Grafana / Loki
Pre-built dashboard, Prometheus + Loki shipping
Honeycomb
Native OTLP traces with span-level routing metadata
New Relic
OTLP traces and Prometheus metrics
Jaeger
Distributed tracing for multi-agent spans
Prometheus
Scrape /metrics endpoint. Key metrics: invocation rate, routing decisions, fallback activations, budget utilization
Notifications & HITL
Deliver HITL alerts to your existing approval channels
Slack
Post HITL gate open notifications to a channel. Approve/reject from Slack via interactive message
Webhook
POST to any webhook endpoint on HITL open, budget breach, or fallback activation events
PagerDuty
Trigger incidents on critical threshold breaches or HITL timeout events
Integrations docs with working examples
Every integration has a quickstart guide with working config examples in the OrchVynt docs.