Developer
$0
- Up to 3 users, 10k gateway requests per user per month, 5 model accounts, 5 MCP servers, 1 budget rule, 7-day log retention, SaaS deployment
Respan Gateway: up to 55% off tokens on Gemini, GPT, Claude and 1,000+ more models. One API key, 0% fee.
TrueFoundry is an enterprise AI platform built around an AI Gateway that routes LLM, MCP, and agent traffic through one control layer. The company was founded in 2021 and is based in San Francisco. It started as a Kubernetes platform for deploying ML models and still sells model serving and fine-tuning alongside the gateway.
The gateway handles routing, fallbacks, rate limits, budgets, and guardrails, and TrueFoundry reports overhead typically under 5ms. Tracing is OpenTelemetry-compliant and exports to tools like Grafana, Datadog, and Prometheus. Evaluation is narrower: TrueFoundry runs LLM judges inline as guardrails, so datasets and offline experiments need a separate eval tool.
Deployment covers SaaS, VPC, on-premises, and air-gapped environments, with everything beyond SaaS on the Enterprise plan, which is where it differs most from the LLM gateways that run only as managed services. Pricing is per seat with gateway requests included, so traffic growth bills as request overage rather than as extra seats.
Core capabilities this platform advertises.
What this tool does well, and the limitations to keep in mind.
Pros
Cons
What's included in each plan, and how the tiers compare.
$0
$25
Per user per month
Custom
Contact sales for a quote
Enterprise platform and AI teams that need to govern LLM, MCP, and agent traffic, often in their own cloud or on-prem
Respan is the AI router with observability and automated evals built in. Every request it routes is already a trace, priced and ready to score, so output quality is measured in the same place routing happens, with no separate eval tool to wire in.
Respan routes every call across 1,000+ models with automatic fallbacks, and every routed request is already traced, priced, and ready to score. Run evals on live production traffic without wiring in a separate tool, and start free.
Top companies in LLM Gateways you can use instead of TrueFoundry.
Respan
One API for 1,000+ models
OpenRouter
One OpenAI-compatible API for 500+ models from 80+ providers
Cloudflare AI Gateway
Edge-deployed AI gateway
Vercel AI Gateway
One API key for hundreds of models
Bifrost
OpenAI-compatible API for 1,000+ models from 20+ providers
Portkey
Unified API across major providers
LiteLLM
OpenAI-compatible proxy for 140+ providers
Stainless
SDK generation
Helicone
LLM observability and monitoring
Unify
Kong AI Gateway
AI traffic management
Martian
Intelligent model routing based on prompt type
Apigee AI Gateway
Google Cloud AI traffic management
Requesty
400+ model access
The Token Company
Token compression
Condense
Drop-in proxy: change one base URL, keep your own provider key
OrcaRouter
orcarouter/auto adaptive routing per request
InWorld AI
Conditional routing with CEL expressions on request metadata
Orq.ai
AI gateway for 500+ models with fallbacks, retries, and load balancing
Side-by-side comparisons with other tools in this category.
Companies from adjacent layers in the AI stack that work well with TrueFoundry.