OpenRouter vs TrueFoundry (2026)

Pros

• Largest model catalog in the gateway space — 300+ models
• OpenAI-compatible API drops in with zero code change
• Reasonable platform fee — 5.5% over passthrough rates
• Per-key spend tracking and isolated rate limits
• Active free tier viable for prototyping

Cons

• Adds ~25-40ms latency over direct provider calls
• Credits expire after 365 days
• 5.5% fee + $0.80 minimum charge stings on small purchases
• Free models can be flaky — timeouts and required cooldowns

Pros

• LLM, MCP, and agent traffic run through one gateway
• VPC, on-premises, and air-gapped deployment available on Enterprise
• Model serving and fine-tuning live in the same platform as the gateway

Cons

• LLM judges run inline as guardrails only, so datasets and offline experiments need another tool
• SSO, audit logs, and VPC or on-prem deployment require Enterprise