Cloudflare AI Gateway vs Portkey: LLM Gateways Comparison
Compare Cloudflare AI Gateway and Portkey side by side. Both are tools in the LLM Gateways category.
Updated March 10, 2026
The short answer
Choose Cloudflare AI Gateway if core features free with Cloudflare plans—no per-call gateway fees.
Choose Portkey if massive scale—10B requests monthly with 99.9999% uptime.
Want to compare Cloudflare AI Gateway and Portkey on your own traffic?
Respan lets you trace LLM and agent calls across any model or framework, A/B test prompts on production traffic, and route requests across 250+ models through one gateway. Free tier covers 10K traces per month. Setup in 5 minutes, no credit card.
Quick Comparison
| Category | LLM Gateways | LLM Gateways |
| Pricing | Freemium | Freemium |
| Best For | Cloudflare users who want to add AI gateway capabilities to their existing edge infrastructure | Engineering teams who need a reliable, observable gateway for production LLM applications |
| Website | developers.cloudflare.com | portkey.ai |
| Key Features |
|
|
| Use Cases |
|
|
Pros & Cons: Cloudflare AI Gateway vs Portkey
- +Core features free with Cloudflare plans—no per-call gateway fees
- +Tightly integrated with Cloudflare global network for low-latency routing
- +One-line integration for major LLM providers
- +Built-in caching, rate limiting, and fallbacks improve reliability
- −Adds 10-50ms proxy latency to every request
- −Lacks token-level tracing and prompt analysis
- −Strict log retention caps require manual management at scale
- −No enterprise governance features like RBAC or audit trails
- +Massive scale—10B requests monthly with 99.9999% uptime
- +Comprehensive observability and analytics
- +Dedicated support even during POC phase
- +Strong security certifications (SOC2, ISO27001)
- −Real-world latency (20-40ms) higher than claimed
- −Benchmarks show competitors 228% faster
- −Complex feature set overwhelming for new users
- −High pricing for smaller teams
Pricing: Cloudflare AI Gateway vs Portkey
- · 100,000 logs/month
- · Core gateway features
- · Caching and rate limiting
- · Basic analytics
- · 1 million logs/month
- · 10M requests included
- · 30M CPU-ms included
- · USD 0.30 per 1M additional requests
- · Custom log retention
- · Advanced features
- · Dedicated support
- · SLA guarantees
- · Open-source gateway
- · Infrastructure costs only
- · Full control
- · Community support
- · Managed infrastructure
- · Standard support
- · Advanced observability
- · Prompt management
- · RBAC, SSO
- · Private cloud/VPC
- · Data isolation
- · SOC2, ISO27001
When to Choose Cloudflare AI Gateway vs Portkey
- Edge caching for AI API calls
- Rate limiting AI usage per user
- Cost management for AI APIs
- Enterprise LLM deployment with reliability
- Multi-provider failover and load balancing
- Cost reduction through semantic caching
About Cloudflare AI Gateway
Cloudflare AI Gateway is a unified API gateway for AI applications that provides observability, caching, rate limiting, and cost tracking across multiple LLM providers. Available on all Cloudflare plans, the core gateway features are free with no per-call fees beyond the Cloudflare subscription. The platform connects popular providers like Workers AI, Hugging Face, OpenAI, and Anthropic with a single line of code, offering centralized visibility and control. Built into Cloudflare global network infrastructure, AI Gateway provides edge-level caching, request retries, model fallbacks, and analytics. The free tier includes 100,000 AI Gateway logs per month, while the Workers Paid plan starting at USD 5/month provides 1 million logs. In 2026, Cloudflare introduced Unified Billing, allowing customers to pay for third-party model usage directly through Cloudflare invoices. While the platform excels at cost-effectiveness and integration with Cloudflare existing services, it adds 10-50ms of proxy latency, lacks deep AI observability features like token-level tracing, and enforces strict log retention caps that can require manual management at scale.
About Portkey
Portkey is an AI gateway and control panel trusted by thousands of development teams worldwide, providing comprehensive infrastructure for production AI applications. The platform processes over 10 billion LLM requests monthly with 99.9999% uptime and sub-40ms latency. Portkey's suite includes AI Gateway, Guardrails, Observability, and Prompt Management, routing requests to 1600+ models across major providers through a unified interface. Users praise easy integration, intuitive dashboards, dedicated support, and analytics providing detailed insights into traces, errors, caching, and cost visibility. However, real-world deployments often experience 20-40ms latency overhead (higher than claimed), with Kong benchmarks showing competitors 228% faster. Pricing typically ranges USD 2,000-10,000+ monthly depending on volume and deployment model. While powerful for enterprises, the platform can be overwhelming for new users and may require separate tools for comprehensive MLOps capabilities.
What is LLM Gateways?
Unified API platforms and proxies that aggregate multiple LLM providers behind a single endpoint, providing model routing, fallback, caching, rate limiting, cost optimization, and access control.
Browse all LLM Gatewaystools →Other LLM Gateways Tools
More LLM Gateways Comparisons
Run LLM Gateways in production with Respan
One platform for routing, observability, tracing, and evals across every LLM provider.