Question 1

What is GPT-4o?

Accepted Answer

GPT-4o is a model from OpenAI, released on May 13, 2024. GPT-4o ("o" for "omni") is OpenAI's latest AI model, supporting both text and image inputs with text outputs. $2.50 per million input tokens, $10 per million output tokens. 128,000 token context window, maximum output of 16,384 tokens. Higher uptime with 2 providers. Includes independent benchmarks from Artificial Analysis.

Question 2

How much does GPT-4o cost?

Accepted Answer

On the Respan gateway, input starts at $2.50 per 1M tokens on every provider, and output starts at $10.00 per 1M tokens on every provider, after gateway discounts. Averaged across 11 providers, it costs $2.95 per 1M input tokens and $10.91 per 1M output tokens.

Question 3

Which providers serve GPT-4o on Respan?

Accepted Answer

11 providers serve GPT-4o: Azure OpenAI, Inference.net, OpenAI, and OpenRouter. Azure OpenAI require your own provider API key (BYOK).

Question 4

What is GPT-4o's context window?

Accepted Answer

GPT-4o accepts up to 128K tokens of context on its largest provider route.

Question 5

How do I use GPT-4o with the Respan gateway?

Accepted Answer

Point any OpenAI-compatible SDK at https://api.respan.ai/api/ with your Respan API key and set the model to "openai/gpt-4o". To set it up with a coding agent, copy the agent setup prompt at the top of this page.

Question 6

How fast is GPT-4o?

Accepted Answer

Over the last 30 days of requests through the Respan gateway, the fastest provider was OpenAI at 62 tokens per second, and the lowest response latency was 0.4 seconds on OpenAI. Speed varies with request size and provider.

Question 7

Where does GPT-4o rank on the Respan Index?

Accepted Answer

GPT-4o scores 13.9 out of 100 on the Respan Index v1.1, ranking #130 of 138 models. By category: Coding 2.2, Agents 10.9, Reasoning 9.6, Knowledge & language 25.8, and Human preference 37.9. The Respan Index combines independent and lab-reported benchmark results into one score, using benchmark data collected by llmmetric.com.

Question 8

How does GPT-4o score on benchmarks?

Accepted Answer

GPT-4o has 18 published benchmark scores, including SWE-bench Verified 31%, BALROG 32.3%, and GPQA Diamond 49.2%. Each score links to where it was published; the data is collected by llmmetric.com.

Provider	Context	Input	Output
Azure OpenAIBYOK only`azure/gpt-4o`	128K	$2.50/M	$10.00/M
Azure OpenAIBYOK only`azure/gpt-4o-2024-08-06`	128K	$2.50/M	$10.00/M
Inference.net`inference_net/gpt-4o`	128K	$2.50/M	$10.00/M
OpenAI`openai/gpt-4o`	128K	$2.50/M	$10.00/M
OpenAI`openai/gpt-4o-2024-08-06`	128K	$2.50/M	$10.00/M
OpenAI`openai/gpt-4o-2024-11-20`	128K	$2.50/M	$10.00/M
OpenRouter`openrouter/openai/gpt-4o`	128K	$2.50/M	$10.00/M
OpenRouter`openrouter/openai/gpt-4o-2024-08-06`	128K	$2.50/M	$10.00/M
OpenRouter`openrouter/openai/gpt-4o-2024-11-20`	128K	$2.50/M	$10.00/M
OpenAI`openai/gpt-4o-2024-05-13`	128K	$5.00/M	$15.00/M
OpenRouter`openrouter/openai/gpt-4o-2024-05-13`	128K	$5.00/M	$15.00/M

GPT-4o

Providers

Certified where it counts.

Pricing

Cost by volume

Throughput and latency

Output speed

Time to first token

Response latency

Benchmarks

Respan Indexv1.1

Coding3

Apps

GPT-4o FAQ

Works with your entire stack

Built for AI agents.
Break less.
Ship more.

Agents1

Reasoning3

Math6

Knowledge3

Arena2