Question 1

What is GPT-4?

Accepted Answer

GPT-4 is a model from OpenAI, released on Mar 14, 2023. GPT-4, OpenAI's multimodal language model, excels in problem-solving due to its vast general knowledge and advanced reasoning capabilities. Its training data cutoff is September 2021, and it offers a context window of 8,192 tokens.

GPT-4 currently points to gpt-4-0613. As a snapshot of GPT-4 from June 13th, 2023, GPT-4-0613 features enhanced function calling support. This version is available as a snapshot of the continuously upgraded GPT-4 model.

GPT-4's capabilities extend beyond language processing, demonstrating strong performance in multilingual settings. In the MMLU benchmark, it surpasses previous models in both English and other languages, showcasing its versatility and adaptability.

Question 2

How much does GPT-4 cost?

Accepted Answer

On the Respan gateway, input starts at $30.00 per 1M tokens on every provider, and output starts at $60.00 per 1M tokens on every provider, after gateway discounts.

Question 3

Which providers serve GPT-4 on Respan?

Accepted Answer

4 providers serve GPT-4: Azure OpenAI, OpenAI, and OpenRouter. Azure OpenAI requires your own provider API key (BYOK).

Question 4

What is GPT-4's context window?

Accepted Answer

GPT-4 accepts up to 128K tokens of context on its largest provider route.

Question 5

How do I use GPT-4 with the Respan gateway?

Accepted Answer

Point any OpenAI-compatible SDK at https://api.respan.ai/api/ with your Respan API key and set the model to "openai/gpt-4-0613". To set it up with a coding agent, copy the agent setup prompt at the top of this page.

Question 6

How fast is GPT-4?

Accepted Answer

Over the last 30 days of requests through the Respan gateway, the fastest provider was OpenRouter at 11 tokens per second, and the lowest response latency was 0.9 seconds on OpenRouter. Speed varies with request size and provider.

Provider	Context	Input	Output
Azure OpenAIBYOK only`azure/gpt-4`	128K	$30.00/M	$60.00/M
OpenAI`openai/gpt-4`	8K	$30.00/M	$60.00/M
OpenAI`openai/gpt-4-0613`	8K	$30.00/M	$60.00/M
OpenRouter`openrouter/openai/gpt-4`	8K	$30.00/M	$60.00/M

GPT-4

Providers

Certified where it counts.

Pricing

Cost by volume

Throughput and latency

Output speed

Response latency

Apps

GPT-4 FAQ

Works with your entire stack

Built for AI agents.
Break less.
Ship more.