How much does GPT-3.5 Turbo (batch) cost?

On the Respan gateway, input starts at $0.25 per 1M tokens on OpenRouter, and output starts at $0.75 per 1M tokens on OpenRouter, after gateway discounts.

Which providers serve GPT-3.5 Turbo (batch) on Respan?

GPT-3.5 Turbo (batch) is served by OpenRouter.

What is GPT-3.5 Turbo (batch)'s context window?

GPT-3.5 Turbo (batch) accepts up to 16K tokens of context.

How do I use GPT-3.5 Turbo (batch) with the Respan gateway?

Point any OpenAI-compatible SDK at https://api.respan.ai/api/ with your Respan API key and set the model to "gpt-3.5-turbo:batch". To set it up with a coding agent, copy the agent setup prompt at the top of this page.

GPT-3.5 Turbo (batch)

GPT-3.5 Turbo is OpenAI's fastest model. It can understand and generate natural language or code, and is optimized for chat and traditional completion tasks. Training data up to Sep 2021.