What is Llama3.1 8B Instant?

Llama3.1 8B Instant is a model from Meta, released on Jul 23, 2024. Llama 3 1 8b is a Meta Llama-family model for general-purpose generation, reasoning, coding, or chat workloads.

How much does Llama3.1 8B Instant cost?

On the Respan gateway, input starts at $0.20 per 1M tokens on TogetherAI, and output starts at $0.20 per 1M tokens on TogetherAI, after gateway discounts.

Which providers serve Llama3.1 8B Instant on Respan?

Llama3.1 8B Instant is served by TogetherAI. TogetherAI requires your own provider API key (BYOK).

What is Llama3.1 8B Instant's context window?

Llama3.1 8B Instant accepts up to 16K tokens of context.

How do I use Llama3.1 8B Instant with the Respan gateway?

Point any OpenAI-compatible SDK at https://api.respan.ai/api/ with your Respan API key and set the model to "llama-3.1-8b". To set it up with a coding agent, copy the agent setup prompt at the top of this page.