Question 1

What is Mistral Nemo Instruct?

Accepted Answer

Mistral Nemo Instruct is a model from Mistral, released on Jul 18, 2024. A 12B parameter model with a 128k token context length built by Mistral in collaboration with NVIDIA. The model is multilingual, supporting English, French, German, Spanish, Italian, Portuguese, Chinese, Japanese, Korean, Arabic, and Hindi. It supports function calling and is released under the Apache 2.0 license.

Question 2

How much does Mistral Nemo Instruct cost?

Accepted Answer

On the Respan gateway, input starts at $0.02 per 1M tokens on DeepInfra, and output starts at $0.03 per 1M tokens on DeepInfra, after gateway discounts. Averaged across 3 providers, it costs $0.10 per 1M input tokens and $0.13 per 1M output tokens.

Question 3

Which providers serve Mistral Nemo Instruct on Respan?

Accepted Answer

3 providers serve Mistral Nemo Instruct: DeepInfra, IO.net, and Featherless.

Question 4

What is Mistral Nemo Instruct's context window?

Accepted Answer

Mistral Nemo Instruct accepts up to 131K tokens of context on its largest provider route.

Question 5

How do I use Mistral Nemo Instruct with the Respan gateway?

Accepted Answer

Point any OpenAI-compatible SDK at https://api.respan.ai/api/ with your Respan API key and set the model to "mistral-nemo-instruct". To set it up with a coding agent, copy the agent setup prompt at the top of this page.

Question 6

How fast is Mistral Nemo Instruct?

Accepted Answer

Over the last 30 days of requests through the Respan gateway, the fastest provider was IO.net at 29 tokens per second, and the lowest response latency was 0.8 seconds on IO.net. Speed varies with request size and provider.

Provider	Context	Input	Output
DeepInfra`deepinfra/mistralai/Mistral-Nemo-Instruct-2407`	131K	$0.02/M	$0.03/M
IO.net`ionet/mistralai/Mistral-Nemo-Instruct-2407`	128K	$0.06/M	$0.10/M
Featherless`featherless_ai/mistralai/Mistral-Nemo-Instruct-2407`	33K	$0.22/M	$0.25/M

Mistral Nemo Instruct

Providers

Certified where it counts.

Pricing

Cost by volume

Throughput and latency

Output speed

Response latency

Apps