Question 1

What is Mistral Medium Latest?

Accepted Answer

Mistral Medium Latest is a model from Mistral, released on Feb 26, 2024. Mistral AI's medium-sized model, soon to be deprecated, is a closed-source model known for its impressive abilities in reasoning, code comprehension, JSON handling, and chat applications.

Powered by a proprietary closed-source prototype, it has demonstrated competitive performance in benchmark evaluations, often rivaling leading models from other companies.

However, please note that this model is approaching deprecation and may soon be replaced by newer versions with further advancements and improvements. Stay tuned for the latest updates from Mistral AI.

Question 2

How much does Mistral Medium Latest cost?

Accepted Answer

On the Respan gateway, input starts at $1.50 per 1M tokens on Mistral, and output starts at $7.50 per 1M tokens on Mistral, after gateway discounts. Averaged across 3 providers, it costs $1.91 per 1M input tokens and $7.73 per 1M output tokens.

Question 3

Which providers serve Mistral Medium Latest on Respan?

Accepted Answer

3 providers serve Mistral Medium Latest: Mistral. Mistral require your own provider API key (BYOK).

Question 4

What is Mistral Medium Latest's context window?

Accepted Answer

Mistral Medium Latest accepts up to 262K tokens of context on its largest provider route.

Question 5

How do I use Mistral Medium Latest with the Respan gateway?

Accepted Answer

Point any OpenAI-compatible SDK at https://api.respan.ai/api/ with your Respan API key and set the model to "mistral/mistral-medium". To set it up with a coding agent, copy the agent setup prompt at the top of this page.

Question 6

How fast is Mistral Medium Latest?

Accepted Answer

Over the last 30 days of requests through the Respan gateway, the fastest provider was Mistral at 31 tokens per second, and the lowest response latency was 0.3 seconds on Mistral. Speed varies with request size and provider.

Provider	Context	Input	Output
MistralBYOK only`mistral/mistral-medium-2604`	262K	$1.50/M	$7.50/M
MistralBYOK only`mistral/mistral-medium-latest`	262K	$1.50/M	$7.50/M
MistralBYOK only`mistral/mistral-medium`	262K	$2.73/M	$8.20/M

Mistral Medium Latest

Providers

Certified where it counts.

Pricing

Cost by volume

Throughput and latency

Output speed

Response latency

Apps