Mistral: Mixtral 8x22B Instruct
The Mixtral-8x22B-Instruct-v0.1 Large Language Model (LLM) by Mistral AI is a fine-tuned version of Mixtral 8x22B with 39B active parameters. The model is designed to offer enhanced instruction fine-tuning features and can generate responses fluently in English, French, Italian, German, and Spanish. It excels in math, coding, reasoning tasks, offers a large context length of 64k, and supports multiple languages. This model provides cost-efficient performance and showcases strong abilities across various language tasks. Its architecture includes unique characteristics like Grouped-Query Attention and Sliding-Window Attention. Its application extends to diverse areas of text generation, coding assistance, and reasoning tasks.
main.py
from openai import OpenAI client = OpenAI( base_url="https://api.respan.ai/api/", api_key="YOUR_RESPAN_API_KEY",) response = client.chat.completions.create( model="openrouter/mistralai/mixtral-8x22b-instruct", messages=[{"role": "user", "content": "Hello!"}],)print(response.choices[0].message.content)from openai import OpenAI client = OpenAI( base_url="https://api.respan.ai/api/", api_key="YOUR_RESPAN_API_KEY",) response = client.chat.completions.create( model="openrouter/mistralai/mixtral-8x22b-instruct", messages=[{"role": "user", "content": "Hello!"}],)print(response.choices[0].message.content)Providers
Gateway routes for this model on the Respan gateway, including fallback routes when configured.
Similar
Other models from the same provider available through the gateway.
Respan is committed to maintaining compliance with the most rigorous international safety and security standards.
ISO 27001
Respan is fully compliant with ISO 27001, the internationally recognized standard for information security management.
SOC 2
We meet SOC 2 requirements to ensure secure and compliant management of data across all our systems.
GDPR
With operations designed for global compliance, we operate under GDPR - the world's strictest standard for data privacy.
HIPAA
Respan is HIPAA compliant with a Business Associate Agreement available for healthcare organizations.
Works with your entire stack
Use Respan with your favorite frameworks and tools.
