WizardLM 2 8x22B
The WizardLM-2 7B model, developed by WizardLM@Microsoft AI, is a fast and efficient variant of Microsoft AI's latest Wizard model. By finetuning Mistral 7B Instruct, it achieves comparable performance to models 10 times its size. This multilingual model combines speed with high reasoning capabilities, making it a top choice for various tasks. Utilizing a synthetic training system, WizardLM-2 models have undergone rigorous evaluations. They have shown competitive performance in MT-Bench evaluations, surpassing leading baselines at different model scales. Human Preferences Evaluations have also highlighted the strengths of WizardLM-2 models in various tasks such as writing, coding, math, and reasoning. The WizardLM-2 7B supports multi-turn conversations and adopts the prompt format from Vicuna.
- Tool Use
main.py
from openai import OpenAI client = OpenAI( base_url="https://api.respan.ai/api/", api_key="YOUR_RESPAN_API_KEY",) response = client.chat.completions.create( model="novita/microsoft/wizardlm-2-8x22b", messages=[{"role": "user", "content": "Hello!"}], extra_body={ "fallback_models": ["microsoft/wizardlm-2-8x22b"], },)print(response.choices[0].message.content)from openai import OpenAI client = OpenAI( base_url="https://api.respan.ai/api/", api_key="YOUR_RESPAN_API_KEY",) response = client.chat.completions.create( model="novita/microsoft/wizardlm-2-8x22b", messages=[{"role": "user", "content": "Hello!"}], extra_body={ "fallback_models": ["microsoft/wizardlm-2-8x22b"], },)print(response.choices[0].message.content)Providers
Gateway routes for this model on the Respan gateway, including fallback routes when configured.
Similar
Other models from the same provider available through the gateway.
Certified where it counts.
Built to meet the security and privacy standards that enterprise and healthcare teams require.
ISO 27001
The internationally recognized standard for information security management.
SOC 2
Secure, compliant management of your data across all of our systems.
GDPR
Operated under GDPR, the world's strictest standard for data privacy.
HIPAA
HIPAA compliant, with a BAA available for healthcare teams.
Works with your entire stack
Use Respan with your favorite frameworks and tools.
