Airoboros 70B
The Airoboros Llama 2 70B model is fine-tuned using synthetic data from the Airoboros dataset. It focuses on instruction following and contextual question answering tasks. It aims to provide longer and context-compliant responses while ensuring minimal hallucinations. Researchers can explore various prompts formats like obedient question-answering, summarization, coding instructions, agent/function calling, chain-of-thought scenarios, and reWOO style execution planning to leverage the model's capabilities. With a thorough emphasis on generating optimal responses, the model supports sophisticated execution planning for complex tasks using a range of available tools.
main.py
from openai import OpenAI client = OpenAI( base_url="https://api.respan.ai/api/", api_key="YOUR_RESPAN_API_KEY",) response = client.chat.completions.create( model="openrouter/jondurbin/airoboros-l2-70b", messages=[{"role": "user", "content": "Hello!"}],)print(response.choices[0].message.content)from openai import OpenAI client = OpenAI( base_url="https://api.respan.ai/api/", api_key="YOUR_RESPAN_API_KEY",) response = client.chat.completions.create( model="openrouter/jondurbin/airoboros-l2-70b", messages=[{"role": "user", "content": "Hello!"}],)print(response.choices[0].message.content)Providers
Gateway routes for this model on the Respan gateway, including fallback routes when configured.
Similar
Other models from the same provider available through the gateway.
Respan is committed to maintaining compliance with the most rigorous international safety and security standards.
ISO 27001
Respan is fully compliant with ISO 27001, the internationally recognized standard for information security management.
SOC 2
We meet SOC 2 requirements to ensure secure and compliant management of data across all our systems.
GDPR
With operations designed for global compliance, we operate under GDPR - the world's strictest standard for data privacy.
HIPAA
Respan is HIPAA compliant with a Business Associate Agreement available for healthcare organizations.
Works with your entire stack
Use Respan with your favorite frameworks and tools.
