DeepSeek R1 Distill Llama 8B
DeepSeek R1 Distill Llama 8B is a distilled large language model based on Llama-3.1-8B-Instruct, using outputs from DeepSeek R1. The model combines advanced distillation techniques to achieve high performance across multiple benchmarks, including: - AIME 2024 pass@1: 50.4 - MATH-500 pass@1: 89.1 - CodeForces Rating: 1205 The model leverages fine-tuning from DeepSeek R1's outputs, enabling competitive performance comparable to larger frontier models. Hugging Face: - Llama-3.1-8B - DeepSeek-R1-Distill-Llama-8B |
- Tool Use
main.py
from openai import OpenAI client = OpenAI( base_url="https://api.respan.ai/api/", api_key="YOUR_RESPAN_API_KEY",) response = client.chat.completions.create( model="novita/deepseek/deepseek-r1-distill-llama-8b", messages=[{"role": "user", "content": "Hello!"}], extra_body={ "fallback_models": ["deepseek/deepseek-r1-distill-llama-8b"], },)print(response.choices[0].message.content)from openai import OpenAI client = OpenAI( base_url="https://api.respan.ai/api/", api_key="YOUR_RESPAN_API_KEY",) response = client.chat.completions.create( model="novita/deepseek/deepseek-r1-distill-llama-8b", messages=[{"role": "user", "content": "Hello!"}], extra_body={ "fallback_models": ["deepseek/deepseek-r1-distill-llama-8b"], },)print(response.choices[0].message.content)Providers
Gateway routes for this model on the Respan gateway, including fallback routes when configured.
Similar
Other models from the same provider available through the gateway.
Certified where it counts.
Built to meet the security and privacy standards that enterprise and healthcare teams require.
ISO 27001
The internationally recognized standard for information security management.
SOC 2
Secure, compliant management of your data across all of our systems.
GDPR
Operated under GDPR, the world's strictest standard for data privacy.
HIPAA
HIPAA compliant, with a BAA available for healthcare teams.
Works with your entire stack
Use Respan with your favorite frameworks and tools.
