Question 1

What is Llama 3.1 Nemotron 70B Instruct HF?

Accepted Answer

Llama 3.1 Nemotron 70B Instruct HF is a model from NVIDIA, released on Oct 15, 2024. Llama 3.1 Nemotron 70B Instruct HF is an open-weight Llama-class model commonly used for chat, fine-tuning, and on-prem or hosted inference. Llama 3.1 Nemotron 70B Instruct HF is an open-weight Llama-class model commonly used for chat, fine-tuning, and on-prem or hosted inference. Up to 33K context window.

Question 2

How much does Llama 3.1 Nemotron 70B Instruct HF cost?

Accepted Answer

On the Respan gateway, input starts at $0.88 per 1M tokens on TogetherAI, and output starts at $0.88 per 1M tokens on TogetherAI, after gateway discounts.

Question 3

Which providers serve Llama 3.1 Nemotron 70B Instruct HF on Respan?

Accepted Answer

Llama 3.1 Nemotron 70B Instruct HF is served by TogetherAI. TogetherAI requires your own provider API key (BYOK).

Question 4

What is Llama 3.1 Nemotron 70B Instruct HF's context window?

Accepted Answer

Llama 3.1 Nemotron 70B Instruct HF accepts up to 33K tokens of context.

Question 5

How do I use Llama 3.1 Nemotron 70B Instruct HF with the Respan gateway?

Accepted Answer

Point any OpenAI-compatible SDK at https://api.respan.ai/api/ with your Respan API key and set the model to "llama-3.1-nemotron-70b-instruct-hf". To set it up with a coding agent, copy the agent setup prompt at the top of this page.

Llama 3.1 Nemotron 70B Instruct HF

Providers

Pricing

Cost by volume

Apps