Question 1

What is NemoMix Unleashed 12B?

Accepted Answer

NemoMix Unleashed 12B is a model from Other, released on Aug 21, 2024. This one feels a bit different to my previous attempts and seems less prone to repetition, especially on higher contexts, which is great for me! I'll probably improve on it even further, but for now, it feels rather nice. Great for RP and storytelling. All credits and thanks go to the amazing MistralAI, Intervitens, Sao10K and Nbeerbower for their amazing models! Plus, special shoutouts to Parasitic Rogue for ideas and Prodeus Unity and Statuo for cool exl2 quants of my previous merges. Cheers to folks over at the Drummer's server! Have a good one, everyone.

Question 2

How much does NemoMix Unleashed 12B cost?

Accepted Answer

On the Respan gateway, input starts at $0.87 per 1M tokens on Featherless, and output starts at $0.99 per 1M tokens on Featherless, after gateway discounts.

Question 3

Which providers serve NemoMix Unleashed 12B on Respan?

Accepted Answer

NemoMix Unleashed 12B is served by Featherless.

Question 4

What is NemoMix Unleashed 12B's context window?

Accepted Answer

NemoMix Unleashed 12B accepts up to 33K tokens of context.

Question 5

How do I use NemoMix Unleashed 12B with the Respan gateway?

Accepted Answer

Point any OpenAI-compatible SDK at https://api.respan.ai/api/ with your Respan API key and set the model to "nemomix-unleashed-12b". To set it up with a coding agent, copy the agent setup prompt at the top of this page.

Question 6

How fast is NemoMix Unleashed 12B?

Accepted Answer

Over the last 30 days of requests through the Respan gateway, the fastest provider was Featherless at 22 tokens per second, and the lowest response latency was 5.8 seconds on Featherless. Speed varies with request size and provider.

NemoMix Unleashed 12B

Providers

Pricing

Cost by volume

Throughput and latency

Output speed

Response latency

Apps

Certified where it counts.