Question 1

What is Qwen2.5 72B Instruct Abliterated?

Accepted Answer

Qwen2.5 72B Instruct Abliterated is a model from Qwen, released on Oct 26, 2024. This is an uncensored version of Qwen/Qwen2.5-72B-Instruct created with abliteration (see remove-refusals-with-transformers to know more about it). This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens.

Question 2

How much does Qwen2.5 72B Instruct Abliterated cost?

Accepted Answer

On the Respan gateway, input starts at $1.48 per 1M tokens on Featherless, and output starts at $1.60 per 1M tokens on Featherless, after gateway discounts.

Question 3

Which providers serve Qwen2.5 72B Instruct Abliterated on Respan?

Accepted Answer

Qwen2.5 72B Instruct Abliterated is served by Featherless.

Question 4

What is Qwen2.5 72B Instruct Abliterated's context window?

Accepted Answer

Qwen2.5 72B Instruct Abliterated accepts up to 33K tokens of context.

Question 5

How do I use Qwen2.5 72B Instruct Abliterated with the Respan gateway?

Accepted Answer

Point any OpenAI-compatible SDK at https://api.respan.ai/api/ with your Respan API key and set the model to "qwen2.5-72b-instruct-abliterated". To set it up with a coding agent, copy the agent setup prompt at the top of this page.

Question 6

How fast is Qwen2.5 72B Instruct Abliterated?

Accepted Answer

Over the last 30 days of requests through the Respan gateway, the fastest provider was Featherless at 8 tokens per second, and the lowest response latency was 7.8 seconds on Featherless. Speed varies with request size and provider.

Qwen2.5 72B Instruct Abliterated

Providers

Pricing

Cost by volume

Throughput and latency

Output speed

Response latency

Apps

Certified where it counts.