Skip to main content

Jamba 1.5 Large

Jamba 1.5 Large is part of AI21's new family of open models, offering superior speed, efficiency, and quality. It features a 256K effective context window, the longest among open models, enabling improved performance on tasks like document summarization and analysis. Built on a novel SSM-Transformer architecture, it outperforms larger models like Llama 3.1 70B on benchmarks while maintaining resource efficiency. Read their announcement to learn more.

Input / output price
$2.00 / $8.00 per 1M
Context
256K tokens
Released
Aug 22, 2024
Agent setup

Paste into Claude Code, Cursor, or Codex

Help me set up the Respan gateway: fetch and follow https://www.respan.ai/docs/agent-setup.md. Use model "jamba-1.5-large".

Read docs

Providers

One provider serves this model, priced per 1M tokens after gateway discounts.

ProviderInputOutput
ConcentrateRetiringconcentrate/jamba-1-5-large
$2.00/M$8.00/M

Pricing

USD per 1M tokens on Concentrate, after gateway discounts.

Input
$2.00 per 1M
Output
$8.00 per 1M

Cost by volume

Total cost from 0 to 1T tokens.

$2.00/MConcentrate

Throughput and latency

30-day averages from requests through the Respan gateway. Under each figure, every model on the gateway by its average, this one in blue.

Output speed

Higher is better

1.4tokens/sacross providers

Faster than 3% of the other 596 models on the gateway

Response latency

Lower is better

0.7sacross providers

Faster than 71% of the other 776 models on the gateway

Benchmarks

9 published scores from 2 sources, each linked to where it was published.

Published scores

BenchmarkScore
BFCLhuggingface.co85.5%

Apps

Use Jamba 1.5 Large in the tools you already run. Each guide points the app at the Respan gateway.

Setup guides for more apps are in the integration docs.

Jamba 1.5 Large FAQ

Short answers, built from the data on this page.

Jamba 1.5 Large is a model from AI21 Labs, released on Aug 22, 2024. Jamba 1.5 Large is part of AI21's new family of open models, offering superior speed, efficiency, and quality. It features a 256K effective context window, the longest among open models, enabling improved performance on tasks like document summarization and analysis. Built on a novel SSM-Transformer architecture, it outperforms larger models like Llama 3.1 70B on benchmarks while maintaining resource efficiency. Read their announcement to learn more.

On the Respan gateway, Jamba 1.5 Large costs $2.00 per 1M input tokens and $8.00 per 1M output tokens on Concentrate, after gateway discounts.

Jamba 1.5 Large is served by Concentrate.

Jamba 1.5 Large accepts up to 256K tokens of context.

Point any OpenAI-compatible SDK at https://gateway.respan.ai/v1 with your Respan API key and set the model to "jamba-1.5-large". To set it up with a coding agent, copy the agent setup prompt at the top of this page.

Jamba 1.5 Large has 9 published benchmark scores, including BFCL 85.5%, ARC-Challenge 93%, and GSM8K 87%. Each score links to where it was published; the data is collected by Respan.

Certified where it counts.

Built to meet the security and privacy standards that enterprise and healthcare teams require.

ISO 27001

The internationally recognized standard for information security management.

SOC 2

Secure, compliant management of your data across all of our systems.

GDPR

Operated under GDPR, the world's strictest standard for data privacy.

HIPAA

HIPAA compliant, with a BAA available for healthcare teams.

Works with your entire stack

Use Respan with your favorite frameworks and tools.

AnthropicAI21 LabsxAIVercel AI SDK
LangChainOpenRouterAssemblyAICursor
LiteLLMGroqBasetenMem0
CohereCogneeLlamaIndexFireworks
DeepSeekLinkupHaystackTogether AI
PerplexityInference.netPostHogRubyLLM
SlackMastraAzure OpenAIMistral
AWS BedrockMoonshotHyperspellBAML
ModaInstructorGoogle GeminiParasail
ReductoZapierAgnoNebius
OpenAINovita AIReplicateSuperagent

Built for AI agents.
Break less.
Ship more.