Question 1

What is Gemma 2 9B IT?

Accepted Answer

Gemma 2 9B IT is a model from Google Gemini AI, released on Jun 27, 2024. Gemma 2 9B by Google is an advanced, open-source language model that sets a new standard for efficiency and performance in its size class. Designed for a wide variety of tasks, it empowers developers and researchers to build innovative applications, while maintaining accessibility, safety, and cost-effectiveness. See the launch announcement for more details. Usage of Gemma is subject to Google's Gemma Terms of Use.

Question 2

How much does Gemma 2 9B IT cost?

Accepted Answer

On the Respan gateway, input starts at $0.43 per 1M tokens on Featherless, and output starts at $1.12 per 1M tokens on Featherless, after gateway discounts.

Question 3

Which providers serve Gemma 2 9B IT on Respan?

Accepted Answer

Gemma 2 9B IT is served by Featherless.

Question 4

What is Gemma 2 9B IT's context window?

Accepted Answer

Gemma 2 9B IT accepts up to 16K tokens of context.

Question 5

How do I use Gemma 2 9B IT with the Respan gateway?

Accepted Answer

Point any OpenAI-compatible SDK at https://api.respan.ai/api/ with your Respan API key and set the model to "gemma-2-9b-it". To set it up with a coding agent, copy the agent setup prompt at the top of this page.

Question 6

How fast is Gemma 2 9B IT?

Accepted Answer

Over the last 30 days of requests through the Respan gateway, the fastest provider was Featherless at 4 tokens per second, and the lowest response latency was 4.5 seconds on Featherless. Speed varies with request size and provider.

Gemma 2 9B IT

Providers

Pricing

Cost by volume

Throughput and latency

Output speed

Response latency

Apps

Certified where it counts.

Gemma 2 9B IT FAQ

Works with your entire stack

Built for AI agents.
Break less.
Ship more.