Together AI — Inference & Compute Platform
Inference & ComputeLayer 1Usage-basedWhat is Together AI?
Together AI is a cloud-based platform for building with open-source generative AI, founded on June 11, 2022 in San Francisco by Ce Zhang, Chris Re, Percy Liang, and Vipul Ved Prakash. The company raised USD 305 million in Series B funding in 2025 with participation from industry leaders including NVIDIA and Salesforce Ventures. Together AI provides serverless inference with pay-as-you-go pricing starting from USD 0.10 per million tokens for small models and USD 0.90 for Llama 3 70B, with a free USD 5 credit to start. The platform offers a 50 percent discount on batch inference and 50 percent savings on prompt caching for repetitive queries. For teams requiring dedicated resources, Together AI provides GPU endpoints billed per minute, with high-end H100 and H200 GPUs available. The platform specializes in open-source model deployment and provides instant GPU clusters for training and inference workloads. Together AI has become a leading platform for teams building with open-source AI models, offering both serverless convenience and dedicated infrastructure options.
Key Features
- ✓Inference and training cloud
- ✓Open-source model hosting
- ✓Serverless inference endpoints
- ✓Fine-tuning as a service
- ✓Competitive GPU pricing
Pros & Cons
Pros
- +Competitive pricing starting at USD 0.10 per million tokens
- +50 percent discounts on batch inference and prompt caching
- +Strong backing from NVIDIA and Salesforce Ventures
- +Flexible deployment with both serverless and dedicated options
Cons
- -Focused on open-source models may limit access to proprietary models
- -Per-minute billing for dedicated GPUs can be complex to predict
- -Newer platform with less extensive documentation than established providers
- -Pricing varies significantly by model making cost planning difficult
Together AI Pricing
Free trial available
- ✓Pay-as-you-go
- ✓Multiple open-source models
- ✓USD 5 free credit
- ✓Llama 3 70B at USD 0.90/M tokens
- ✓Bulk processing discount
- ✓Async execution
- ✓Cost optimization
- ✓H100, H200 GPUs
- ✓Reserved capacity
- ✓Production workloads
- ✓Custom pricing
Common Use Cases
Developers and companies deploying open-source AI models in production
- •Hosting open-source LLMs in production
- •Fine-tuning models on custom data
- •Cost-efficient inference at scale
- •Training custom models
- •Rapid model prototyping
Using Together AI with Respan
Together AI and Respan enable open-source AI deployment with cost tracking. Run models on Together AI while monitoring usage with Respan.
- ✓Track costs across serverless and dedicated GPU endpoints
- ✓Monitor batch inference efficiency and caching effectiveness
- ✓Compare Together AI performance against other inference providers
- ✓Optimize model selection based on Respan cost and latency analytics
Best Together AI Alternatives & Competitors
Top companies in Inference & Compute you can use instead of Together AI.
Compare Together AI
Best Integrations for Together AI
Companies from adjacent layers in the AI stack that work well with Together AI.
Last verified: March 9, 2026