Key features
Core capabilities each platform advertises.
- GPU droplets
- Cloud compute
- AI infrastructure
vLLM- PagedAttention and continuous batching for high-throughput serving
- OpenAI-compatible API server, plus Anthropic Messages API and gRPC
- Quantization including FP8, INT4, GPTQ, AWQ, and GGUF
- Speculative decoding and prefix caching
