Vision Agents (open source)
$0
- Apache-2.0 licensed framework
- Self-host on any WebRTC network or local devices
Stream is the company behind chat, video, and activity feed APIs used inside consumer and enterprise apps. Headquartered in Boulder, Colorado, with an office in Amsterdam, it now also builds Vision Agents, an open-source Python framework for agents that see, hear, and talk in real time.
Vision Agents streams audio and video frames over WebRTC straight to models such as OpenAI Realtime and Gemini Live, with vision pipelines (YOLO, Roboflow, Moondream) that run before or after the model call. It handles turn detection, tool calling and MCP, memory, RAG, and inbound or outbound phone calls through Twilio or Telnyx. The framework is edge-agnostic: Stream's own low-latency edge network is the default, but it also runs on any WebRTC infrastructure or local devices.
Core capabilities this platform advertises.
What this tool does well, and the limitations to keep in mind.
Pros
Cons
What's included in each plan, and how the tiers compare.
$0
Usage-based
Python developers building real-time voice and video agents, from phone agents to vision-based coaching and live-call assistants.
Vision Agents handles the real-time audio and video, and Respan covers the model calls behind it. Route, observe, and evaluate every LLM call your agent makes during a session.
Respan traces each model call your agent makes during a session, routes it across 1,000+ models, and scores output on live traffic, so cost and quality for every run sit on one record. Start free.
Try Respan freeTop companies in Agent Frameworks you can use instead of Stream.
OpenClaw
Connects to 50+ channels — WhatsApp, Telegram, Slack, Discord, Signal, iMessage, Teams
LangChain
LangChain Expression Language (LCEL)
AutoGPT
Visual workflow builder with composable agent 'blocks'
LangGraph
Graph-based agent workflows with nodes, edges, and conditional routing
Strands
OpenAI Agents SDK
Llama Stack
GripTape
CrewAI
Multi-agent role-based collaboration
AutoGen
Multi-agent conversation framework
Google ADK
Vercel AI SDK
TypeScript-first AI SDK
Dify
Visual workflow builder for AI apps
DSPy
Semantic Kernel
Enterprise AI orchestration by Microsoft
Pydantic AI
Type-safe agent inputs, outputs, and tool calls via Python type hints
Instructor
Hermes Agent
Persistent memory across sessions in ~/.hermes/memories/
Agno
23+ LLM providers (OpenAI, Anthropic, Gemini, etc.) and 100+ tool integrations
Atomic Agents
Built on Instructor for structured outputs
Smolagents
21st.dev
Largest React component registry — shadcn/ui + Tailwind based
Terminal Use
Agent hosting & deployment
Mastra
TypeScript agent framework
Side-by-side comparisons with other tools in this category.
Companies from adjacent layers in the AI stack that work well with Stream.