Apify is a full-stack web scraping and automation platform with a marketplace of 6,000+ pre-built scrapers (Actors). It provides managed browser infrastructure, proxy rotation, and data storage for large-scale web data extraction. Apify is widely used for feeding web data into AI applications and RAG pipelines.
ScrapeGraphAI is an open-source web scraping library that uses LLMs to automatically extract structured data from websites. Instead of writing CSS selectors or XPath queries, developers describe what data they want in natural language. Supports multiple LLM providers and handles dynamic JavaScript-rendered pages.
Respan lets you trace LLM and agent calls across any model or framework, A/B test prompts on production traffic, and route requests across 500+ models through one gateway.