brettdavies/
crawl4ai-skill
Scrape JavaScript-heavy sites and extract structured data via reusable CSS schemas. Portable agent skill wrapping the Crawl4AI CLI and Python SDK.
46
D4Vinci/ScraplingFrameworks & SDKs
🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!
80k
exa-labs/
exa-mcp-server
exa-labs/exa-mcp-serverConnectors
Exa MCP for web search and web crawling!
5k
bzsasson/
screaming-frog-mcp
bzsasson/screaming-frog-mcpConnectors
Headless MCP server for Screaming Frog SEO Spider – run crawls, export and analyze crawl data via the CLI. Small locked-down tool surface for scheduled audits, CI, and unattended AI agents.
84
Sriram-PR/
doc-scraper
Go web crawler to scrape documentation sites and convert content to clean Markdown for LLM ingestion (RAG, training data).
99
apify/apify-mcp-serverConnectors
The Apify MCP server enables your AI agents to extract data from social media, search engines, maps, e-commerce sites, or any other website using thousands of ready-made scrapers, crawlers, and automation tools available on the Apify Store.
6.7k
brightdata/brightdata-mcpConnectors
A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.
2.6k