brettdavies/
crawl4ai-skill
Scrape JavaScript-heavy sites and extract structured data via reusable CSS schemas. Portable agent skill wrapping the Crawl4AI CLI and Python SDK.
46
D4Vinci/ScraplingFrameworks & SDKs
🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!
80k
us/crwConnectors
Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.
970
alizdavoodi/
MCPDocSearch
alizdavoodi/MCPDocSearchConnectors
This project provides a toolset to crawl websites wikis, tool/library documentions and generate Markdown documentation, and make that documentation searchable via a Model Context Protocol (MCP) server, designed for integration with tools like Cursor.
42
KnockOutEZ/wigoloConnectors
The go-to web for your AI coding agent — local-first search, fetch, crawl & research over MCP. No API keys, no cloud, $0/query. Public beta.
5.2k
0xMassi/webclawTools
Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.
2.3k
Goldziher/basemindConnectors
Full AI context and content layer for coding agents over one MCP server — tree-sitter code-map, document RAG, shared memory, multi-agent comms, web crawl, git history + blame. 300+ languages, 10+ agent harnesses, pure Rust.
98
apify/apify-mcp-serverConnectors
The Apify MCP server enables your AI agents to extract data from social media, search engines, maps, e-commerce sites, or any other website using thousands of ready-made scrapers, crawlers, and automation tools available on the Apify Store.
6.7k
firecrawl/firecrawl-mcp-serverConnectors
🔥 Official Firecrawl MCP Server - Adds powerful web scraping and search to Cursor, Claude and any other LLM clients.
7.4k
pinkpixel-dev/
web-scout-mcp
pinkpixel-dev/web-scout-mcpConnectors
An MCP server providing web search and content extraction capabilities. Integrates DuckDuckGo search functionality and URL content extraction into your MCP environment, enabling AI assistants to search the web and extract webpage content.
133
just-every/
mcp-read-website-fast
just-every/mcp-read-website-fastConnectors
Quickly reads webpages and converts to markdown for fast, token efficient web scraping
161
graphlit/
graphlit-mcp-server
graphlit/graphlit-mcp-serverConnectors
Model Context Protocol (MCP) Server for Graphlit Platform
379
brightdata/brightdata-mcpConnectors
A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.
2.6k