Sandbox
Sign in
8 repos for “web-crawling” · Connectors · Claude CodeClear
Goldziher/basemindConnectors

Full AI context and content layer for coding agents over one MCP server — tree-sitter code-map, document RAG, shared memory, multi-agent comms, web crawl, git history + blame. 300+ languages, 10+ agent harnesses, pure Rust.

98
firecrawl/firecrawl-mcp-serverConnectors

🔥 Official Firecrawl MCP Server - Adds powerful web scraping and search to Cursor, Claude and any other LLM clients.

7.4k
brightdata/brightdata-mcpConnectors

A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.

2.6k
KnockOutEZ/wigoloConnectors

The go-to web for your AI coding agent — local-first search, fetch, crawl & research over MCP. No API keys, no cloud, $0/query. Public beta.

5.2k
pinkpixel-dev/
web-scout-mcp
pinkpixel-dev/web-scout-mcpConnectors

An MCP server providing web search and content extraction capabilities. Integrates DuckDuckGo search functionality and URL content extraction into your MCP environment, enabling AI assistants to search the web and extract webpage content.

133
adityaarsharma/
librecrawl-technical-seo-audit-mcp
adityaarsharma/librecrawl-technical-seo-audit-mcpConnectors

The AI-native technical SEO crawler. Open-source MCP server for Claude / Cursor / Codex — 37 tools, 50+ checks, unlimited pages, WAF detection, ephemeral by design. Built on LibreCrawl. MIT.

39
us/crwConnectors

Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.

970