Sandbox
4 repos for web-crawling · Any agent · DataClear
Sriram-PR/
doc-scraper

Go web crawler to scrape documentation sites and convert content to clean Markdown for LLM ingestion (RAG, training data).

99

A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.

2.6k
brettdavies/
crawl4ai-skill

Scrape JavaScript-heavy sites and extract structured data via reusable CSS schemas. Portable agent skill wrapping the Crawl4AI CLI and Python SDK.

46