Go web crawler to scrape documentation sites and convert content to clean Markdown for LLM ingestion (RAG, training data).

Agentic RAG for local and self-hosted document search: hybrid retrieval, reranking and multimodal RAG on embedded LanceDB, with Docling parsing and an MCP server