Sandbox
@brightdata/brightdata-mcp

MCP server for web search, scraping, and browser automation

Bright Data MCP connects an agent to public web search, page scraping, structured data extraction, and remote browser automation. It exposes a large tool set for live web work, including search engines, site-specific extractors, package registry lookups, and browser actions like navigate, click, type, and screenshot.

2,636 stars326 forksJavaScriptUpdated 1mo ago
Who it's for

Builders who want their agent to pull live web data, read blocked pages, or automate browser tasks through MCP.

What it delivers

You can give your agent reliable access to current web data instead of relying on brittle scraping code or stale answers.

What it does

Web search

Search Google, Bing, and Yandex and return results as structured data.

Page scraping

Fetch any URL as Markdown or HTML, with bot detection, CAPTCHA solving, and proxy rotation handled for you.

Structured extraction

Pull clean JSON from supported sites like Amazon, LinkedIn, TikTok, YouTube, X, Reddit, Zillow, and more.

Browser automation

Use a remote browser to navigate, click, type, scroll, screenshot, and inspect page text and HTML.

LLM response collection

Ask ChatGPT, Grok, or Perplexity a prompt and get the responses back as structured data.

Package registry data

Look up npm and PyPI package metadata, README content, versions, and dependencies without scraping registries.

Tool grouping

Load only the tool groups you need, such as ecommerce, social, browser, business, finance, research, app stores, travel, geo, code, and advanced scraping.

How to get it

  1. 1Hosted server — no installation. Add this URL to your MCP client
    https://mcp.brightdata.com/mcp?token=YOUR_API_TOKEN_HERE
  2. 2Run
    claude mcp add --transport http brightdata "https://mcp.brightdata.com/mcp?token=YOUR_API_TOKEN"

README

Bright Data Logo

Bright Data MCP

Web search, page scraping, structured data extraction, and browser automation for AI agents and LLMs over the Model Context Protocol.

Works with AI agents, coding agents, chat assistants, and any MCP-compatible client.

npm version npm downloads License

Quick StartPricingUse CasesToolsAgent SkillsDocsSupport

Free tier: 5,000 requests per month. No credit card required. Renews monthly.


Overview

The Bright Data MCP server gives AI agents real-time access to public web data. It exposes 69 tools covering:

  • Web search — Google, Bing, and Yandex results as structured data
  • Page scraping — any URL as Markdown or HTML, with bot detection, CAPTCHA solving, and proxy rotation handled automatically on every request
  • Structured data extraction — clean JSON from Amazon, LinkedIn, Instagram, TikTok, YouTube, X, Reddit, Facebook, Crunchbase, Zillow, and other major platforms, without parsing HTML
  • Browser automation — navigate, click, type, screenshot, and read pages in a remote browser session
  • LLM response collection — send prompts to ChatGPT, Grok, and Perplexity and get their answers back as structured data
  • Package registry data — npm and PyPI package versions, READMEs, dependencies, and metadata

Every request is routed through Bright Data's unblocking infrastructure, so pages that block ordinary HTTP clients (bot detection, CAPTCHAs, rate limits, geo-restrictions) return normally. No proxy setup, no headless browser maintenance, no retry logic to write.

Two deployment options: a hosted remote server (one URL, no installation) or a local instance via npx @brightdata/mcp.


Quick Start

Hosted server — no installation. Add this URL to your MCP client:

https://mcp.brightdata.com/mcp?token=YOUR_API_TOKEN_HERE

Get your API token from your Bright Data account settings. New accounts get 5,000 free requests per month.

Optional URL parameters:

ParameterDescriptionExample
groups=<ids>Enable specific tool groups...&groups=social,ecommerce
tools=<names>Enable specific tools only...&tools=search_engine,scrape_as_markdown
Claude Desktop
  1. Go to: Settings → Connectors → Add custom connector
  2. Name: Bright Data
  3. URL: https://mcp.brightdata.com/mcp?token=YOUR_API_TOKEN
  4. Click "Add"

Or run locally:

{
  "mcpServers": {
    "Bright Data": {
      "command": "npx",
      "args": ["@brightdata/mcp"],
      "env": {
        "API_TOKEN": "<your-api-token-here>"
      }
    }
  }
}
Claude Code
claude mcp add --transport http brightdata "https://mcp.brightdata.com/mcp?token=YOUR_API_TOKEN"
Cursor

Add to ~/.cursor/mcp.json:

{
  "mcpServers": {
    "brightdata": {
      "url": "https://mcp.brightdata.com/mcp?token=YOUR_API_TOKEN"
    }
  }
}
VS Code

Add to .vscode/mcp.json:

{
  "servers": {
    "brightdata": {
      "type": "http",
      "url": "https://mcp.brightdata.com/mcp?token=YOUR_API_TOKEN"
    }
  }
}
Windsurf

Add to ~/.codeium/windsurf/mcp_config.json:

{
  "mcpServers": {
    "brightdata": {
      "serverUrl": "https://mcp.brightdata.com/mcp?token=YOUR_API_TOKEN"
    }
  }
}
Gemini CLI

Add to ~/.gemini/settings.json:

{
  "mcpServers": {
    "brightdata": {
      "httpUrl": "https://mcp.brightdata.com/mcp?token=YOUR_API_TOKEN"
    }
  }
}
Zed

Add to your Zed settings:

{
  "context_servers": {
    "brightdata": {
      "url": "https://mcp.brightdata.com/mcp?token=YOUR_API_TOKEN"
    }
  }
}
Warp

Go to Settings > MCP Servers > Add MCP Server and add:

{
  "brightdata": {
    "url": "https://mcp.brightdata.com/mcp?token=YOUR_API_TOKEN"
  }
}
Other clients (local npx)

For any client that supports local MCP servers:

{
  "mcpServers": {
    "Bright Data": {
      "command": "npx",
      "args": ["@brightdata/mcp"],
      "env": {
        "API_TOKEN": "<your-api-token-here>"
      }
    }
  }
}

Pricing and Free Tier

Every account includes a recurring monthly free tier. No credit card or commitment required to start.

5,000 free requests per month, renewing on the 1st of each month. Unused requests don't roll over. For team accounts, the free tier is shared across all users in the account.

What's included free:

  • Fetch any webpage and extract as Markdown
  • Access to 60+ pre-built scrapers for popular domains
  • Web search (Google, Bing, Yandex)
  • Web unlocking (bot detection bypass, CAPTCHA solving, proxy rotation)
  • Browser automation
  • Geo-targeting

Beyond the free tier — pay as you go, no commitment:

Search, Scrape & ExtractBrowser Navigation
Pay as you go$1.50 / 1K results$8 / GB
  • When free requests run out, requests stop. No surprise charges — unless you have deposited funds
  • Adding a credit card is a verification step only; you are not charged unless your free tier is exhausted and you have funds deposited
  • Set a spend cap in the control panel so pay-as-you-go usage never exceeds your budget

Full pricing, volume plans and enterprise →


Use Cases

Real-time research

Answer questions using live web data instead of training data. Search, then read the sources.

TaskTools
Search the web for current informationsearch_engine, search_engine_batch
Read a specific page as clean Markdownscrape_as_markdown, scrape_batch
Find the most relevant sources for a research question, ranked by AI relevance scorediscover

Example prompts: "What's Tesla's current stock price?", "Get today's weather forecast for New York", "Find the most cited sources on EU AI regulation from the last 6 months".

E-commerce intelligence

Read product data as structured JSON: price, availability, rating, review count, seller, images.

TaskTools
Amazon product details, reviews, search resultsweb_data_amazon_product, web_data_amazon_product_reviews, web_data_amazon_product_search
Walmart, eBay, Best Buy, Etsy, Home Depot, Zara productsweb_data_walmart_product, web_data_ebay_product, web_data_bestbuy_products, web_data_etsy_products, web_data_homedepot_products, web_data_zara_products
Cross-retailer price viewweb_data_google_shopping
Seller profilesweb_data_walmart_seller

Example prompts: "Compare this laptop's price on Amazon vs Walmart vs Best Buy", "Get the rating and review count for ASIN B0D2Q9397Y", "Is this product in stock?".

Market and competitor analysis

Build competitor profiles from live data: funding, headcount, hiring, customer reviews, pricing pages.

TaskTools
Company funding, investors, sizeweb_data_crunchbase_company, web_data_zoominfo_company_profile
Company pages, employees, job postingsweb_data_linkedin_company_profile, web_data_linkedin_job_listings
Customer sentimentweb_data_google_maps_reviews, web_data_facebook_company_reviews, app store review tools
Competitor pricing pagesscrape_as_markdown, scrape_batch
Market discoverysearch_engine_batch, discover

Example prompt: "Analyze Notion as a competitor: pricing, funding, hiring focus, and what customers complain about".

AI agents with reliable web access

Replace built-in fetch/search tools that get blocked on protected sites. Every request goes through unblocking infrastructure, so agents don't fail on bot detection, CAPTCHAs, or geo-restrictions.

TaskTools
Drop-in replacement for built-in web searchsearch_engine
Drop-in replacement for built-in URL fetchscrape_as_markdown
Parallel data collection (10 at a time)search_engine_batch, scrape_batch
Interactive sites (login walls, infinite scroll, dynamic content)scraping_browser_* (13 tools)
Structured JSON from any page, no schema neededextract

Coding agents

Package registry data on demand — no scraping, no stale caches.

TaskTools
npm package version, README, dependencies, metadataweb_data_npm_package
PyPI package version, README, dependencies, metadataweb_data_pypi_package
Read files from GitHub repositoriesweb_data_github_repository_file

Example prompts: "What's the latest version of express on npm?", "Get the README for the langchain-brightdata PyPI package".

GEO and brand visibility

Send prompts to major LLMs and get their answers back as structured data. Measure how AI assistants describe your brand, which sources they cite, and what they recommend — the feedback loop for Generative Engine Optimization.

TaskTools
ChatGPT answers with citations and recommendationsweb_data_chatgpt_ai_insights
Grok answersweb_data_grok_ai_insights
Perplexity answers with sourcesweb_data_perplexity_ai_insights

Example prompt: "Ask ChatGPT, Grok, and Perplexity 'what is the best proxy provider' and compare how each one ranks us".

Social media monitoring

Structured data from seven platforms: profiles, posts, comments, engagement metrics.

PlatformTools
LinkedInperson profiles, company profiles, job listings, posts, people search (5 tools)
Instagramprofiles, posts, reels, comments (4 tools)
TikTokprofiles, posts, shop, comments (4 tools)
Facebookposts, marketplace listings, company reviews, events (4 tools)
YouTubevideos, channel profiles, comments (3 tools)
X (Twitter)posts, profile posts (2 tools)
Redditposts (1 tool)

Example prompt: "Get the last 10 posts from this TikTok profile and summarize the engagement".

Content creation and academic research

Gather source material from many pages at once, filtered by recency and relevance.

TaskTools
Collect multiple sources in one callscrape_batch (up to 10 URLs)
Find sources by topic with date filteringdiscover with start_date / end_date
News and finance dataweb_data_yahoo_finance_business, search_engine with news queries

How It Compares

CapabilityBright Data MCPTypical web MCP servers
Total tools692–10
Platform-specific structured JSON extractors45 tools across e-commerce, social, business, finance, travel, app storesRare; generic scraping only
Unblocking (bot detection bypass, CAPTCHA solving, proxy rotation)Built into every requestUsually none; blocked on protected sites
Search enginesGoogle, Bing, YandexUsually one
AI-relevance-ranked search with intentYes (discover)Not offered
Browser automation13 tools, remote browser, no local setupLimited or none
LLM response collection (ChatGPT, Grok, Perplexity)YesNot offered
Package registry data (npm, PyPI)YesNot offered
Batch operations10 searches or 10 scrapes per callUsually single-request only
Geo-targetingYesLimited or none
Free tier5,000 requests/month, browser automation included, no credit cardVaries; often rate-limited keyless access

Tool Selection: Groups

Tools are organized into groups so you only load what you need. Fewer tools means less context for your agent to process.

  • GROUPS enables tool bundles. Comma-separated: GROUPS="ecommerce,browser" (local) or &groups=ecommerce,browser (hosted URL)
  • TOOLS adds individual tools on top: TOOLS="extract,scrape_as_html"
  • Base tools are always enabled: search_engine, search_engine_batch, scrape_as_markdown, scrape_batch, discover
  • Group ID custom is reserved; use TOOLS for individual picks
Group IDContentsTool count
ecommerceAmazon, Walmart, eBay, Best Buy, Etsy, Home Depot, Zara, Google Shopping11
socialLinkedIn, Instagram, Facebook, TikTok, YouTube, X, Reddit23
browserRemote browser automation13
businessCrunchbase, ZoomInfo, Google Maps reviews, Zillow4
financeYahoo Finance1
researchGitHub repository files1
app_storesGoogle Play, Apple App Store2
travelBooking.com1
geoChatGPT, Grok, Perplexity response collection3
codenpm, PyPI package data2
advanced_scrapingBatch tools, HTML scraping, AI extraction, session stats5

Configuration examples

Local server with browser automation and AI extraction:

{
  "mcpServers": {
    "Bright Data": {
      "command": "npx",
      "args": ["@brightdata/mcp"],
      "env": {
        "API_TOKEN": "<your-api-token-here>",
        "GROUPS": "browser,advanced_scraping",
        "TOOLS": "extract"
      }
    }
  }
}

Coding agent setup (Claude Code / Cursor / Windsurf) — npm and PyPI package data:

{
  "mcpServers": {
    "Bright Data": {
      "command": "npx",
      "args": ["@brightdata/mcp"],
      "env": {
        "API_TOKEN": "<your-api-token-here>",
        "GROUPS": "code"
      }
    }
  }
}

Tools Reference (69 Tools)

Which tool to use

  • Known URL, need the content: scrape_as_markdown. Multiple URLs (up to 10): scrape_batch
  • Need to find information: search_engine. Multiple queries (up to 10): search_engine_batch
  • Deep research or RAG, need relevance-ranked sources: discover with an intent
  • Page is on a supported platform (Amazon, LinkedIn, TikTok, etc.): use the matching web_data_* tool — returns clean JSON, faster and more reliable than scraping the same page
  • Structured JSON from an unsupported page: extract
  • Raw HTML: scrape_as_html
  • Page requires interaction (click, type, scroll, login): scraping_browser_* tools
  • npm/PyPI package info: web_data_npm_package / web_data_pypi_package — never scrape package registries
  • How ChatGPT/Grok/Perplexity answer a prompt: web_data_chatgpt_ai_insights / web_data_grok_ai_insights / web_data_perplexity_ai_insights

Notes that apply to all web_data_* tools:

  • Return structured JSON, billed per record returned
  • Each tool validates its URL pattern; a wrong URL type fails (exact requirements in the tables below)
  • Results can be large. Use built-in limits where available (num_of_comments, days_limit) and run bulk collection in a subagent where your framework supports it, so records don't flood the main context window
  • If a web_data_* call fails, scrape_as_markdown works on the same URL as a fallback
Search and Scraping — 8 tools
ToolDescriptionGroup
search_engineSearch Google, Bing, or Yandex. Google returns JSON (URL, title, description); Bing and Yandex return Markdown. Paginate with the cursor parameteralways enabled
search_engine_batchUp to 10 search queries in one callalways enabled
scrape_as_markdownAny URL as Markdown. Bot protection and CAPTCHA handled automaticallyalways enabled
scrape_batchUp to 10 URLs in one call; returns an array of URL/content pairs in Markdownalways enabled
discoverAI-relevance-ranked web search. Returns scored results (title, description, URL, relevance score). Supports intent-based ranking, geo-targeting, date filtering, keyword filteringalways enabled
scrape_as_htmlAny URL as raw HTMLadvanced_scraping
extractScrape a page and convert it to structured JSON using AI, with an optional custom extraction promptadvanced_scraping
session_statsTool usage counts for the current sessionadvanced_scraping
E-commerce — 11 tools
ToolInput requirementReturns
web_data_amazon_productProduct URL containing /dp/Price, title, availability, rating, review count, ASIN, seller, images
web_data_amazon_product_reviewsProduct URL containing /dp/Review data
web_data_amazon_product_searchSearch keyword + Amazon domain URLFirst page of search results
web_data_walmart_productProduct URL containing /ip/Product data
web_data_walmart_sellerWalmart seller URLSeller data
web_data_ebay_producteBay product URLListing data
web_data_homedepot_productshomedepot.com product URLProduct data
web_data_zara_productsZara product URLProduct data
web_data_etsy_productsEtsy product URLListing data
web_data_bestbuy_productsBest Buy product URLProduct data
web_data_google_shoppingGoogle Shopping product URLMulti-seller product data
Social Media — 23 tools
ToolInput requirementReturns
web_data_linkedin_person_profileLinkedIn profile URLProfile, experience, skills
web_data_linkedin_company_profileLinkedIn company URLCompany data
web_data_linkedin_job_listingsLinkedIn jobs URLJob listing data
web_data_linkedin_postsLinkedIn post URLPost data
web_data_linkedin_people_searchLinkedIn people search URLSearch results
web_data_instagram_profilesInstagram profile URLProfile data
web_data_instagram_postsInstagram post URLPost data
web_data_instagram_reelsInstagram reel URLReel data
web_data_instagram_commentsInstagram URLComments
web_data_facebook_postsFacebook post URLPost data
web_data_facebook_marketplace_listingsMarketplace listing URLListing data
web_data_facebook_company_reviewsFacebook company URL + review countReviews
web_data_facebook_eventsFacebook event URLEvent data
web_data_tiktok_profilesTikTok profile URLProfile data
web_data_tiktok_postsTikTok post URLPost data
web_data_tiktok_shopTikTok Shop product URLProduct data
web_data_tiktok_commentsTikTok video URLComments
web_data_x_postsX post URLPost data
web_data_x_profile_postsX profile URLRecent posts, optional date range filter
web_data_youtube_videosYouTube video URLVideo metadata
web_data_youtube_profilesYouTube channel URLChannel data
web_data_youtube_commentsYouTube video URL, optional num_of_comments (default 10)Comments
web_data_reddit_postsReddit post URLPost data
Browser Automation — 13 tools

Remote browser session. Typical sequence: navigate → snapshot → interact by ref → extract or screenshot.

ToolDescription
scraping_browser_navigateOpen or reuse a browser session and navigate to a URL
scraping_browser_go_backNavigate back
scraping_browser_go_forwardNavigate forward
scraping_browser_snapshotARIA snapshot of the page listing interactive elements with refs. Required before ref-based actions
scraping_browser_click_refClick an element by ref from the latest snapshot
scraping_browser_type_refType into an element by ref; optionally press Enter to submit
scraping_browser_screenshotScreenshot of the current page; optional full_page
scraping_browser_get_textText content of the page body
scraping_browser_get_htmlHTML of the current page
scraping_browser_scrollScroll to the bottom of the page
scraping_browser_scroll_to_refScroll an element into view
scraping_browser_wait_for_refWait for an element to become visible, with optional timeout
scraping_browser_network_requestsNetwork requests since page load: method, URL, status

Refs come from the latest snapshot. If the page changes after a click or navigation, take a new snapshot before the next ref-based action. For static pages, scrape_as_markdown is faster and cheaper than a browser session.

Business Intelligence — 4 tools
ToolInput requirementReturns
web_data_crunchbase_companyCrunchbase company URLFunding, investors, company data
web_data_zoominfo_company_profileZoomInfo company URLCompany profile
web_data_google_maps_reviewsGoogle Maps URL, optional days_limit (default 3)Business reviews
web_data_zillow_properties_listingZillow listing URLProperty listing data
GEO and LLM Visibility — 3 tools
ToolInputReturns
web_data_chatgpt_ai_insightsPromptChatGPT's answer: structured text, citations, recommendations, Markdown
web_data_grok_ai_insightsPromptGrok's answer as structured Markdown
web_data_perplexity_ai_insightsPromptPerplexity's answer with sources, as structured Markdown

Use for Generative Engine Optimization (tracking how LLMs describe your brand) and LLM-as-a-judge workflows.

Code — 2 tools
ToolInputReturns
web_data_npm_packagenpm package name (e.g., @brightdata/sdk)Latest version, README, dependencies, metadata
web_data_pypi_packagePyPI package name (e.g., langchain-brightdata)Latest version, README, dependencies, metadata
Finance, Research, App Stores, Travel — 5 tools
ToolInput requirementReturnsGroup
web_data_yahoo_finance_businessYahoo Finance business URLCompany financial datafinance
web_data_github_repository_fileGitHub file URLFile content and metadataresearch
web_data_google_play_storePlay Store app URLApp detailsapp_stores
web_data_apple_app_storeApp Store app URLApp detailsapp_stores
web_data_booking_hotel_listingsBooking.com listing URLHotel listing datatravel

Full tool reference in the docs →


Agent Skills

Ready-to-use skills that teach your agent how to use this MCP server correctly. The full

Files in the repo

Repository payload27 top-level entries
  • .github
  • assets
  • examples
  • mcp-evals
  • test
  • .gitignore
  • .mcpbignore
  • .npmignore
  • aria_snapshot_filter.js
  • brightdata-mcp-2.7.1.mcpb
  • browser_session.js
  • browser_tools.js
  • CHANGELOG.md
  • Dockerfile
  • icon.png
  • LICENSE
  • manifest.json
  • package-lock.json
  • package.json
  • prompts.js
  • README.md
  • search_dataset_schema.js
  • search_utils.js
  • server.js
  • server.json
  • smithery.yaml
  • tool_groups.js

Discussion (0)

Ask about usage, or say what you built with it

Sign in to join the discussion.

No comments yet. Be the first to say what this is good for.

More connectors

Real-time global intelligence dashboard. AI-powered news aggregation, geopolitical monitoring, and infrastructure tracking in a unified situational awareness interface

86k

High-performance code intelligence MCP server. Indexes codebases into a persistent knowledge graph — average repo in milliseconds. 158 languages, sub-ms queries, 99% fewer tokens. Single static binary, zero dependencies.

43k

Universal provider proxy for OpenAI Codex & Claude Code — use any LLM (Claude, Gemini, Grok, DeepSeek, Ollama…) with Codex CLI, App, SDK, and Claude Code

14k
okf-memory/
okf-agent-memory

Git-native persistent memory for AI coding agents. Implements Google OKF v0.2 with sub-300µs in-memory BM25 search, embedded MCP server, and progressive disclosure. Slashes token bloat by 80% with zero external databases or dependencies. Built in pure Go.

547
tirth8205/
code-review-graph

Local-first code intelligence graph for MCP and CLI. Builds a persistent map of your codebase so AI coding tools read only what matters, with benchmarked context reductions on reviews and large-repo workflows.

31k
2akouwu/
reverify

Stop your AI from making things up — it proposes, deterministic tools decide, every claim checked against ground truth with evidence. Grounded facts and context survive resets. Reverse engineering is the proving ground. MCP server + CLI.

1.1k