Search the web, scrape websites, extract structured data from URLs, and automate browsers using Bright Data's Web MCP. Use when fetching live web content, bypassing blocks/CAPTCHAs, getting product data from Amazon/eBay, social media posts, or when standard requests fail.
Use this skill for reliable web access in MCP-compatible agents. Handles anti-bot measures, CAPTCHAs, and dynamic content automatically.
Tool: search_engine
Input: { "query": "latest AI news", "engine": "google" }
Returns JSON for Google, Markdown for Bing/Yandex. Use cursor parameter for pagination.
Tool: scrape_as_markdown
Input: { "url": "https://example.com/article" }
Tool: extract
Input: {
"url": "https://example.com/product",
"prompt": "Extract: name, price, description, availability"
}
| Scenario | Tool | Mode |
|---|---|---|
| Web search results | search_engine | Rapid (Free) |
| Clean page content | scrape_as_markdown | Rapid (Free) |
| Parallel searches (up to 10) | search_engine_batch | Pro/advanced_scraping |
| Multiple URLs at once | scrape_batch | Pro/advanced_scraping |
| HTML structure needed | scrape_as_html | Pro/advanced_scraping |
| AI JSON extraction | extract | Pro/advanced_scraping |
| Dynamic/JS-heavy sites | scraping_browser_* | Pro/browser |
| Amazon/LinkedIn/social data | web_data_* | Pro |
Remote (recommended) - No installation required:
SSE Endpoint: