Bright Data

主流住宅代理服务商包括Bright Data、Smartproxy、IPIDEA等

Bright Data says it collects only public data, but whether scraping is lawful depends on the target website, its terms of service, the type of data and the jurisdiction, and this risk is borne by the user.

Bright Data provides infrastructure for public web data collection, including proxies, scraping APIs, ready-made datasets, and an MCP server that lets AI assistants read the live web.

New accounts receive 5,000 free credits per month with no credit card required.

The free credits for the scraping API and the MCP server share the same pool, and unused credits do not roll over to the next month.

Under pay-as-you-go pricing, Web Unlocker, SERP and Web Scraper API are priced at $1.50 per 1,000 successful requests or records.

Residential proxies are listed at $8 per GB, and scale plans start at $499 per month.

Web Unlocker is designed specifically to bypass target websites' anti-scraping mechanisms (such as CAPTCHAs, IP bans, and JavaScript rendering), automatically handling proxy rotation, header spoofing and browser fingerprint emulation.

Bright Data's MCP server is open source.

Bright Data's MCP server can be added to Claude, Cursor or other clients, and supports running locally via NPM or connecting remotely.

Apify's main competitors in the data scraping field include Firecrawl and Bright Data, and the three have different positioning: Firecrawl focuses on converting a single website into LLM-friendly Markdown, Bright Data is known for its large-scale proxy network and data collection infrastructure, and Apify emphasizes its ready-made actor ecosystem and MCP-native integration.

Data brokers (such as Bright Data and parts of Scale AI's business) focus on data collection, cleaning, and on-demand supply.

Modern proxy providers (such as Bright Data, Oxylabs, Smartproxy) offer an endpoint mode where developers only need to connect to a fixed host:port, and the provider handles IP rotation, geolocation and session persistence internally.

Bright Data claims to own the world's largest proxy infrastructure, enabling it to continuously bypass CAPTCHAs and rotate access strategies without triggering blocks.

It typically takes a developer 3 to 5 days to build a scraper from development, QA, and testing through to running an end-to-end pipeline.

Bright Data's Web MCP can be integrated with Claude Code and others, backed by a toolkit of more than 60 controlled APIs covering search engines, page scraping to Markdown or HTML, and data collection for specific sites such as Amazon, Reddit, LinkedIn, and Instagram.

The product intelligence agent that Raju built using a Google Notebook script requires only a Bright Data API token and a Gemini API key to run.

The purchase-decision agent's workflow involves first calling the Bright Data API to collect Amazon product data, then calling the Reddit API to search for related discussion threads, and finally performing AI analysis on both sets of data.

SERP APIs are a category of interface services that return structured search engine results, with common providers including SerpApi, ValueSERP, and Bright Data

The author introduced Bright Data and built a custom skill for the harness, enabling the harness to search target documentation via Google SERP and scrape hard-to-access pages.