ScrapingTest logoscrapingtest

> 16 Web Scraping APIs: Detailed 2026 Benchmark <

Head-to-head comparison of leading scraping APIs across diverse, challenging domains, measured on success rate, response time, and cost per 1,000 requests.

By ScrapingTest Research · Updated

Results
target: Overall
API Provider
#1scrape.do logoScrape.do
99.39%41916993$0.87
#2decodo logoDecodo
95.90%1190817862$0.86
#3apify logoApify
95.25%1953829219$7.04
bright data logoBright Data
94.67%1459029014$1.55
scrapfly logoScrapfly
93.45%47777158$2.69
oxylabs logoOxylabs
93.42%1309920186$7.00
scrapegraphai logoScrapegraphAI
88.67%57808553$5.80
webscrapingapi logoWebScrapingAPI
86.91%1484432312$6.62
scrapingbee logoScrapingBee
85.12%2273632167$2.64
zyte logoZyte
83.00%1146625618$3.50
zenrows logoZenRows
81.53%1100718177$4.13
scrapingdog logoScrapingDog
80.55%61699538$2.16
scraperapi logoScraperAPI
75.47%1320720175$9.63
firecrawl logoFirecrawl
66.50%31986359$12.53
scrapingant logoScrapingAnt
56.20%2300238422$1.38
serpapi logoSerpApi
10.00%7751060$25.00
────────────────────────────────────────────────────────────────────────────────────────────────────

What Is a Web Scraping API?

A web scraping API is a managed HTTP endpoint that scrapes a target URL on your behalf and returns the result. You send a single request with the URL and an API key; the provider handles proxy rotation, headless browsers, CAPTCHAs, fingerprinting, retries, and bot-detection bypass; and you get back rendered HTML, parsed JSON, or markdown. One call in, one clean response out.

The hard work happens inside that single request. Modern sites detect bots with a stack of defences — Cloudflare, DataDome, Akamai, PerimeterX, Turnstile, reCAPTCHA — and getting past them takes a constantly rotating pool of millions of residential and mobile IPs, real browser fingerprints, JavaScript execution, and retry logic. A scraping API absorbs all of that into one HTTP call so your code stays the size of a fetch().

How a web scraping API worksA three-zone pipeline. The client sends a request with a URL, API key, and parameters. The API service runs the request through five internal stages: ingest, proxy and IP selection, render, bypass, and extract. Output is returned to the client as JSON, CSV, or rendered data.[ CLIENT ]user_keystrurlstrparamsobj$ developerawait fetch( api, { url })// your coderequest[ API SERVICE ]1INGESTvalidates key, queuesrequest, picks strategy→ scrape_task2PROXY & IP1cresidential · datacentermobile · 195 countries~100M+ rotating IPs3RENDER5cheadless Chromeexecutes JS · clicks · waitsreal fingerprint4BYPASS25cCloudflare · DataDomeAkamai · PerimeterXTurnstile · reCAPTCHA5EXTRACTXPath · CSS · LLM parseHTML → JSON · markdownreturn[ OUTPUT ]JSONHTMLMDCSVdatabasedashboardsLLM ingest// formatted
Your request enters the API, flows through five managed stages — ingest, proxy, render, bypass, extract — and comes back as JSON, HTML, markdown, or CSV.

Pricing on most scraping APIs is built around credits, not requests. A basic HTML fetch is usually 1 credit, but enabling JavaScript rendering can cost 5×, residential proxies 10×, and the full “stealth” configuration on hard targets up to 75×. A nominal “100K credit” plan can deliver anywhere from a few thousand fully-protected scrapes to a hundred thousand simple fetches — which is why the per-provider breakdowns below itemize both the plan price and the credit multiplier of every feature toggle.

All 16 APIs ranked below expose the same basic shape (URL in, HTML or JSON out), but differ across five axes that decide success on real-world targets: proxy network size and type, anti-bot bypass quality, the availability of dedicated parsers for high-value sites, AI / MCP integration for agent workflows, and the pricing model — per successful request, per gigabyte, per parsed result, or per compute unit. The benchmark and rankings that follow score each axis against the same 20 target domains.

Each provider's benchmark numbers, what they do well, and where they fall short — ordered by overall success rate.

#1

Scrape.do

Success rate
99.39%
Avg response
4.2s
P90 latency
7.0s
Cost / 1K
$0.87
Free tier
Yes
Starting plan
$29/mo
AI implementation
Intermediate
Structured data
3 / 20

Scrape.do is a web-scraping API that routes requests through a pool of 110M+ datacenter, residential, and mobile proxies across 150 countries, with optional headless-browser rendering. It targets developers who want a thin, pay-per-success proxy layer rather than a managed dataset product, and competes mainly on price-per-credit and a free-forever tier.

Pros
  • +Granular credit pricing: 1 credit for datacenter, 5 for JS render, 10 for residential, 25 for residential plus render.
  • +Free-forever account and a permissive billing model that only charges on 2xx, 400, 404, and 410 responses.
  • +Async API runs on a separate concurrency pool worth 30% of your plan limit, so batch jobs don't starve live traffic.
Cons
  • Concurrency on the cheaper plans is tight: 5 parallel requests on Free and Hobby, only stepping up at Pro (15) and Business (40).
  • No official Python or JavaScript SDK; only a community-style scrapy-scrapedo wrapper, so most users wire up raw HTTP or proxy mode themselves.
  • Auto-upgrades the proxy tier on protected domains even when you request basic. In our benchmark, capterra, google, idealista, indeed, reddit, tripadvisor, and trustpilot all billed at 10 credits per call (not 1), g2 at 25, and linkedin at 30, regardless of the params we sent. The actual cost shows in the scrape.do-request-cost response header per request.
Pricing

Plans are tiered as Free, Hobby, Pro, Business, Advanced, and Custom/Enterprise, billed in credits with concurrency rising from 5 (Free/Hobby) to 200 (Advanced). The headline gotcha is the 5x multiplier for JS render and 10x for residential (a residential plus render call burns 25 credits), plus per-domain surcharges that get applied automatically: 10 credits for most protected sites, 25 for g2, 30 for linkedin.

PlanPriceCredits / volume
Free$01K credits + 5 concurrency
Hobby$29/mo250K credits + 5 concurrency
Pro$99/mo1.5M credits + 15 concurrency
Business$249/mo5M credits + 40 concurrency
Advanced$499/mo12M credits + 200 concurrency

Credits don't map one-to-one to requests. Each feature stacks a multiplier on top of the base call:

  • ·Datacenter (default): 1 credit
  • ·Datacenter + JS render: 5 credits
  • ·Residential / Mobile: 10 credits
  • ·Residential + JS render: 25 credits
  • ·Protected domain auto-upgrade (e.g. google, indeed, reddit): 10 credits
  • ·G2: 25 credits
  • ·LinkedIn: 30 credits

A few things to watch out for before signing up:

  • !Auto-upgrade hides the real per-domain cost: requesting basic on capterra, google, indeed, reddit, tripadvisor, or trustpilot still bills 10 credits per call.
  • !Residential proxy at 10 credits per call (25 with render) burns volume fast on hard targets.
  • !Hard 2MB response cap on returned HTML.
Per-domain results (20 domains)
DomainSuccessAvgP90Cost/1KStructured
amazon.com100.0%3.4s4.8s$0.11
bestbuy.com99.9%4.4s6.1s$1.10
bing.com100.0%1.1s1.5s$0.11
booking.com98.7%4.6s6.3s$0.11
capterra.com100.0%9.1s19.5s$1.10
ebay.com99.5%2.5s3.8s$0.11
g2.com99.7%10.2s18.3s$2.75
github.com100.0%3.0s6.9s$0.11
google.com100.0%1.9s2.7s$1.10
idealista.com100.0%1.0s1.4s$1.10
indeed.com100.0%8.3s17.4s$1.10
instagram.com99.9%1.3s1.4s$0.11
linkedin.com99.8%5.2s8.9s$3.30
reddit.com100.0%2.0s2.3s$1.10
tripadvisor.com100.0%2.6s3.4s$1.10
trustpilot.com99.7%3.2s4.3s$1.10
walmart.com99.8%5.1s7.6s$0.11
x.com90.8%10.2s15.7s$0.55
youtube.com100.0%2.4s3.6s$0.11
zillow.com100.0%2.6s4.0s$1.10
#2

Decodo

Success rate
95.90%
Avg response
11.9s
P90 latency
17.9s
Cost / 1K
$0.86
Free tier
Yes
Starting plan
$19/mo
AI implementation
Intermediate
Structured data
6 / 20

Decodo is the 2024 rebrand of Smartproxy, offering a Web Scraping API alongside residential, mobile, and datacenter proxies. The unified scraper-api.decodo.com/v2/scrape endpoint covers general scraping plus target templates for Amazon, Google, Walmart, Reddit, YouTube, Bing, TikTok, and Target.

Pros
  • +Large 125M+ IP pool with 195+ residential locations and a claimed 99.86% success rate on residential proxies.
  • +Built-in parsers for 20+ targets including Amazon, Google, Bing, Walmart, Reddit, and YouTube return structured JSON automatically.
  • +Open-source MCP server on GitHub and a free AI Parser make it easier to wire into LLM and agent pipelines.
Cons
  • The 2024 Smartproxy rebrand means third-party tutorials and Stack Overflow answers still reference old gate.smartproxy.com hostnames.
  • Target template coverage is narrower than Bright Data or Apify, with no dedicated shopping, scholar, or news SERP endpoints.
  • The $0.50/1K standard tier only carries 6 of our 20 benchmark domains; the other 14 require standard+JS ($0.75), premium ($1.00), or premium+JS ($1.50), pushing blended cost on a mixed workload closer to $0.86/1K than the headline rate.
Pricing

The Web Scraping API starts at $19/month for 38K standard requests at $0.50/1K, with premium proxies plus JS rendering billed at $1.50/1K. A free tier offers 2K requests, and the popular $99 Pro plan unlocks 50 req/s and roughly 82K premium+JS requests. Real-world blended cost depends heavily on which tier your target domains require: 6 of our 20 benchmark domains worked on standard, 5 on standard+JS, 6 on premium, and 3 only on premium+JS.

PlanPriceCredits / volume
Free$02K requests @ 10 req/s
Starter$19/mo38K standard requests @ 10 req/s
Advanced$49/mo163K standard requests @ 25 req/s
Pro$99/mo707K standard requests @ 50 req/s
EnterpriseCustomCustom volume + concurrency

Credits don't map one-to-one to requests. Each feature stacks a multiplier on top of the base call:

  • ·Standard proxy (8 geos): $0.50 / 1K (1x base)
  • ·Standard + JS render: $0.75 / 1K (1.5x)
  • ·Premium proxy (195+ geos): $1.00 / 1K (2x)
  • ·Premium + JS render: $1.50 / 1K (3x)
  • ·AI Parser: Free — natural-language → JSON

A few things to watch out for before signing up:

  • !Smartproxy → Decodo rebrand confusion still circulating in old docs.
  • !Starter tier rate-capped at 10 req/s — must jump to Advanced for 25 req/s.
  • !Target templates force the premium pool (2-3x cost).
Per-domain results (20 domains)
DomainSuccessAvgP90Cost/1KStructured
amazon.com100.0%4.2s6.4s$0.50
bestbuy.com79.0%24.4s36.6s$1.50
bing.com100.0%3.8s5.7s$0.50
booking.com98.0%25.8s38.7s$0.75
capterra.com100.0%3.6s5.5s$0.75
ebay.com100.0%5.0s7.5s$1.00
g2.com60.0%47.6s71.5s$1.50
github.com100.0%2.6s3.9s$0.50
google.com99.0%2.9s4.3s$0.50
idealista.com100.0%4.2s6.3s$1.00
indeed.com100.0%4.5s6.8s$1.00
instagram.com100.0%4.0s6.0s$0.75
linkedin.com100.0%3.0s4.5s$0.50
reddit.com100.0%2.3s3.4s$0.50
tripadvisor.com100.0%8.6s12.8s$1.00
trustpilot.com100.0%24.5s36.7s$0.75
walmart.com100.0%6.9s10.3s$1.00
x.com100.0%18.3s27.4s$0.75
youtube.com82.0%3.1s4.7s$1.50
zillow.com100.0%38.9s58.4s$1.00
#3

Apify

Success rate
95.25%
Avg response
19.5s
P90 latency
29.2s
Cost / 1K
$7.04
Free tier
Yes
Starting plan
$29/mo
AI implementation
Intermediate
Structured data
20 / 20

Apify is a Prague-based scraping platform built around Actors: containerized serverless programs that run on its cloud, with a marketplace of 22,000+ pre-built scrapers. Founded 2015, it pairs the open-source Crawlee SDK with integrated proxies, storage, scheduling, and MCP server access for AI agents.

Pros
  • +Marketplace of 22,000+ Actors covers TikTok, Instagram, Google Maps, Amazon, and most niche sites without custom code.
  • +Crawlee SDK and code templates let developers build, deploy, and monetize custom scrapers on managed cloud infrastructure.
  • +Native MCP server and integrations with LangChain, LlamaIndex, Zapier, Make, and n8n suit AI agent workflows.
Cons
  • Steeper learning curve than single-endpoint APIs since users must pick Actors, configure JSON inputs, and manage runs.
  • Compute-unit pricing (memory × runtime plus proxy GB and storage I/O) makes monthly costs hard to forecast accurately.
  • Marketplace quality varies widely because community-published Actors set their own pricing, support, and maintenance cadence.
Pricing

Credit-based consumption rather than flat per-request, billing compute units, residential or SERP proxy traffic, storage I/O, and data transfer. Free tier includes $5 monthly credits; paid Starter, Scale, and Business tiers unlock more compute and discounted pay-per-event rates. Third-party Actors add rental fees from roughly $20/month or $8 per 1,000 results.

PlanPriceCredits / volume
Free$0/mo$5 monthly platform credits
Starter$39/moIncreased compute + PPE discount
Scale$199/moHigher compute + deeper PPE discount
Business$999/moLargest compute + best PPE rate
Per-actor pricingVariesPay-per-result (~$8/1K) or pay-per-event

Credits don't map one-to-one to requests. Each feature stacks a multiplier on top of the base call:

  • ·Compute units: CPU × memory × runtime per actor
  • ·Residential proxy: Per-GB transfer
  • ·SERP proxy: Per query
  • ·Datacenter proxy: Per-GB (cheapest tier)
  • ·Dataset / storage I/O: Per read + write

A few things to watch out for before signing up:

  • !Compute-unit pricing across 10+ dimensions is hard to forecast.
  • !Marketplace quality varies — community actors lack consistent maintenance.
  • !Monthly actor rental and pay-per-event fees stack on top of platform compute.
Per-domain results (20 domains)
DomainSuccessAvgP90Cost/1KStructured
amazon.com80.0%14.5s21.8s$5.00
bestbuy.com100.0%11.6s17.3s$10.15
bing.com100.0%13.3s18.1s$6.10
booking.com100.0%52.4s78.6s$1.07
capterra.com100.0%17.2s25.9s$6.05
ebay.com100.0%7.0s10.5s$4.10
g2.com75.0%2.7s4.0s$13.75
github.com100.0%6.2s9.2s$4.55
google.com100.0%12.7s19.0s$1.50
idealista.com90.0%11.5s17.2s$2.00
indeed.com100.0%20.8s31.2s$13.25
instagram.com100.0%6.6s9.9s$2.60
linkedin.com100.0%8.9s13.3s$4.00
reddit.com100.0%20.0s30.0s$44.00
tripadvisor.com100.0%54.4s81.5s$7.21
trustpilot.com85.0%22.5s33.8s$0.47
walmart.com80.0%56.0s84.0s$3.06
x.com100.0%16.3s24.5s$5.00
youtube.com95.0%24.4s36.6s$4.00
zillow.com100.0%11.8s17.8s$3.00
#4

Bright Data

Success rate
94.67%
Avg response
14.6s
P90 latency
29.0s
Cost / 1K
$1.55
Free tier
Yes
Starting plan
PAYG
AI implementation
Intermediate
Structured data
20 / 20

Bright Data is an Israel-based web data platform serving 20,000+ organizations with a full stack spanning proxy networks, unlocking APIs, a scraping browser, 250+ pre-built scrapers, ready-made datasets, and a 50+ PB web archive. Its breadth and enterprise compliance posture (GDPR, CCPA, ISO 27001, SOC) target large teams rather than weekend scripters.

Pros
  • +Pay-only-for-success billing on Web Unlocker, SERP, and Scraper APIs means failed requests and retries don't count against you.
  • +Proxy network is unusually deep: 400M+ residential IPs, 1.3M datacenter, 1.3M ISP, and 7M mobile across 195 countries with city and ZIP targeting.
  • +Product range is the widest in the category, covering raw proxies, browser API, 250+ pre-built scrapers, 190+ datasets, archive, and a free MCP server with 5,000 requests/month.
Cons
  • Pricing is fragmented across at least nine separate product lines with different billing units (per 1K results, per GB, per IP, per record), making total cost hard to predict.
  • Marketing IP counts diverge from documentation: product pages cite 400M+ residential IPs while docs reference 150M+ total, suggesting the headline number reflects monthly unique devices rather than concurrent capacity.
  • Heavy promotional discounting (50% off residential, 25% off scrapers) means published rates are unstable and renewals can effectively double once coupons expire.
Pricing

Web Unlocker, SERP, and Crawl APIs start at $1.50 per 1,000 successful results on pay-as-you-go, dropping to $1.00 at the $1,999/month tier. The Scraping Browser is bandwidth-billed at $8/GB down to $5/GB, residential proxies start at $8/GB (currently $4 with promo), and datasets begin at $250 per 100K records. New accounts get $5 in free credits plus a first-deposit match up to $500.

PlanPriceCredits / volume
Pay As You Go$1.50 / 1Kno commitment
Growth$499/mo380K results ($1.30/1K)
Business$999/mo900K results ($1.10/1K)
Premium$1,999/mo2M results ($1.00/1K)
EnterpriseCustomSSO + Premium SLA

Credits don't map one-to-one to requests. Each feature stacks a multiplier on top of the base call:

  • ·Scraping Browser: $8/GB → $5/GB bandwidth
  • ·Residential proxies: $8/GB ($4/GB promo)
  • ·Datasets Marketplace: $250 per 100K records
  • ·Archive API (historical): $1.00 / 1K vs $0.20 / 1K recent

A few things to watch out for before signing up:

  • !Each product line bills separately even though tiers look unified.
  • !Scraping Browser is GB-billed, not per request — costs vary with page weight.
  • !Promo rates expire after the first cycle; renewals can effectively double.
Per-domain results (20 domains)
DomainSuccessAvgP90Cost/1KStructured
amazon.com96.7%3.4s4.8s$1.50
bestbuy.com83.3%10.3s26.8s$2.50
bing.com100.0%4.5s11.6s$1.50
booking.com86.7%31.4s90.0s$1.50
capterra.com80.0%51.9s90.0s$1.50
ebay.com93.3%10.0s27.1s$1.50
g2.com83.3%43.5s90.0s$1.50
github.com100.0%1.4s1.7s$1.50
google.com100.0%3.1s6.2s$1.50
idealista.com96.7%25.7s36.7s$1.50
indeed.com100.0%6.6s20.2s$1.50
instagram.com100.0%2.7s3.6s$1.50
linkedin.com100.0%5.4s6.1s$1.50
reddit.com100.0%1.4s1.8s$1.50
tripadvisor.com100.0%18.4s28.9s$1.50
trustpilot.com80.0%33.6s65.1s$1.50
walmart.com96.7%13.3s20.2s$1.50
x.com96.7%17.5s25.2s$1.50
youtube.com100.0%2.5s3.3s$1.50
zillow.com100.0%5.2s20.9s$1.50
#5

Scrapfly

Success rate
93.45%
Avg response
4.8s
P90 latency
7.2s
Cost / 1K
$2.69
Free tier
Yes
Starting plan
$30/mo
AI implementation
Intermediate
Structured data
0 / 20

Scrapfly is a developer-focused platform built around three APIs — Web Scraping, Screenshot, and Extraction — billed against a single credit balance. Originally built internally in 2017 and opened publicly in 2020, it leans toward engineering teams that want fine-grained controls like ASP toggles, CDP access, and named extraction models.

Pros
  • +Three coordinated APIs (scrape, screenshot, extract) share one credit balance, simplifying budgeting across mixed workloads.
  • +Python and TypeScript SDKs plus a Scrapy extension cover most common stacks without custom HTTP glue code.
  • +Open-source scrapers for 40+ domains on GitHub and the Scrapfly Academy curriculum lower the onboarding curve.
Cons
  • SMS phone verification during signup adds friction and reportedly precedes account bans for some users.
  • Generic content-type extraction models (product, article) tend to be less accurate than domain-specific parsers from competitors.
  • The $30 Discovery plan covers only about 6,600 fully-protected requests since ASP+JS+residential hits the 30-credit ceiling.
Pricing

Pricing starts with a free 1,000-credit tier, then a $30 Discovery plan with 200,000 credits, scaling to $500 Enterprise at 5.5M credits. Fully-protected requests using ASP, JS rendering, and residential proxies cost up to 30 credits each, so headline credit counts shrink quickly on hard targets. Annual billing knocks off roughly 16%.

PlanPriceCredits / volume
Free$01,000 credits/month
Discovery$30/mo200K credits
Production$100/mo1M credits
Startup$250/mo2.5M credits
Enterprise$500/mo5.5M credits

Credits don't map one-to-one to requests. Each feature stacks a multiplier on top of the base call:

  • ·Base request: 1 credit
  • ·ASP (anti-bot bypass): +5 credits
  • ·render_js (browser): +5 credits
  • ·Residential proxy: +25 credits
  • ·Fully-protected (ASP + JS + residential): ~30 credits

A few things to watch out for before signing up:

  • !SMS phone verification at signup blocks some users from trialing the service.
  • !$30 plan yields only ~6,600 fully-protected requests per month.
  • !Annual billing saves ~16% but locks you in.
Per-domain results (20 domains)
DomainSuccessAvgP90Cost/1KStructured
amazon.com100.0%4.7s6.2s$3.75
bestbuy.com90.0%5.5s8.3s$3.37
bing.com98.0%2.6s3.9s$0.15
booking.com98.0%7.6s11.5s$4.07
capterra.com99.0%4.4s7.9s$6.76
ebay.com60.0%8.5s12.8s$0.82
g2.com100.0%5.1s7.7s$6.00
github.com100.0%4.3s6.4s$3.75
google.com63.3%8.2s11.8s$0.90
idealista.com82.0%2.4s3.5s$3.07
indeed.com100.0%6.2s9.3s$3.75
instagram.com98.0%3.7s5.5s$0.15
linkedin.com100.0%3.1s4.7s$3.90
reddit.com100.0%2.6s3.9s$3.67
tripadvisor.com86.0%8.6s12.9s$4.51
trustpilot.com100.0%1.7s2.5s$3.75
walmart.com100.0%3.4s4.7s$0.15
x.com98.0%5.6s8.4s$0.15
youtube.com100.0%1.5s2.3s$0.15
zillow.com96.7%5.8s9.1s$0.90
#6

Oxylabs

Success rate
93.42%
Avg response
13.1s
P90 latency
20.2s
Cost / 1K
$7.00
Free tier
No
Starting plan
$49/mo
AI implementation
Difficult
Structured data
9 / 20

Oxylabs is a Lithuania-based web intelligence platform offering residential, datacenter, ISP, and mobile proxies alongside Web Scraper API and Web Unblocker. The company targets enterprise data teams with 177M+ IPs across 195 countries, ISO 27001 certification, and an AI-assisted code generator called OxyCopilot.

Pros
  • +Massive IP footprint of 177M+ residential addresses spanning 195 countries supports granular city, state, and ZIP targeting.
  • +Success-based billing on Scraper API and Web Unblocker means 5xx server errors are not charged to the customer.
  • +OxyCopilot generates request code and custom parsers from natural language, reducing setup time for new scraping targets.
Cons
  • Bandwidth-based GB pricing on Web Unblocker and proxies makes costs unpredictable, since heavy pages consume more billable traffic.
  • Entry-level Web Unblocker plan starts at $75 monthly (pre-promo), among the highest minimum commitments in the unblocking API category.
  • Residential response times average 0.6 seconds, and heavy JS-rendered targets can extend latency further on the Scraper API.
Pricing

Web Scraper API starts at $49/month for 98K Amazon results, with success-based billing on 2xx/4xx responses only. Web Unblocker uses GB-based pricing from $9.40/GB regular ($75 entry plan), while residential proxies start at $6/GB and datacenter from $0.59/GB. Enterprise tiers require custom quotes.

PlanPriceCredits / volume
Free Trial$02,000 Web Scraper API results
Web Scraper API Micro$49/mo98K Amazon results
Web Unblocker Micro$75/mo8GB bandwidth
Web Scraper API Starter$99/mo220K results
Web Scraper API Advanced$249/mo622.5K results

Credits don't map one-to-one to requests. Each feature stacks a multiplier on top of the base call:

  • ·Web Unblocker bandwidth: $9.40/GB ($5.64 promo)
  • ·Residential Proxies: $6.00/GB
  • ·Datacenter Proxies (PAYG): $0.59/GB
  • ·Web Scraper API + JS rendering: $1.35 / 1K results

A few things to watch out for before signing up:

  • !GB-based billing on Web Unblocker makes costs unpredictable vs flat per-request.
  • !$75/mo Web Unblocker entry is the highest in the unblocking category.
  • !No MCP server — integration requires SDKs, Postman, or direct HTTP.
Per-domain results (20 domains)
DomainSuccessAvgP90Cost/1KStructured
amazon.com100.0%10.2s15.3s$7.00
bestbuy.com75.0%34.1s51.1s$7.00
bing.com100.0%7.0s10.5s$7.00
booking.com86.7%30.9s49.1s$7.00
capterra.com100.0%18.4s27.7s$7.00
ebay.com100.0%7.0s10.5s$7.00
g2.com83.3%23.0s34.5s$7.00
github.com100.0%4.0s6.1s$7.00
google.com100.0%6.7s10.0s$7.00
idealista.com90.0%7.8s19.7s$7.00
indeed.com100.0%27.6s41.4s$7.00
instagram.com100.0%14.3s21.5s$7.00
linkedin.com100.0%4.2s6.3s$7.00
reddit.com100.0%5.0s7.6s$7.00
tripadvisor.com91.7%16.3s24.5s$7.00
trustpilot.com41.7%24.0s36.0s$7.00
walmart.com100.0%4.4s6.6s$7.00
x.com100.0%6.8s10.1s$7.00
youtube.com100.0%5.0s7.5s$7.00
zillow.com100.0%5.2s7.7s$7.00
#7

ScrapegraphAI

Success rate
88.67%
Avg response
5.8s
P90 latency
8.6s
Cost / 1K
$5.80
Free tier
Yes
Starting plan
$17/mo
AI implementation
Easy
Structured data
0 / 20

ScrapegraphAI is an LLM-first scraping API that turns URLs into structured data via natural-language prompts or JSON schemas. It exposes generic Scrape, Extract, Search, Crawl and Monitor endpoints with no per-site parsers, served from api.scrapegraphai.com and wrapped by official Python and JavaScript SDKs.

Pros
  • +AI-driven Extract endpoint converts free-text prompts or JSON schemas into structured output without writing selectors.
  • +Generic by design with one endpoint per task, so Scrape, Search and Crawl share the same prompt-based interface.
  • +Official scrapegraph-py and scrapegraph-js SDKs plus LangChain, LlamaIndex and n8n integrations cover AI agent workflows.
Cons
  • Hard-to-scrape consumer targets like Zillow can return an empty body, so coverage on protected sites is inconsistent.
  • LLM-backed extraction adds noticeable latency on heavier pages such as X.com timelines compared with raw HTML fetches.
  • Extract costs 5 credits per call versus 1 for markdownify, making structured runs roughly five times pricier than plain scrapes.
Pricing

Pricing is credit-based with a 500-credit free tier and a $17/month Starter plan that includes 10,000 credits and 100 requests per minute. Markdownify scrapes cost 1 credit, Extract calls 5 credits, and stealth mode adds 5 credits per request; top-up packs start at $5 for 1,000 credits.

PlanPriceCredits / volume
Free$0500 credits one-time, 10 req/min
Starter$17/mo10K credits + 100 req/min
Growth$85/mo100K credits + 500 req/min
Pro$425/mo750K credits + 5K req/min
EnterpriseCustomCustom credits + SLA

Credits don't map one-to-one to requests. Each feature stacks a multiplier on top of the base call:

  • ·Scrape (markdown): 1 credit
  • ·Scrape (screenshot): 2 credits
  • ·Extract (LLM-structured): 5 credits
  • ·Search (with prompt): 5 credits / result
  • ·Stealth toggle: +5 credits per request

A few things to watch out for before signing up:

  • !Extract costs 5x a basic markdown scrape — the LLM is the expensive part.
  • !Stealth adds a flat +5 credits, making protected targets ~6x more expensive.
  • !Some hard sites (Zillow-class anti-bot) return empty bodies even with stealth.
Per-domain results (20 domains)
DomainSuccessAvgP90Cost/1KStructured
amazon.com100.0%6.9s10.4s$2.00
bestbuy.com0.0%0.0s0.0s$0.00
bing.com100.0%0.6s0.8s$2.00
booking.com100.0%7.3s11.0s$12.00
capterra.com100.0%0.2s0.2s$12.00
ebay.com100.0%3.0s4.5s$12.00
g2.com96.7%16.0s24.0s$12.00
github.com100.0%1.8s2.7s$2.00
google.com100.0%1.2s1.7s$2.00
idealista.com100.0%1.6s2.3s$12.00
indeed.com100.0%4.2s6.3s$12.00
instagram.com100.0%9.3s13.9s$2.00
linkedin.com100.0%11.8s17.6s$2.00
reddit.com100.0%2.8s4.1s$2.00
tripadvisor.com93.3%6.8s10.2s$2.00
trustpilot.com100.0%5.3s8.0s$12.00
walmart.com96.7%1.6s0.1s$12.00
x.com86.7%27.1s40.7s$2.00
youtube.com100.0%8.3s12.4s$2.00
zillow.com0.0%0.0s0.0s$0.00
#8

WebScrapingAPI

Success rate
86.91%
Avg response
14.8s
P90 latency
32.3s
Cost / 1K
$6.62
Free tier
Yes
Starting plan
$19/mo
AI implementation
Intermediate
Structured data
8 / 20

WebScrapingAPI is a Romania-founded platform offering a Scraper API, Browser API, residential proxies, and dedicated SERP and Amazon endpoints. It bundles JS rendering, ASN-level geo-targeting, and six official SDKs (Node, Python, Scrapy, Rust, Java, PHP), with billing only for successful Scraper API requests.

Pros
  • +Free tier offers 5,000 monthly requests, one of the more generous freemiums among general-purpose scraping APIs.
  • +Six official SDKs covering Node, Python, Scrapy, Rust, Java, and PHP reduce integration friction across language stacks.
  • +Scraper API bills only successful requests, and ASN-level targeting plus 195-country coverage suit precise geo workflows.
Cons
  • The $19 Starter plan ships only 7,000 requests, well below rival entry tiers that bundle 100,000-plus at similar prices.
  • Browser API charges for every request including failures, breaking the headline 'pay only for success' promise on JS-heavy targets.
  • The generic name causes constant confusion with similarly branded competitors like ScrapingAPI, ScraperAPI, and ScrapingBee.
Pricing

Paid Scraper API tiers run from $19/mo for 7,000 calls up to $599/mo for 450,000, with a free 5,000-request trial. SERP and Amazon APIs price separately, starting at $28 and $59 respectively, and residential proxies begin at $8.50/GB pay-as-you-go.

PlanPriceCredits / volume
Trial$05,000 API calls/month
Starter$19/mo7,000 API calls
Basic$49/mo20,000 API calls
Standard$99/mo45,000 API calls
Pro$599/mo450,000 API calls

Credits don't map one-to-one to requests. Each feature stacks a multiplier on top of the base call:

  • ·Scraper API (success-billed): 1 credit
  • ·Browser API (billed on failure too): 1 credit / request
  • ·Heavier protected targets: Up to 5 credits
  • ·SERP API: Separate $28/mo plan, 10K requests
  • ·Amazon API: Separate $59/mo plan, 10K requests
  • ·Residential Proxies PAYG: $8.50/GB

A few things to watch out for before signing up:

  • !Starter plan ships just 7K requests — rivals offer 100K+ at the same price.
  • !Browser API bills 100% of requests, including failures.
  • !Naming clashes with ScraperAPI, ScrapingAPI, and ScrapingBee.
Per-domain results (20 domains)
DomainSuccessAvgP90Cost/1KStructured
amazon.com100.0%2.9s4.8s$2.45
bestbuy.com87.0%7.4s16.4s$12.25
bing.com51.0%2.2s6.6s$2.45
booking.com93.3%24.3s84.9s$12.25
capterra.com93.0%46.2s86.9s$2.45
ebay.com69.2%25.9s42.9s$24.50
g2.com95.9%50.9s77.4s$2.45
github.com100.0%1.7s2.8s$2.45
google.com99.0%3.3s9.3s$2.45
idealista.com96.6%25.0s47.5s$2.45
indeed.com59.0%10.3s36.4s$12.25
instagram.com100.0%2.4s3.1s$24.50
linkedin.com100.0%4.2s10.4s$2.45
reddit.com100.0%2.7s3.8s$2.45
tripadvisor.com98.0%14.2s26.9s$2.45
trustpilot.com77.8%22.6s53.1s$2.45
walmart.com24.7%13.9s43.6s$2.45
x.com97.0%18.0s45.3s$2.45
youtube.com100.0%2.2s4.4s$2.45
zillow.com96.7%16.6s39.5s$12.25
#9

ScrapingBee

Success rate
85.12%
Avg response
22.7s
P90 latency
32.2s
Cost / 1K
$2.64
Free tier
No
Starting plan
$49/mo
AI implementation
Easy
Structured data
4 / 20

ScrapingBee is a France-based scraping API from founders Kevin Sahin and Pierre de Wulf, serving 2,500+ customers with a developer-first HTML endpoint. The platform spans AI extraction, dedicated Google/Amazon/YouTube/Walmart APIs, a CLI, and an MCP server for AI agents.

Pros
  • +All features unlocked on every paid plan, including AI extraction, JS rendering, and SERP APIs.
  • +Three-tier proxy system covers datacenter, residential, and a 75-credit stealth pool for hard targets.
  • +Dedicated structured endpoints exist for Google, Amazon, YouTube, Walmart, and ChatGPT scraping.
Cons
  • JavaScript rendering is on by default and costs 5 credits, burning quota faster than expected.
  • Stealth proxy requests cost 75 credits each and require JS rendering to be enabled.
  • No free tier exists beyond a one-time 1,000-credit trial, with paid plans starting at $49/month.
Pricing

Paid plans run $49/mo Freelance (250k credits), $99 Startup (1M), $249 Business (3M), and $599 Business+ (8M), all excluding VAT. A 1,000-credit trial is offered with no card required, but there is no ongoing free tier.

PlanPriceCredits / volume
Free Trial$01,000 credits one-time
Freelance$49/mo250K credits + 10 concurrency
Startup$99/mo1M credits + 50 concurrency
Business$249/mo3M credits + 100 concurrency
Business+$599/mo8M credits + 200 concurrency

Credits don't map one-to-one to requests. Each feature stacks a multiplier on top of the base call:

  • ·JS rendering (default on): 5 credits
  • ·Premium proxy without JS: 10 credits
  • ·Premium proxy with JS: 25 credits
  • ·Stealth proxy (JS required): 75 credits
  • ·Google SERP (custom_google): 15 credits

A few things to watch out for before signing up:

  • !JS rendering is on by default — 5 credits per call.
  • !Stealth proxy costs 75 credits each and requires JS.
  • !No ongoing free tier; only a one-time 1K-credit trial.
Per-domain results (20 domains)
DomainSuccessAvgP90Cost/1KStructured
amazon.com100.0%4.9s8.9s$0.20
bestbuy.com100.0%47.3s60.4s$4.90
bing.com100.0%0.9s1.7s$0.20
booking.com97.0%38.9s58.9s$4.90
capterra.com100.0%24.2s48.2s$4.90
ebay.com98.0%9.6s18.5s$4.90
g2.com0.0%90.8s120.0s$4.90
github.com100.0%1.3s2.3s$0.20
google.com100.0%3.0s6.6s$4.90
idealista.com54.0%110.6s140.4s$14.70
indeed.com90.0%3.5s5.8s$0.20
instagram.com99.0%2.3s4.2s$0.98
linkedin.com100.0%2.1s2.9s$0.20
reddit.com67.0%2.7s4.7s$0.20
tripadvisor.com52.0%7.2s10.1s$0.20
trustpilot.com91.0%40.8s56.8s$4.90
walmart.com84.0%4.5s10.0s$0.98
x.com100.0%1.0s2.4s$0.20
youtube.com77.0%1.3s2.4s$0.20
zillow.com93.3%57.9s78.1s$0.00
#10

Zyte

Success rate
83.00%
Avg response
11.5s
P90 latency
25.6s
Cost / 1K
$3.50
Free tier
No
Starting plan
PAYG
AI implementation
Difficult
Structured data
0 / 20

Zyte, formerly Scrapinghub, is the company behind Scrapy and has been operating since 2010, making it one of the oldest players in the space. Its unified Zyte API bundles automatic unblocking, headless browser rendering, AI extraction, and proxy management into a single endpoint.

Pros
  • +Built and maintains Scrapy, the dominant open-source scraping framework with a 20,000+ developer Discord community.
  • +Only successful responses are billed, with bans and rate-limit errors free across all five difficulty tiers.
  • +AI extraction covers products, articles, job postings, and SERPs, plus a VS Code Copilot for spider development.
Cons
  • Per-website tier pricing swings from $0.13 to $16.08 per 1,000 requests, making project costs hard to forecast.
  • Tier assignment is automatic and only reviewed quarterly, so users cannot optimize by choosing a cheaper engine.
  • Marketing claims sub-100ms latency, but browser-rendered requests routinely take 10-30 seconds in practice.
Pricing

Zyte API uses a five-tier per-website model from $0.13 per 1,000 simple HTTP requests up to $16.08 for advanced browser-rendered ones, with tier assigned automatically by the platform. Volume commitments from $100 to $500 monthly unlock discounts of 25-52%, and a $5 trial credit lasts 30 days.

PlanPriceCredits / volume
Free Trial$5 credit30-day PAYG access
Pay As You Go$0 commit$100/mo spending limit, 0% discount
$200 Commitment$100/mo$400 limit, 40% discount
$500 Commitment$250/mo$1,000 limit, 52% discount
EnterpriseCustomCustom commitment + $200 free credit

Credits don't map one-to-one to requests. Each feature stacks a multiplier on top of the base call:

  • ·T1 Simple HTTP: $0.13 / 1K
  • ·T3 Moderate HTTP: $0.44 / 1K
  • ·T5 Advanced HTTP: $1.27 / 1K
  • ·T1 Simple Browser: $1.01 / 1K
  • ·T5 Advanced Browser: $16.08 / 1K (124x T1 HTTP)
  • ·AI extraction (product/article): $0.0004 – $0.0016 each

A few things to watch out for before signing up:

  • !Auto-tier means you can't predict cost — Zyte assigns each website T1-T5 with no override.
  • !Cross-modal spread (T1 HTTP → T5 browser) is 124x.
  • !Tiers reviewed quarterly with only 2 weeks notice.
Per-domain results (20 domains)
DomainSuccessAvgP90Cost/1KStructured
amazon.com100.0%3.0s4.5s$3.50
bestbuy.com70.0%5.7s13.2s$3.50
bing.com100.0%0.9s1.5s$3.50
booking.com90.0%10.8s19.9s$3.50
capterra.com100.0%7.2s33.8s$3.50
ebay.com83.3%17.6s41.3s$3.50
g2.com0.0%0.0s0.0s$3.50
github.com100.0%2.6s4.4s$3.50
google.com93.3%18.0s42.5s$3.50
idealista.com90.0%20.8s57.7s$3.50
indeed.com76.7%26.2s46.9s$3.50
instagram.com100.0%3.1s7.1s$3.50
linkedin.com0.0%0.0s0.0s$3.50
reddit.com96.7%6.5s31.1s$3.50
tripadvisor.com93.3%31.0s49.4s$3.50
trustpilot.com96.7%12.2s13.7s$3.50
walmart.com100.0%6.2s19.6s$3.50
x.com96.7%14.7s34.7s$3.50
youtube.com100.0%4.0s31.0s$3.50
zillow.com73.3%38.9s60.0s$3.50
#11

ZenRows

Success rate
81.53%
Avg response
11.0s
P90 latency
18.2s
Cost / 1K
$4.13
Free tier
No
Starting plan
$69/mo
AI implementation
Intermediate
Structured data
5 / 20

ZenRows packages a Universal Scraper API, headless Scraping Browser, 55M-IP residential proxy network across 190+ countries, and vertical scrapers for Amazon, Walmart, Zillow, Idealista, and Google. Its Adaptive Stealth Mode auto-escalates only when needed, billing solely on successful requests.

Pros
  • +Adaptive Stealth Mode auto-picks cheapest viable config and bills only on successful requests.
  • +Shared dollar balance spans Universal API, Scraping Browser, Residential Proxies, and Scraper APIs alike.
  • +Free autoparse extracts structured JSON from e-commerce, news, jobs, and real estate pages.
Cons
  • Entry pricing starts at $69.99/month with no Pay-As-You-Go option currently available.
  • Developer plan caps premium-proxy + JS-rendered requests at only 10K per month.
  • Credit multipliers stack aggressively: 5x for JS, 10x for premium proxy, 25x combined.
Pricing

Plans run from $69.99/month Developer (250K basic requests, 20 concurrency) through $2,999.99 Business 3K, plus custom Enterprise. Credits multiply 5x for JS rendering, 10x for premium proxy, and 25x combined. Top-ups add 15% usage for 15% price, and yearly billing saves 10%.

PlanPriceCredits / volume
Developer$69.99/mo250K basic / 10K premium+JS
Startup$129.99/mo1M basic / 40K premium+JS
Business$299.99/mo3M basic / 120K premium+JS
Business 3K$2,999.99/mo37.5M basic / 1.5M premium+JS
EnterpriseCustomShared balance + SLA + dedicated AM

Credits don't map one-to-one to requests. Each feature stacks a multiplier on top of the base call:

  • ·Basic request: 1x credits
  • ·JS rendering only: 5x
  • ·Premium proxy only: 10x
  • ·JS rendering + premium proxy: 25x

A few things to watch out for before signing up:

  • !No pay-as-you-go option — only monthly subscriptions.
  • !Developer plan caps premium+JS at just 10K requests per month.
  • !Geo-targeting is country-level only; no city or state targeting.
Per-domain results (20 domains)
DomainSuccessAvgP90Cost/1KStructured
amazon.com74.0%1.9s2.8s$0.28
bestbuy.com0.0%0.0s0.0s$0.00
bing.com100.0%5.6s8.3s$7.00
booking.com86.7%8.3s12.5s$7.00
capterra.com100.0%7.7s11.5s$1.40
ebay.com66.7%38.3s83.2s$7.00
g2.com80.0%18.2s27.3s$7.00
github.com100.0%0.9s1.3s$0.28
google.com100.0%13.1s19.6s$7.00
idealista.com96.7%12.0s18.0s$7.00
indeed.com100.0%9.3s13.9s$7.00
instagram.com0.0%0.0s0.0s$0.00
linkedin.com100.0%1.7s2.5s$0.28
reddit.com100.0%7.2s10.8s$7.00
tripadvisor.com96.7%37.7s56.5s$7.00
trustpilot.com96.7%36.0s60.8s$7.00
walmart.com33.3%7.6s12.1s$2.80
x.com100.0%0.8s1.2s$0.28
youtube.com100.0%1.1s1.6s$0.28
zillow.com100.0%13.1s19.7s$7.00
#12

ScrapingDog

Success rate
80.55%
Avg response
6.2s
P90 latency
9.5s
Cost / 1K
$2.16
Free tier
Yes
Starting plan
$40/mo
AI implementation
Intermediate
Structured data
11 / 20

ScrapingDog is a budget-tilted scraping API that bundles proxy rotation, headless Chrome, and a sprawling catalog of dedicated endpoints behind one key. It markets itself on breadth (Google, Amazon, LinkedIn, YouTube, X, Walmart, eBay, Indeed, Zillow) and low entry pricing rather than raw unblocking horsepower.

Pros
  • +Entry tier starts at $40/month for 200K credits, undercutting most rivals on cost-per-request math.
  • +Most dedicated endpoints (Amazon, Indeed, Yelp, YouTube Transcript) cost just 1 credit per successful request.
  • +Broad endpoint catalog spans SERPs, social, e-commerce, jobs, finance, and travel under a single API key.
Cons
  • The generic /scrape endpoint underperforms domain-specific scrapers, forcing users to dig through docs for the right URL.
  • Real estate and jobs coverage is uneven, with Zillow priced at 5 credits and Indeed reliability lagging dedicated rivals.
  • Signup lacks GitHub or social OAuth options, slowing onboarding compared with developer-first competitors.
Pricing

Pricing spans 28 monthly tiers from $40 LITE (200K credits, 5 concurrency) up to $30,000 NOVA PRO (1.1B credits). Annual billing trims roughly 17 percent, and only successful 200/404 responses are charged. A 1,000-credit free trial requires no card, but the free plan hard-caps at 1,000 requests per month.

PlanPriceCredits / volume
Free Trial$01,000 credits (one-time)
LITE$40/mo200K credits + 5 concurrency
STANDARD$90/mo1M credits + 50 concurrency
PRO$200/mo3M credits + 100 concurrency
NOVA PRO$30,000/mo1.1B credits + 2,200 concurrency

Credits don't map one-to-one to requests. Each feature stacks a multiplier on top of the base call:

  • ·Generic /scrape (base, no JS): 1 credit
  • ·Generic /scrape + JS render (default!): 5 credits
  • ·Generic /scrape + premium proxy: 10 credits
  • ·Generic /scrape + premium + JS: 25 credits
  • ·Dedicated endpoints (Amazon, Indeed, Yelp): 1 credit
  • ·LinkedIn profile (protected): 100 credits

A few things to watch out for before signing up:

  • !JS rendering is ON by default — silently costs 5x base credits.
  • !LinkedIn profiles and Amazon Reviews cost 100 credits each.
  • !Free plan hard-caps at 1K credits/month with a 403 on overage.
Per-domain results (20 domains)
DomainSuccessAvgP90Cost/1KStructured
amazon.com100.0%3.6s8.3s$0.20
bestbuy.com53.0%12.4s19.1s$0.20
bing.com100.0%5.3s7.2s$0.20
booking.com86.7%8.3s12.4s$5.00
capterra.com100.0%5.6s9.1s$0.20
ebay.com100.0%2.8s3.4s$1.00
g2.com0.0%0.0s0.0s$0.00
github.com100.0%5.9s7.6s$0.20
google.com100.0%1.5s2.2s$1.00
idealista.com31.0%11.7s15.5s$5.00
indeed.com68.0%6.4s17.2s$0.20
instagram.com100.0%3.7s5.7s$1.00
linkedin.com100.0%3.3s4.9s$10.00
reddit.com93.3%11.7s17.5s$5.00
tripadvisor.com24.0%7.3s8.7s$5.00
trustpilot.com99.0%22.9s29.6s$5.00
walmart.com100.0%4.1s6.1s$1.00
x.com100.0%1.5s3.0s$1.00
youtube.com100.0%1.6s3.1s$1.00
zillow.com56.0%3.9s10.1s$1.00
#13

ScraperAPI

Success rate
75.47%
Avg response
13.2s
P90 latency
20.2s
Cost / 1K
$9.63
Free tier
Yes
Starting plan
$49/mo
AI implementation
Intermediate
Structured data
4 / 20

ScraperAPI is a credit-based scraping API founded in 2018, abstracting proxy rotation, CAPTCHA handling, and JavaScript rendering behind a single endpoint. The platform pairs general scraping with four structured endpoints for Amazon, eBay, Google, and Walmart, plus a no-code DataPipeline and async batch jobs supporting up to 50,000 URLs per submission.

Pros
  • +Per-successful-request credit billing means only HTTP 200 and 404 responses get charged, simplifying cost forecasting versus bandwidth.
  • +Four dedicated structured endpoints for Amazon, eBay, Google, and Walmart return pre-parsed JSON without writing or maintaining selectors.
  • +A pre-flight urlcost endpoint and max_cost parameter let teams cap credit spend per request before firing the job.
Cons
  • Credit multipliers span 25x between tiers, with ultra_premium plus render hitting 75 credits and forcing careful per-domain budgeting.
  • Hobby and Startup plans restrict geotargeting to US and EU regions, so country-level routing requires the $299 Business tier.
  • x.com and twitter.com sit on the ToS denylist and return zero successful responses, with Zillow and Indeed weaker at default settings.
Pricing

Paid plans start at $49/month Hobby (100,000 credits, 20 threads, US/EU geo only) and scale through Startup ($149), Business ($299, full country geo), and Scaling ($475). A 7-day trial offers 5,000 credits without a card, and a 1,000-credit/month permanent free tier remains available.

PlanPriceCredits / volume
Free$01,000 credits/month
Hobby$49/mo100K credits + 20 threads, US/EU geo
Startup$149/mo1M credits + 50 threads, US/EU geo
Business$299/mo3M credits + 100 threads, full geo
Scaling$475/mo5M credits + 200 threads, full geo

Credits don't map one-to-one to requests. Each feature stacks a multiplier on top of the base call:

  • ·Standard request: 1x credits
  • ·Premium proxy: 10x
  • ·Premium + render: 25x
  • ·Ultra premium: 30x
  • ·Ultra premium + render: 75x

A few things to watch out for before signing up:

  • !x.com / twitter.com on ToS denylist — blocked at API level on every tier.
  • !Hobby and Startup restricted to US/EU geo; country geo unlocks at $299.
  • !75x credit range forces per-domain budgeting to avoid silent quota burn.
Per-domain results (20 domains)
DomainSuccessAvgP90Cost/1KStructured
amazon.com100.0%7.3s10.9s$2.45
bestbuy.com100.0%1.2s2.1s$36.75
bing.com100.0%1.4s2.1s$26.95
booking.com92.0%36.2s49.7s$2.45
capterra.com100.0%0.5s0.8s$4.90
ebay.com99.0%5.9s8.9s$0.49
g2.com93.3%6.7s37.1s$36.75
github.com100.0%2.6s3.9s$0.49
google.com97.0%5.5s8.3s$12.25
idealista.com100.0%1.9s2.9s$0.00
indeed.com60.0%3.5s5.3s$4.90
instagram.com0.0%0.0s0.0s$0.00
linkedin.com100.0%3.6s5.4s$14.70
reddit.com51.0%50.0s74.9s$19.60
tripadvisor.com64.0%47.9s56.2s$12.25
trustpilot.com2.0%54.8s82.1s$12.25
walmart.com100.0%15.6s23.3s$0.00
x.com0.0%0.0s0.0s$0.00
youtube.com100.0%5.8s8.6s$4.90
zillow.com51.0%13.9s20.8s$0.49
#14

Firecrawl

Success rate
66.50%
Avg response
3.2s
P90 latency
6.4s
Cost / 1K
$12.53
Free tier
Yes
Starting plan
$16/mo
AI implementation
Easy
Structured data
0 / 20

Firecrawl is an AI-focused web data API that converts pages into clean, LLM-ready markdown or structured JSON via endpoints like /v2/scrape, /crawl, /map, and /agent. Open source under AGPL-3.0, backed by Y Combinator, and popular with AI engineers building RAG pipelines and autonomous agents.

Pros
  • +Returns clean, LLM-ready markdown out of the box, removing the usual HTML-to-text cleanup step entirely.
  • +Open-source SDKs in Python, Node, Java, and Elixir, plus an MCP server and CLI for AI tooling.
  • +Fast latency on cooperative sites and a /map endpoint that returns full URL graphs for one credit.
Cons
  • Hard edge-level block-list refuses Instagram, LinkedIn, and Reddit requests with 403 policy errors before any fetch.
  • Google searches fail across every tier, returning reCAPTCHA challenges and 429 rate-limit responses on each attempt.
  • Once JSON extraction or enhanced proxy modifiers are enabled, per-1K-page cost ranks highest in the benchmark category.
Pricing

Subscription-only tiers run from a free 500-credit trial through Hobby ($16/mo, 3K credits), Standard ($83/mo, 100K), Growth ($333/mo, 500K), and Scale ($599/mo, 1M). There is no pay-as-you-go option, plan credits never roll over, and JSON or enhanced-proxy modifiers stack additional credits per page.

PlanPriceCredits / volume
Free$0500 credits one-time trial
Hobby$16/mo3K credits (billed yearly)
Standard$83/mo100K credits (billed yearly)
Growth$333/mo500K credits (billed yearly)
Scale$599/mo1M credits (billed yearly)

Credits don't map one-to-one to requests. Each feature stacks a multiplier on top of the base call:

  • ·/v1/scrape (basic): 1 credit / page
  • ·/v1/search: 2 credits per 10 results
  • ·Browser sessions / interact: 2 credits / browser-minute
  • ·JSON (LLM extraction): +4 credits / page
  • ·Enhanced (stealth) proxy: +4 credits / page
  • ·FIRE-1 agent: Dynamic; billed on failures too

A few things to watch out for before signing up:

  • !No pay-as-you-go — subscriptions only, and credits never roll over.
  • !FIRE-1 agent bills even on failed requests, rate-limited to 10/min.
  • !Enhanced proxy is US + Denmark only; auto-recharge capped at 4 packs/mo.
Per-domain results (20 domains)
DomainSuccessAvgP90Cost/1KStructured
amazon.com53.3%6.3s22.6s$5.33
bestbuy.com33.3%14.2s23.0s$26.65
bing.com100.0%0.4s0.5s$5.33
booking.com90.0%4.1s6.5s$5.33
capterra.com96.7%2.0s2.5s$5.33
ebay.com100.0%0.5s0.6s$26.65
g2.com83.3%11.6s19.1s$26.65
github.com100.0%2.6s5.1s$5.33
google.com0.0%0.0s0.0s$0.00
idealista.com100.0%0.4s0.5s$26.65
indeed.com40.0%3.4s14.9s$26.65
instagram.com0.0%0.0s0.0s$0.00
linkedin.com0.0%0.0s0.0s$0.00
reddit.com0.0%0.0s0.0s$0.00
tripadvisor.com100.0%0.4s0.5s$26.65
trustpilot.com100.0%0.4s0.6s$26.65
walmart.com100.0%0.4s0.5s$26.65
x.com100.0%5.9s8.8s$0.00
youtube.com100.0%4.1s9.0s$5.33
zillow.com33.3%7.2s12.4s$5.33
#15

ScrapingAnt

Success rate
56.20%
Avg response
23.0s
P90 latency
38.4s
Cost / 1K
$1.38
Free tier
Yes
Starting plan
$19/mo
AI implementation
Intermediate
Structured data
0 / 20

ScrapingAnt is a credit-based scraping API with headless Chrome rendering, rotating datacenter and residential proxies, webhook async, persistent sessions, and custom JS evaluation up to 60 seconds. A generous 10,000-credit free tier and $19/month Enthusiast plan make entry cheap, but credit multipliers on protected targets add up fast.

Pros
  • +Free forever tier offers 10,000 credits monthly with no card, no trial clock, and unlimited concurrency on paid plans.
  • +Default headless Chrome with custom JS evaluation, screenshot capture, persistent sessions, and webhook async covers most rendering workflows out of the box.
  • +Hosted MCP server, n8n nodes, Python and JavaScript SDKs make integration into AI agents and no-code stacks straightforward.
Cons
  • Datacenter response time averaged 33+ seconds in our benchmark, well behind providers that finish similar pages in under 10 seconds.
  • Residential proxy costs 25 credits per request and 125 with JS rendering, making protected targets 5x to 12x more expensive than datacenter.
  • Confirmed 423 anti-bot blocks on g2.com, linkedin.com, tripadvisor.com, trustpilot.com, and idealista, plus hard failures on X, Google, and Indeed.
Pricing

Plans run from a free 10,000-credit tier to Enthusiast at $19 for 100K credits, Startup at $49 for 500K, and Business at $249 for 3M. Credit multipliers matter: residential plus JS rendering burns 125 credits per call, so a nominal 100K plan can deliver as few as 800 protected requests.

PlanPriceCredits / volume
Free$010K credits
Enthusiast$19/mo100K credits
Startup$49/mo500K credits
Business$249/mo3M credits

Credits don't map one-to-one to requests. Each feature stacks a multiplier on top of the base call:

  • ·Datacenter proxy: 1 credit
  • ·JS render (browser + datacenter): 10 credits
  • ·Residential proxy: 25 credits
  • ·Residential + JS render: 125 credits

A few things to watch out for before signing up:

  • !browser=true is default — JS render silently costs 10x credits per call.
  • !423 anti-bot errors surface on hard targets (Google SERP, fingerprinted sites).
  • !No structured-data endpoints — relies on AI extractor for parsed output.
Per-domain results (20 domains)
DomainSuccessAvgP90Cost/1KStructured
amazon.com96.0%17.8s56.6s$0.19
bestbuy.com38.0%13.3s57.7s$1.90
bing.com100.0%39.9s46.8s$0.19
booking.com99.0%56.2s84.3s$0.19
capterra.com64.0%57.9s86.8s$0.19
ebay.com19.0%21.3s56.2s$0.19
g2.com0.0%0.0s0.0s$0.00
github.com100.0%5.2s11.7s$0.19
google.com42.0%31.9s48.7s$23.75
idealista.com0.0%0.0s0.0s$0.00
indeed.com54.0%56.3s60.6s$0.19
instagram.com100.0%12.4s18.6s$0.00
linkedin.com0.0%0.0s0.0s$0.00
reddit.com100.0%9.3s14.0s$0.00
tripadvisor.com0.0%0.0s0.0s$0.00
trustpilot.com0.0%0.0s0.0s$0.00
walmart.com100.0%37.3s56.0s$0.00
x.com30.0%5.8s28.1s$0.19
youtube.com91.0%38.5s57.3s$0.19
zillow.com91.0%56.8s85.2s$0.19
#16

SerpApi

Success rate
10.00%
Avg response
0.8s
P90 latency
1.1s
Cost / 1K
$25.00
Free tier
No
Starting plan
$25/mo
AI implementation
Easy
Structured data
8 / 20

SerpApi is a SERP-only API returning parsed JSON for 50+ search engines, including Google verticals (News, Shopping, Maps, Flights, Hotels, Trends, Images) and select marketplaces like Amazon, eBay, Walmart, YouTube, and Tripadvisor. It is not a general-purpose web scraper, and 18 of 20 domains in our benchmark have no matching SerpApi engine.

Pros
  • +Structured JSON output across 50+ engines removes HTML parsing work for Google, Bing, Yandex, Baidu, and Naver.
  • +Dedicated endpoints for Google News, Shopping, Maps, Flights, Hotels, Trends, and Images cover most SERP feature blocks.
  • +Cached repeat queries within a 1-hour window are free and do not decrement the monthly search quota.
Cons
  • SERP-only scope means no product pages, profiles, or arbitrary URLs outside the supported engine list.
  • Starter pricing of $25 per 1,000 searches runs roughly 10x more than generalist scrapers for equivalent crawl volume.
  • No shared schema across engines forces consumers to branch parsing logic for every distinct SerpApi endpoint.
Pricing

Pricing starts at $25/month for 1,000 searches on Starter, scaling through Developer ($75), Production ($150), and Big Data ($275 for 30,000 searches). Every successful call counts as one search regardless of engine, while cached, errored, and failed requests are not billed. Ludicrous Speed costs 2x per search.

PlanPriceCredits / volume
Starter$25/mo1,000 searches
Developer$75/mo5,000 searches
Production$150/mo15,000 searches
Big Data$275/mo30,000 searches

Credits don't map one-to-one to requests. Each feature stacks a multiplier on top of the base call:

  • ·Any engine (Google, Bing, Amazon, YouTube, etc.): 1 credit / search
  • ·Ludicrous Speed (priority queue): 2x base price
  • ·Cached repeat within 1h: Free (not counted)

A few things to watch out for before signing up:

  • !SERP-only — no arbitrary URL scraping or product / profile pages.
  • !$0.025 / search on Starter is ~10x the per-request rate of generalist scrapers.
  • !Each engine returns a different response schema; integration scales with engine count.
Per-domain results (20 domains)
DomainSuccessAvgP90Cost/1KStructured
amazon.com0.0%0.0s0.0s$25.00
bestbuy.com0.0%0.0s0.0s$25.00
bing.com100.0%13.0s18.0s$25.00
booking.com0.0%0.0s0.0s$25.00
capterra.com0.0%0.0s0.0s$25.00
ebay.com0.0%0.0s0.0s$25.00
g2.com0.0%0.0s0.0s$25.00
github.com0.0%0.0s0.0s$25.00
google.com100.0%2.5s3.2s$25.00
idealista.com0.0%0.0s0.0s$25.00
indeed.com0.0%0.0s0.0s$25.00
instagram.com0.0%0.0s0.0s$25.00
linkedin.com0.0%0.0s0.0s$25.00
reddit.com0.0%0.0s0.0s$25.00
tripadvisor.com0.0%0.0s0.0s$25.00
trustpilot.com0.0%0.0s0.0s$25.00
walmart.com0.0%0.0s0.0s$25.00
x.com0.0%0.0s0.0s$25.00
youtube.com0.0%0.0s0.0s$25.00
zillow.com0.0%0.0s0.0s$25.00