Head-to-head comparison of leading scraping APIs across diverse, challenging domains, measured on success rate, response time, and cost per 1,000 requests.
A web scraping API is a managed HTTP endpoint that scrapes a target URL on your behalf and returns the result. You send a single request with the URL and an API key; the provider handles proxy rotation, headless browsers, CAPTCHAs, fingerprinting, retries, and bot-detection bypass; and you get back rendered HTML, parsed JSON, or markdown. One call in, one clean response out.
The hard work happens inside that single request. Modern sites detect bots with a stack of defences — Cloudflare, DataDome, Akamai, PerimeterX, Turnstile, reCAPTCHA — and getting past them takes a constantly rotating pool of millions of residential and mobile IPs, real browser fingerprints, JavaScript execution, and retry logic. A scraping API absorbs all of that into one HTTP call so your code stays the size of a fetch().
Your request enters the API, flows through five managed stages — ingest, proxy, render, bypass, extract — and comes back as JSON, HTML, markdown, or CSV.
Pricing on most scraping APIs is built around credits, not requests. A basic HTML fetch is usually 1 credit, but enabling JavaScript rendering can cost 5×, residential proxies 10×, and the full “stealth” configuration on hard targets up to 75×. A nominal “100K credit” plan can deliver anywhere from a few thousand fully-protected scrapes to a hundred thousand simple fetches — which is why the per-provider breakdowns below itemize both the plan price and the credit multiplier of every feature toggle.
All 16 APIs ranked below expose the same basic shape (URL in, HTML or JSON out), but differ across five axes that decide success on real-world targets: proxy network size and type, anti-bot bypass quality, the availability of dedicated parsers for high-value sites, AI / MCP integration for agent workflows, and the pricing model — per successful request, per gigabyte, per parsed result, or per compute unit. The benchmark and rankings that follow score each axis against the same 20 target domains.
Each provider's benchmark numbers, what they do well, and where they fall short — ordered by overall success rate.
#1
Scrape.do
Success rate
99.39%
Avg response
4.2s
P90 latency
7.0s
Cost / 1K
$0.87
Free tier
Yes
Starting plan
$29/mo
AI implementation
Intermediate
Structured data
3 / 20
Scrape.do is a web-scraping API that routes requests through a pool of 110M+ datacenter, residential, and mobile proxies across 150 countries, with optional headless-browser rendering. It targets developers who want a thin, pay-per-success proxy layer rather than a managed dataset product, and competes mainly on price-per-credit and a free-forever tier.
Pros
+Granular credit pricing: 1 credit for datacenter, 5 for JS render, 10 for residential, 25 for residential plus render.
+Free-forever account and a permissive billing model that only charges on 2xx, 400, 404, and 410 responses.
+Async API runs on a separate concurrency pool worth 30% of your plan limit, so batch jobs don't starve live traffic.
Cons
−Concurrency on the cheaper plans is tight: 5 parallel requests on Free and Hobby, only stepping up at Pro (15) and Business (40).
−No official Python or JavaScript SDK; only a community-style scrapy-scrapedo wrapper, so most users wire up raw HTTP or proxy mode themselves.
−Auto-upgrades the proxy tier on protected domains even when you request basic. In our benchmark, capterra, google, idealista, indeed, reddit, tripadvisor, and trustpilot all billed at 10 credits per call (not 1), g2 at 25, and linkedin at 30, regardless of the params we sent. The actual cost shows in the scrape.do-request-cost response header per request.
Pricing
Plans are tiered as Free, Hobby, Pro, Business, Advanced, and Custom/Enterprise, billed in credits with concurrency rising from 5 (Free/Hobby) to 200 (Advanced). The headline gotcha is the 5x multiplier for JS render and 10x for residential (a residential plus render call burns 25 credits), plus per-domain surcharges that get applied automatically: 10 credits for most protected sites, 25 for g2, 30 for linkedin.
Plan
Price
Credits / volume
Free
$0
1K credits + 5 concurrency
Hobby
$29/mo
250K credits + 5 concurrency
Pro
$99/mo
1.5M credits + 15 concurrency
Business
$249/mo
5M credits + 40 concurrency
Advanced
$499/mo
12M credits + 200 concurrency
Credits don't map one-to-one to requests. Each feature stacks a multiplier on top of the base call:
!Auto-upgrade hides the real per-domain cost: requesting basic on capterra, google, indeed, reddit, tripadvisor, or trustpilot still bills 10 credits per call.
!Residential proxy at 10 credits per call (25 with render) burns volume fast on hard targets.
!Hard 2MB response cap on returned HTML.
Per-domain results (20 domains)▾
Domain
Success
Avg
P90
Cost/1K
Structured
amazon.com
100.0%
3.4s
4.8s
$0.11
✓
bestbuy.com
99.9%
4.4s
6.1s
$1.10
—
bing.com
100.0%
1.1s
1.5s
$0.11
—
booking.com
98.7%
4.6s
6.3s
$0.11
—
capterra.com
100.0%
9.1s
19.5s
$1.10
—
ebay.com
99.5%
2.5s
3.8s
$0.11
—
g2.com
99.7%
10.2s
18.3s
$2.75
—
github.com
100.0%
3.0s
6.9s
$0.11
—
google.com
100.0%
1.9s
2.7s
$1.10
✓
idealista.com
100.0%
1.0s
1.4s
$1.10
—
indeed.com
100.0%
8.3s
17.4s
$1.10
—
instagram.com
99.9%
1.3s
1.4s
$0.11
—
linkedin.com
99.8%
5.2s
8.9s
$3.30
—
reddit.com
100.0%
2.0s
2.3s
$1.10
—
tripadvisor.com
100.0%
2.6s
3.4s
$1.10
—
trustpilot.com
99.7%
3.2s
4.3s
$1.10
—
walmart.com
99.8%
5.1s
7.6s
$0.11
—
x.com
90.8%
10.2s
15.7s
$0.55
—
youtube.com
100.0%
2.4s
3.6s
$0.11
✓
zillow.com
100.0%
2.6s
4.0s
$1.10
—
#2
Decodo
Success rate
95.90%
Avg response
11.9s
P90 latency
17.9s
Cost / 1K
$0.86
Free tier
Yes
Starting plan
$19/mo
AI implementation
Intermediate
Structured data
6 / 20
Decodo is the 2024 rebrand of Smartproxy, offering a Web Scraping API alongside residential, mobile, and datacenter proxies. The unified scraper-api.decodo.com/v2/scrape endpoint covers general scraping plus target templates for Amazon, Google, Walmart, Reddit, YouTube, Bing, TikTok, and Target.
Pros
+Large 125M+ IP pool with 195+ residential locations and a claimed 99.86% success rate on residential proxies.
+Built-in parsers for 20+ targets including Amazon, Google, Bing, Walmart, Reddit, and YouTube return structured JSON automatically.
+Open-source MCP server on GitHub and a free AI Parser make it easier to wire into LLM and agent pipelines.
Cons
−The 2024 Smartproxy rebrand means third-party tutorials and Stack Overflow answers still reference old gate.smartproxy.com hostnames.
−Target template coverage is narrower than Bright Data or Apify, with no dedicated shopping, scholar, or news SERP endpoints.
−The $0.50/1K standard tier only carries 6 of our 20 benchmark domains; the other 14 require standard+JS ($0.75), premium ($1.00), or premium+JS ($1.50), pushing blended cost on a mixed workload closer to $0.86/1K than the headline rate.
Pricing
The Web Scraping API starts at $19/month for 38K standard requests at $0.50/1K, with premium proxies plus JS rendering billed at $1.50/1K. A free tier offers 2K requests, and the popular $99 Pro plan unlocks 50 req/s and roughly 82K premium+JS requests. Real-world blended cost depends heavily on which tier your target domains require: 6 of our 20 benchmark domains worked on standard, 5 on standard+JS, 6 on premium, and 3 only on premium+JS.
Plan
Price
Credits / volume
Free
$0
2K requests @ 10 req/s
Starter
$19/mo
38K standard requests @ 10 req/s
Advanced
$49/mo
163K standard requests @ 25 req/s
Pro
$99/mo
707K standard requests @ 50 req/s
Enterprise
Custom
Custom volume + concurrency
Credits don't map one-to-one to requests. Each feature stacks a multiplier on top of the base call:
·Standard proxy (8 geos): $0.50 / 1K (1x base)
·Standard + JS render: $0.75 / 1K (1.5x)
·Premium proxy (195+ geos): $1.00 / 1K (2x)
·Premium + JS render: $1.50 / 1K (3x)
·AI Parser: Free — natural-language → JSON
A few things to watch out for before signing up:
!Smartproxy → Decodo rebrand confusion still circulating in old docs.
!Starter tier rate-capped at 10 req/s — must jump to Advanced for 25 req/s.
!Target templates force the premium pool (2-3x cost).
Per-domain results (20 domains)▾
Domain
Success
Avg
P90
Cost/1K
Structured
amazon.com
100.0%
4.2s
6.4s
$0.50
✓
bestbuy.com
79.0%
24.4s
36.6s
$1.50
—
bing.com
100.0%
3.8s
5.7s
$0.50
✓
booking.com
98.0%
25.8s
38.7s
$0.75
—
capterra.com
100.0%
3.6s
5.5s
$0.75
—
ebay.com
100.0%
5.0s
7.5s
$1.00
—
g2.com
60.0%
47.6s
71.5s
$1.50
—
github.com
100.0%
2.6s
3.9s
$0.50
—
google.com
99.0%
2.9s
4.3s
$0.50
✓
idealista.com
100.0%
4.2s
6.3s
$1.00
—
indeed.com
100.0%
4.5s
6.8s
$1.00
—
instagram.com
100.0%
4.0s
6.0s
$0.75
—
linkedin.com
100.0%
3.0s
4.5s
$0.50
—
reddit.com
100.0%
2.3s
3.4s
$0.50
✓
tripadvisor.com
100.0%
8.6s
12.8s
$1.00
—
trustpilot.com
100.0%
24.5s
36.7s
$0.75
—
walmart.com
100.0%
6.9s
10.3s
$1.00
✓
x.com
100.0%
18.3s
27.4s
$0.75
—
youtube.com
82.0%
3.1s
4.7s
$1.50
✓
zillow.com
100.0%
38.9s
58.4s
$1.00
—
#3
Apify
Success rate
95.25%
Avg response
19.5s
P90 latency
29.2s
Cost / 1K
$7.04
Free tier
Yes
Starting plan
$29/mo
AI implementation
Intermediate
Structured data
20 / 20
Apify is a Prague-based scraping platform built around Actors: containerized serverless programs that run on its cloud, with a marketplace of 22,000+ pre-built scrapers. Founded 2015, it pairs the open-source Crawlee SDK with integrated proxies, storage, scheduling, and MCP server access for AI agents.
Pros
+Marketplace of 22,000+ Actors covers TikTok, Instagram, Google Maps, Amazon, and most niche sites without custom code.
+Crawlee SDK and code templates let developers build, deploy, and monetize custom scrapers on managed cloud infrastructure.
+Native MCP server and integrations with LangChain, LlamaIndex, Zapier, Make, and n8n suit AI agent workflows.
Cons
−Steeper learning curve than single-endpoint APIs since users must pick Actors, configure JSON inputs, and manage runs.
−Compute-unit pricing (memory × runtime plus proxy GB and storage I/O) makes monthly costs hard to forecast accurately.
−Marketplace quality varies widely because community-published Actors set their own pricing, support, and maintenance cadence.
Pricing
Credit-based consumption rather than flat per-request, billing compute units, residential or SERP proxy traffic, storage I/O, and data transfer. Free tier includes $5 monthly credits; paid Starter, Scale, and Business tiers unlock more compute and discounted pay-per-event rates. Third-party Actors add rental fees from roughly $20/month or $8 per 1,000 results.
Plan
Price
Credits / volume
Free
$0/mo
$5 monthly platform credits
Starter
$39/mo
Increased compute + PPE discount
Scale
$199/mo
Higher compute + deeper PPE discount
Business
$999/mo
Largest compute + best PPE rate
Per-actor pricing
Varies
Pay-per-result (~$8/1K) or pay-per-event
Credits don't map one-to-one to requests. Each feature stacks a multiplier on top of the base call:
·Compute units: CPU × memory × runtime per actor
·Residential proxy: Per-GB transfer
·SERP proxy: Per query
·Datacenter proxy: Per-GB (cheapest tier)
·Dataset / storage I/O: Per read + write
A few things to watch out for before signing up:
!Compute-unit pricing across 10+ dimensions is hard to forecast.
!Marketplace quality varies — community actors lack consistent maintenance.
!Monthly actor rental and pay-per-event fees stack on top of platform compute.
Per-domain results (20 domains)▾
Domain
Success
Avg
P90
Cost/1K
Structured
amazon.com
80.0%
14.5s
21.8s
$5.00
✓
bestbuy.com
100.0%
11.6s
17.3s
$10.15
✓
bing.com
100.0%
13.3s
18.1s
$6.10
✓
booking.com
100.0%
52.4s
78.6s
$1.07
✓
capterra.com
100.0%
17.2s
25.9s
$6.05
✓
ebay.com
100.0%
7.0s
10.5s
$4.10
✓
g2.com
75.0%
2.7s
4.0s
$13.75
✓
github.com
100.0%
6.2s
9.2s
$4.55
✓
google.com
100.0%
12.7s
19.0s
$1.50
✓
idealista.com
90.0%
11.5s
17.2s
$2.00
✓
indeed.com
100.0%
20.8s
31.2s
$13.25
✓
instagram.com
100.0%
6.6s
9.9s
$2.60
✓
linkedin.com
100.0%
8.9s
13.3s
$4.00
✓
reddit.com
100.0%
20.0s
30.0s
$44.00
✓
tripadvisor.com
100.0%
54.4s
81.5s
$7.21
✓
trustpilot.com
85.0%
22.5s
33.8s
$0.47
✓
walmart.com
80.0%
56.0s
84.0s
$3.06
✓
x.com
100.0%
16.3s
24.5s
$5.00
✓
youtube.com
95.0%
24.4s
36.6s
$4.00
✓
zillow.com
100.0%
11.8s
17.8s
$3.00
✓
#4
Bright Data
Success rate
94.67%
Avg response
14.6s
P90 latency
29.0s
Cost / 1K
$1.55
Free tier
Yes
Starting plan
PAYG
AI implementation
Intermediate
Structured data
20 / 20
Bright Data is an Israel-based web data platform serving 20,000+ organizations with a full stack spanning proxy networks, unlocking APIs, a scraping browser, 250+ pre-built scrapers, ready-made datasets, and a 50+ PB web archive. Its breadth and enterprise compliance posture (GDPR, CCPA, ISO 27001, SOC) target large teams rather than weekend scripters.
Pros
+Pay-only-for-success billing on Web Unlocker, SERP, and Scraper APIs means failed requests and retries don't count against you.
+Proxy network is unusually deep: 400M+ residential IPs, 1.3M datacenter, 1.3M ISP, and 7M mobile across 195 countries with city and ZIP targeting.
+Product range is the widest in the category, covering raw proxies, browser API, 250+ pre-built scrapers, 190+ datasets, archive, and a free MCP server with 5,000 requests/month.
Cons
−Pricing is fragmented across at least nine separate product lines with different billing units (per 1K results, per GB, per IP, per record), making total cost hard to predict.
−Marketing IP counts diverge from documentation: product pages cite 400M+ residential IPs while docs reference 150M+ total, suggesting the headline number reflects monthly unique devices rather than concurrent capacity.
−Heavy promotional discounting (50% off residential, 25% off scrapers) means published rates are unstable and renewals can effectively double once coupons expire.
Pricing
Web Unlocker, SERP, and Crawl APIs start at $1.50 per 1,000 successful results on pay-as-you-go, dropping to $1.00 at the $1,999/month tier. The Scraping Browser is bandwidth-billed at $8/GB down to $5/GB, residential proxies start at $8/GB (currently $4 with promo), and datasets begin at $250 per 100K records. New accounts get $5 in free credits plus a first-deposit match up to $500.
Plan
Price
Credits / volume
Pay As You Go
$1.50 / 1K
no commitment
Growth
$499/mo
380K results ($1.30/1K)
Business
$999/mo
900K results ($1.10/1K)
Premium
$1,999/mo
2M results ($1.00/1K)
Enterprise
Custom
SSO + Premium SLA
Credits don't map one-to-one to requests. Each feature stacks a multiplier on top of the base call:
·Scraping Browser: $8/GB → $5/GB bandwidth
·Residential proxies: $8/GB ($4/GB promo)
·Datasets Marketplace: $250 per 100K records
·Archive API (historical): $1.00 / 1K vs $0.20 / 1K recent
A few things to watch out for before signing up:
!Each product line bills separately even though tiers look unified.
!Scraping Browser is GB-billed, not per request — costs vary with page weight.
!Promo rates expire after the first cycle; renewals can effectively double.
Per-domain results (20 domains)▾
Domain
Success
Avg
P90
Cost/1K
Structured
amazon.com
96.7%
3.4s
4.8s
$1.50
✓
bestbuy.com
83.3%
10.3s
26.8s
$2.50
✓
bing.com
100.0%
4.5s
11.6s
$1.50
✓
booking.com
86.7%
31.4s
90.0s
$1.50
✓
capterra.com
80.0%
51.9s
90.0s
$1.50
✓
ebay.com
93.3%
10.0s
27.1s
$1.50
✓
g2.com
83.3%
43.5s
90.0s
$1.50
✓
github.com
100.0%
1.4s
1.7s
$1.50
✓
google.com
100.0%
3.1s
6.2s
$1.50
✓
idealista.com
96.7%
25.7s
36.7s
$1.50
✓
indeed.com
100.0%
6.6s
20.2s
$1.50
✓
instagram.com
100.0%
2.7s
3.6s
$1.50
✓
linkedin.com
100.0%
5.4s
6.1s
$1.50
✓
reddit.com
100.0%
1.4s
1.8s
$1.50
✓
tripadvisor.com
100.0%
18.4s
28.9s
$1.50
✓
trustpilot.com
80.0%
33.6s
65.1s
$1.50
✓
walmart.com
96.7%
13.3s
20.2s
$1.50
✓
x.com
96.7%
17.5s
25.2s
$1.50
✓
youtube.com
100.0%
2.5s
3.3s
$1.50
✓
zillow.com
100.0%
5.2s
20.9s
$1.50
✓
#5
Scrapfly
Success rate
93.45%
Avg response
4.8s
P90 latency
7.2s
Cost / 1K
$2.69
Free tier
Yes
Starting plan
$30/mo
AI implementation
Intermediate
Structured data
0 / 20
Scrapfly is a developer-focused platform built around three APIs — Web Scraping, Screenshot, and Extraction — billed against a single credit balance. Originally built internally in 2017 and opened publicly in 2020, it leans toward engineering teams that want fine-grained controls like ASP toggles, CDP access, and named extraction models.
Pros
+Three coordinated APIs (scrape, screenshot, extract) share one credit balance, simplifying budgeting across mixed workloads.
+Python and TypeScript SDKs plus a Scrapy extension cover most common stacks without custom HTTP glue code.
+Open-source scrapers for 40+ domains on GitHub and the Scrapfly Academy curriculum lower the onboarding curve.
Cons
−SMS phone verification during signup adds friction and reportedly precedes account bans for some users.
−Generic content-type extraction models (product, article) tend to be less accurate than domain-specific parsers from competitors.
−The $30 Discovery plan covers only about 6,600 fully-protected requests since ASP+JS+residential hits the 30-credit ceiling.
Pricing
Pricing starts with a free 1,000-credit tier, then a $30 Discovery plan with 200,000 credits, scaling to $500 Enterprise at 5.5M credits. Fully-protected requests using ASP, JS rendering, and residential proxies cost up to 30 credits each, so headline credit counts shrink quickly on hard targets. Annual billing knocks off roughly 16%.
Plan
Price
Credits / volume
Free
$0
1,000 credits/month
Discovery
$30/mo
200K credits
Production
$100/mo
1M credits
Startup
$250/mo
2.5M credits
Enterprise
$500/mo
5.5M credits
Credits don't map one-to-one to requests. Each feature stacks a multiplier on top of the base call:
!SMS phone verification at signup blocks some users from trialing the service.
!$30 plan yields only ~6,600 fully-protected requests per month.
!Annual billing saves ~16% but locks you in.
Per-domain results (20 domains)▾
Domain
Success
Avg
P90
Cost/1K
Structured
amazon.com
100.0%
4.7s
6.2s
$3.75
—
bestbuy.com
90.0%
5.5s
8.3s
$3.37
—
bing.com
98.0%
2.6s
3.9s
$0.15
—
booking.com
98.0%
7.6s
11.5s
$4.07
—
capterra.com
99.0%
4.4s
7.9s
$6.76
—
ebay.com
60.0%
8.5s
12.8s
$0.82
—
g2.com
100.0%
5.1s
7.7s
$6.00
—
github.com
100.0%
4.3s
6.4s
$3.75
—
google.com
63.3%
8.2s
11.8s
$0.90
—
idealista.com
82.0%
2.4s
3.5s
$3.07
—
indeed.com
100.0%
6.2s
9.3s
$3.75
—
instagram.com
98.0%
3.7s
5.5s
$0.15
—
linkedin.com
100.0%
3.1s
4.7s
$3.90
—
reddit.com
100.0%
2.6s
3.9s
$3.67
—
tripadvisor.com
86.0%
8.6s
12.9s
$4.51
—
trustpilot.com
100.0%
1.7s
2.5s
$3.75
—
walmart.com
100.0%
3.4s
4.7s
$0.15
—
x.com
98.0%
5.6s
8.4s
$0.15
—
youtube.com
100.0%
1.5s
2.3s
$0.15
—
zillow.com
96.7%
5.8s
9.1s
$0.90
—
#6
Oxylabs
Success rate
93.42%
Avg response
13.1s
P90 latency
20.2s
Cost / 1K
$7.00
Free tier
No
Starting plan
$49/mo
AI implementation
Difficult
Structured data
9 / 20
Oxylabs is a Lithuania-based web intelligence platform offering residential, datacenter, ISP, and mobile proxies alongside Web Scraper API and Web Unblocker. The company targets enterprise data teams with 177M+ IPs across 195 countries, ISO 27001 certification, and an AI-assisted code generator called OxyCopilot.
Pros
+Massive IP footprint of 177M+ residential addresses spanning 195 countries supports granular city, state, and ZIP targeting.
+Success-based billing on Scraper API and Web Unblocker means 5xx server errors are not charged to the customer.
+OxyCopilot generates request code and custom parsers from natural language, reducing setup time for new scraping targets.
Cons
−Bandwidth-based GB pricing on Web Unblocker and proxies makes costs unpredictable, since heavy pages consume more billable traffic.
−Entry-level Web Unblocker plan starts at $75 monthly (pre-promo), among the highest minimum commitments in the unblocking API category.
−Residential response times average 0.6 seconds, and heavy JS-rendered targets can extend latency further on the Scraper API.
Pricing
Web Scraper API starts at $49/month for 98K Amazon results, with success-based billing on 2xx/4xx responses only. Web Unblocker uses GB-based pricing from $9.40/GB regular ($75 entry plan), while residential proxies start at $6/GB and datacenter from $0.59/GB. Enterprise tiers require custom quotes.
Plan
Price
Credits / volume
Free Trial
$0
2,000 Web Scraper API results
Web Scraper API Micro
$49/mo
98K Amazon results
Web Unblocker Micro
$75/mo
8GB bandwidth
Web Scraper API Starter
$99/mo
220K results
Web Scraper API Advanced
$249/mo
622.5K results
Credits don't map one-to-one to requests. Each feature stacks a multiplier on top of the base call:
·Web Unblocker bandwidth: $9.40/GB ($5.64 promo)
·Residential Proxies: $6.00/GB
·Datacenter Proxies (PAYG): $0.59/GB
·Web Scraper API + JS rendering: $1.35 / 1K results
A few things to watch out for before signing up:
!GB-based billing on Web Unblocker makes costs unpredictable vs flat per-request.
!$75/mo Web Unblocker entry is the highest in the unblocking category.
!No MCP server — integration requires SDKs, Postman, or direct HTTP.
Per-domain results (20 domains)▾
Domain
Success
Avg
P90
Cost/1K
Structured
amazon.com
100.0%
10.2s
15.3s
$7.00
✓
bestbuy.com
75.0%
34.1s
51.1s
$7.00
✓
bing.com
100.0%
7.0s
10.5s
$7.00
✓
booking.com
86.7%
30.9s
49.1s
$7.00
—
capterra.com
100.0%
18.4s
27.7s
$7.00
—
ebay.com
100.0%
7.0s
10.5s
$7.00
✓
g2.com
83.3%
23.0s
34.5s
$7.00
—
github.com
100.0%
4.0s
6.1s
$7.00
—
google.com
100.0%
6.7s
10.0s
$7.00
✓
idealista.com
90.0%
7.8s
19.7s
$7.00
✓
indeed.com
100.0%
27.6s
41.4s
$7.00
—
instagram.com
100.0%
14.3s
21.5s
$7.00
—
linkedin.com
100.0%
4.2s
6.3s
$7.00
—
reddit.com
100.0%
5.0s
7.6s
$7.00
—
tripadvisor.com
91.7%
16.3s
24.5s
$7.00
—
trustpilot.com
41.7%
24.0s
36.0s
$7.00
—
walmart.com
100.0%
4.4s
6.6s
$7.00
✓
x.com
100.0%
6.8s
10.1s
$7.00
—
youtube.com
100.0%
5.0s
7.5s
$7.00
✓
zillow.com
100.0%
5.2s
7.7s
$7.00
✓
#7
ScrapegraphAI
Success rate
88.67%
Avg response
5.8s
P90 latency
8.6s
Cost / 1K
$5.80
Free tier
Yes
Starting plan
$17/mo
AI implementation
Easy
Structured data
0 / 20
ScrapegraphAI is an LLM-first scraping API that turns URLs into structured data via natural-language prompts or JSON schemas. It exposes generic Scrape, Extract, Search, Crawl and Monitor endpoints with no per-site parsers, served from api.scrapegraphai.com and wrapped by official Python and JavaScript SDKs.
Pros
+AI-driven Extract endpoint converts free-text prompts or JSON schemas into structured output without writing selectors.
+Generic by design with one endpoint per task, so Scrape, Search and Crawl share the same prompt-based interface.
+Official scrapegraph-py and scrapegraph-js SDKs plus LangChain, LlamaIndex and n8n integrations cover AI agent workflows.
Cons
−Hard-to-scrape consumer targets like Zillow can return an empty body, so coverage on protected sites is inconsistent.
−LLM-backed extraction adds noticeable latency on heavier pages such as X.com timelines compared with raw HTML fetches.
−Extract costs 5 credits per call versus 1 for markdownify, making structured runs roughly five times pricier than plain scrapes.
Pricing
Pricing is credit-based with a 500-credit free tier and a $17/month Starter plan that includes 10,000 credits and 100 requests per minute. Markdownify scrapes cost 1 credit, Extract calls 5 credits, and stealth mode adds 5 credits per request; top-up packs start at $5 for 1,000 credits.
Plan
Price
Credits / volume
Free
$0
500 credits one-time, 10 req/min
Starter
$17/mo
10K credits + 100 req/min
Growth
$85/mo
100K credits + 500 req/min
Pro
$425/mo
750K credits + 5K req/min
Enterprise
Custom
Custom credits + SLA
Credits don't map one-to-one to requests. Each feature stacks a multiplier on top of the base call:
·Scrape (markdown): 1 credit
·Scrape (screenshot): 2 credits
·Extract (LLM-structured): 5 credits
·Search (with prompt): 5 credits / result
·Stealth toggle: +5 credits per request
A few things to watch out for before signing up:
!Extract costs 5x a basic markdown scrape — the LLM is the expensive part.
!Stealth adds a flat +5 credits, making protected targets ~6x more expensive.
!Some hard sites (Zillow-class anti-bot) return empty bodies even with stealth.
Per-domain results (20 domains)▾
Domain
Success
Avg
P90
Cost/1K
Structured
amazon.com
100.0%
6.9s
10.4s
$2.00
—
bestbuy.com
0.0%
0.0s
0.0s
$0.00
—
bing.com
100.0%
0.6s
0.8s
$2.00
—
booking.com
100.0%
7.3s
11.0s
$12.00
—
capterra.com
100.0%
0.2s
0.2s
$12.00
—
ebay.com
100.0%
3.0s
4.5s
$12.00
—
g2.com
96.7%
16.0s
24.0s
$12.00
—
github.com
100.0%
1.8s
2.7s
$2.00
—
google.com
100.0%
1.2s
1.7s
$2.00
—
idealista.com
100.0%
1.6s
2.3s
$12.00
—
indeed.com
100.0%
4.2s
6.3s
$12.00
—
instagram.com
100.0%
9.3s
13.9s
$2.00
—
linkedin.com
100.0%
11.8s
17.6s
$2.00
—
reddit.com
100.0%
2.8s
4.1s
$2.00
—
tripadvisor.com
93.3%
6.8s
10.2s
$2.00
—
trustpilot.com
100.0%
5.3s
8.0s
$12.00
—
walmart.com
96.7%
1.6s
0.1s
$12.00
—
x.com
86.7%
27.1s
40.7s
$2.00
—
youtube.com
100.0%
8.3s
12.4s
$2.00
—
zillow.com
0.0%
0.0s
0.0s
$0.00
—
#8
WebScrapingAPI
Success rate
86.91%
Avg response
14.8s
P90 latency
32.3s
Cost / 1K
$6.62
Free tier
Yes
Starting plan
$19/mo
AI implementation
Intermediate
Structured data
8 / 20
WebScrapingAPI is a Romania-founded platform offering a Scraper API, Browser API, residential proxies, and dedicated SERP and Amazon endpoints. It bundles JS rendering, ASN-level geo-targeting, and six official SDKs (Node, Python, Scrapy, Rust, Java, PHP), with billing only for successful Scraper API requests.
Pros
+Free tier offers 5,000 monthly requests, one of the more generous freemiums among general-purpose scraping APIs.
+Six official SDKs covering Node, Python, Scrapy, Rust, Java, and PHP reduce integration friction across language stacks.
+Scraper API bills only successful requests, and ASN-level targeting plus 195-country coverage suit precise geo workflows.
Cons
−The $19 Starter plan ships only 7,000 requests, well below rival entry tiers that bundle 100,000-plus at similar prices.
−Browser API charges for every request including failures, breaking the headline 'pay only for success' promise on JS-heavy targets.
−The generic name causes constant confusion with similarly branded competitors like ScrapingAPI, ScraperAPI, and ScrapingBee.
Pricing
Paid Scraper API tiers run from $19/mo for 7,000 calls up to $599/mo for 450,000, with a free 5,000-request trial. SERP and Amazon APIs price separately, starting at $28 and $59 respectively, and residential proxies begin at $8.50/GB pay-as-you-go.
Plan
Price
Credits / volume
Trial
$0
5,000 API calls/month
Starter
$19/mo
7,000 API calls
Basic
$49/mo
20,000 API calls
Standard
$99/mo
45,000 API calls
Pro
$599/mo
450,000 API calls
Credits don't map one-to-one to requests. Each feature stacks a multiplier on top of the base call:
·Scraper API (success-billed): 1 credit
·Browser API (billed on failure too): 1 credit / request
·Heavier protected targets: Up to 5 credits
·SERP API: Separate $28/mo plan, 10K requests
·Amazon API: Separate $59/mo plan, 10K requests
·Residential Proxies PAYG: $8.50/GB
A few things to watch out for before signing up:
!Starter plan ships just 7K requests — rivals offer 100K+ at the same price.
!Browser API bills 100% of requests, including failures.
!Naming clashes with ScraperAPI, ScrapingAPI, and ScrapingBee.
Per-domain results (20 domains)▾
Domain
Success
Avg
P90
Cost/1K
Structured
amazon.com
100.0%
2.9s
4.8s
$2.45
✓
bestbuy.com
87.0%
7.4s
16.4s
$12.25
✓
bing.com
51.0%
2.2s
6.6s
$2.45
✓
booking.com
93.3%
24.3s
84.9s
$12.25
✓
capterra.com
93.0%
46.2s
86.9s
$2.45
—
ebay.com
69.2%
25.9s
42.9s
$24.50
✓
g2.com
95.9%
50.9s
77.4s
$2.45
—
github.com
100.0%
1.7s
2.8s
$2.45
—
google.com
99.0%
3.3s
9.3s
$2.45
✓
idealista.com
96.6%
25.0s
47.5s
$2.45
—
indeed.com
59.0%
10.3s
36.4s
$12.25
—
instagram.com
100.0%
2.4s
3.1s
$24.50
—
linkedin.com
100.0%
4.2s
10.4s
$2.45
—
reddit.com
100.0%
2.7s
3.8s
$2.45
—
tripadvisor.com
98.0%
14.2s
26.9s
$2.45
—
trustpilot.com
77.8%
22.6s
53.1s
$2.45
—
walmart.com
24.7%
13.9s
43.6s
$2.45
✓
x.com
97.0%
18.0s
45.3s
$2.45
✓
youtube.com
100.0%
2.2s
4.4s
$2.45
—
zillow.com
96.7%
16.6s
39.5s
$12.25
—
#9
ScrapingBee
Success rate
85.12%
Avg response
22.7s
P90 latency
32.2s
Cost / 1K
$2.64
Free tier
No
Starting plan
$49/mo
AI implementation
Easy
Structured data
4 / 20
ScrapingBee is a France-based scraping API from founders Kevin Sahin and Pierre de Wulf, serving 2,500+ customers with a developer-first HTML endpoint. The platform spans AI extraction, dedicated Google/Amazon/YouTube/Walmart APIs, a CLI, and an MCP server for AI agents.
Pros
+All features unlocked on every paid plan, including AI extraction, JS rendering, and SERP APIs.
+Three-tier proxy system covers datacenter, residential, and a 75-credit stealth pool for hard targets.
+Dedicated structured endpoints exist for Google, Amazon, YouTube, Walmart, and ChatGPT scraping.
Cons
−JavaScript rendering is on by default and costs 5 credits, burning quota faster than expected.
−Stealth proxy requests cost 75 credits each and require JS rendering to be enabled.
−No free tier exists beyond a one-time 1,000-credit trial, with paid plans starting at $49/month.
Pricing
Paid plans run $49/mo Freelance (250k credits), $99 Startup (1M), $249 Business (3M), and $599 Business+ (8M), all excluding VAT. A 1,000-credit trial is offered with no card required, but there is no ongoing free tier.
Plan
Price
Credits / volume
Free Trial
$0
1,000 credits one-time
Freelance
$49/mo
250K credits + 10 concurrency
Startup
$99/mo
1M credits + 50 concurrency
Business
$249/mo
3M credits + 100 concurrency
Business+
$599/mo
8M credits + 200 concurrency
Credits don't map one-to-one to requests. Each feature stacks a multiplier on top of the base call:
·JS rendering (default on): 5 credits
·Premium proxy without JS: 10 credits
·Premium proxy with JS: 25 credits
·Stealth proxy (JS required): 75 credits
·Google SERP (custom_google): 15 credits
A few things to watch out for before signing up:
!JS rendering is on by default — 5 credits per call.
!Stealth proxy costs 75 credits each and requires JS.
!No ongoing free tier; only a one-time 1K-credit trial.
Per-domain results (20 domains)▾
Domain
Success
Avg
P90
Cost/1K
Structured
amazon.com
100.0%
4.9s
8.9s
$0.20
✓
bestbuy.com
100.0%
47.3s
60.4s
$4.90
—
bing.com
100.0%
0.9s
1.7s
$0.20
—
booking.com
97.0%
38.9s
58.9s
$4.90
—
capterra.com
100.0%
24.2s
48.2s
$4.90
—
ebay.com
98.0%
9.6s
18.5s
$4.90
—
g2.com
0.0%
90.8s
120.0s
$4.90
—
github.com
100.0%
1.3s
2.3s
$0.20
—
google.com
100.0%
3.0s
6.6s
$4.90
✓
idealista.com
54.0%
110.6s
140.4s
$14.70
—
indeed.com
90.0%
3.5s
5.8s
$0.20
—
instagram.com
99.0%
2.3s
4.2s
$0.98
—
linkedin.com
100.0%
2.1s
2.9s
$0.20
—
reddit.com
67.0%
2.7s
4.7s
$0.20
—
tripadvisor.com
52.0%
7.2s
10.1s
$0.20
—
trustpilot.com
91.0%
40.8s
56.8s
$4.90
—
walmart.com
84.0%
4.5s
10.0s
$0.98
✓
x.com
100.0%
1.0s
2.4s
$0.20
—
youtube.com
77.0%
1.3s
2.4s
$0.20
✓
zillow.com
93.3%
57.9s
78.1s
$0.00
—
#10
Zyte
Success rate
83.00%
Avg response
11.5s
P90 latency
25.6s
Cost / 1K
$3.50
Free tier
No
Starting plan
PAYG
AI implementation
Difficult
Structured data
0 / 20
Zyte, formerly Scrapinghub, is the company behind Scrapy and has been operating since 2010, making it one of the oldest players in the space. Its unified Zyte API bundles automatic unblocking, headless browser rendering, AI extraction, and proxy management into a single endpoint.
Pros
+Built and maintains Scrapy, the dominant open-source scraping framework with a 20,000+ developer Discord community.
+Only successful responses are billed, with bans and rate-limit errors free across all five difficulty tiers.
+AI extraction covers products, articles, job postings, and SERPs, plus a VS Code Copilot for spider development.
Cons
−Per-website tier pricing swings from $0.13 to $16.08 per 1,000 requests, making project costs hard to forecast.
−Tier assignment is automatic and only reviewed quarterly, so users cannot optimize by choosing a cheaper engine.
−Marketing claims sub-100ms latency, but browser-rendered requests routinely take 10-30 seconds in practice.
Pricing
Zyte API uses a five-tier per-website model from $0.13 per 1,000 simple HTTP requests up to $16.08 for advanced browser-rendered ones, with tier assigned automatically by the platform. Volume commitments from $100 to $500 monthly unlock discounts of 25-52%, and a $5 trial credit lasts 30 days.
Plan
Price
Credits / volume
Free Trial
$5 credit
30-day PAYG access
Pay As You Go
$0 commit
$100/mo spending limit, 0% discount
$200 Commitment
$100/mo
$400 limit, 40% discount
$500 Commitment
$250/mo
$1,000 limit, 52% discount
Enterprise
Custom
Custom commitment + $200 free credit
Credits don't map one-to-one to requests. Each feature stacks a multiplier on top of the base call:
·T1 Simple HTTP: $0.13 / 1K
·T3 Moderate HTTP: $0.44 / 1K
·T5 Advanced HTTP: $1.27 / 1K
·T1 Simple Browser: $1.01 / 1K
·T5 Advanced Browser: $16.08 / 1K (124x T1 HTTP)
·AI extraction (product/article): $0.0004 – $0.0016 each
A few things to watch out for before signing up:
!Auto-tier means you can't predict cost — Zyte assigns each website T1-T5 with no override.
!Cross-modal spread (T1 HTTP → T5 browser) is 124x.
!Tiers reviewed quarterly with only 2 weeks notice.
Per-domain results (20 domains)▾
Domain
Success
Avg
P90
Cost/1K
Structured
amazon.com
100.0%
3.0s
4.5s
$3.50
—
bestbuy.com
70.0%
5.7s
13.2s
$3.50
—
bing.com
100.0%
0.9s
1.5s
$3.50
—
booking.com
90.0%
10.8s
19.9s
$3.50
—
capterra.com
100.0%
7.2s
33.8s
$3.50
—
ebay.com
83.3%
17.6s
41.3s
$3.50
—
g2.com
0.0%
0.0s
0.0s
$3.50
—
github.com
100.0%
2.6s
4.4s
$3.50
—
google.com
93.3%
18.0s
42.5s
$3.50
—
idealista.com
90.0%
20.8s
57.7s
$3.50
—
indeed.com
76.7%
26.2s
46.9s
$3.50
—
instagram.com
100.0%
3.1s
7.1s
$3.50
—
linkedin.com
0.0%
0.0s
0.0s
$3.50
—
reddit.com
96.7%
6.5s
31.1s
$3.50
—
tripadvisor.com
93.3%
31.0s
49.4s
$3.50
—
trustpilot.com
96.7%
12.2s
13.7s
$3.50
—
walmart.com
100.0%
6.2s
19.6s
$3.50
—
x.com
96.7%
14.7s
34.7s
$3.50
—
youtube.com
100.0%
4.0s
31.0s
$3.50
—
zillow.com
73.3%
38.9s
60.0s
$3.50
—
#11
ZenRows
Success rate
81.53%
Avg response
11.0s
P90 latency
18.2s
Cost / 1K
$4.13
Free tier
No
Starting plan
$69/mo
AI implementation
Intermediate
Structured data
5 / 20
ZenRows packages a Universal Scraper API, headless Scraping Browser, 55M-IP residential proxy network across 190+ countries, and vertical scrapers for Amazon, Walmart, Zillow, Idealista, and Google. Its Adaptive Stealth Mode auto-escalates only when needed, billing solely on successful requests.
Pros
+Adaptive Stealth Mode auto-picks cheapest viable config and bills only on successful requests.
+Shared dollar balance spans Universal API, Scraping Browser, Residential Proxies, and Scraper APIs alike.
+Free autoparse extracts structured JSON from e-commerce, news, jobs, and real estate pages.
Cons
−Entry pricing starts at $69.99/month with no Pay-As-You-Go option currently available.
−Developer plan caps premium-proxy + JS-rendered requests at only 10K per month.
−Credit multipliers stack aggressively: 5x for JS, 10x for premium proxy, 25x combined.
Pricing
Plans run from $69.99/month Developer (250K basic requests, 20 concurrency) through $2,999.99 Business 3K, plus custom Enterprise. Credits multiply 5x for JS rendering, 10x for premium proxy, and 25x combined. Top-ups add 15% usage for 15% price, and yearly billing saves 10%.
Plan
Price
Credits / volume
Developer
$69.99/mo
250K basic / 10K premium+JS
Startup
$129.99/mo
1M basic / 40K premium+JS
Business
$299.99/mo
3M basic / 120K premium+JS
Business 3K
$2,999.99/mo
37.5M basic / 1.5M premium+JS
Enterprise
Custom
Shared balance + SLA + dedicated AM
Credits don't map one-to-one to requests. Each feature stacks a multiplier on top of the base call:
·Basic request: 1x credits
·JS rendering only: 5x
·Premium proxy only: 10x
·JS rendering + premium proxy: 25x
A few things to watch out for before signing up:
!No pay-as-you-go option — only monthly subscriptions.
!Developer plan caps premium+JS at just 10K requests per month.
!Geo-targeting is country-level only; no city or state targeting.
Per-domain results (20 domains)▾
Domain
Success
Avg
P90
Cost/1K
Structured
amazon.com
74.0%
1.9s
2.8s
$0.28
✓
bestbuy.com
0.0%
0.0s
0.0s
$0.00
—
bing.com
100.0%
5.6s
8.3s
$7.00
—
booking.com
86.7%
8.3s
12.5s
$7.00
—
capterra.com
100.0%
7.7s
11.5s
$1.40
—
ebay.com
66.7%
38.3s
83.2s
$7.00
—
g2.com
80.0%
18.2s
27.3s
$7.00
—
github.com
100.0%
0.9s
1.3s
$0.28
—
google.com
100.0%
13.1s
19.6s
$7.00
✓
idealista.com
96.7%
12.0s
18.0s
$7.00
✓
indeed.com
100.0%
9.3s
13.9s
$7.00
—
instagram.com
0.0%
0.0s
0.0s
$0.00
—
linkedin.com
100.0%
1.7s
2.5s
$0.28
—
reddit.com
100.0%
7.2s
10.8s
$7.00
—
tripadvisor.com
96.7%
37.7s
56.5s
$7.00
—
trustpilot.com
96.7%
36.0s
60.8s
$7.00
—
walmart.com
33.3%
7.6s
12.1s
$2.80
✓
x.com
100.0%
0.8s
1.2s
$0.28
—
youtube.com
100.0%
1.1s
1.6s
$0.28
—
zillow.com
100.0%
13.1s
19.7s
$7.00
✓
#12
ScrapingDog
Success rate
80.55%
Avg response
6.2s
P90 latency
9.5s
Cost / 1K
$2.16
Free tier
Yes
Starting plan
$40/mo
AI implementation
Intermediate
Structured data
11 / 20
ScrapingDog is a budget-tilted scraping API that bundles proxy rotation, headless Chrome, and a sprawling catalog of dedicated endpoints behind one key. It markets itself on breadth (Google, Amazon, LinkedIn, YouTube, X, Walmart, eBay, Indeed, Zillow) and low entry pricing rather than raw unblocking horsepower.
Pros
+Entry tier starts at $40/month for 200K credits, undercutting most rivals on cost-per-request math.
+Most dedicated endpoints (Amazon, Indeed, Yelp, YouTube Transcript) cost just 1 credit per successful request.
+Broad endpoint catalog spans SERPs, social, e-commerce, jobs, finance, and travel under a single API key.
Cons
−The generic /scrape endpoint underperforms domain-specific scrapers, forcing users to dig through docs for the right URL.
−Real estate and jobs coverage is uneven, with Zillow priced at 5 credits and Indeed reliability lagging dedicated rivals.
−Signup lacks GitHub or social OAuth options, slowing onboarding compared with developer-first competitors.
Pricing
Pricing spans 28 monthly tiers from $40 LITE (200K credits, 5 concurrency) up to $30,000 NOVA PRO (1.1B credits). Annual billing trims roughly 17 percent, and only successful 200/404 responses are charged. A 1,000-credit free trial requires no card, but the free plan hard-caps at 1,000 requests per month.
Plan
Price
Credits / volume
Free Trial
$0
1,000 credits (one-time)
LITE
$40/mo
200K credits + 5 concurrency
STANDARD
$90/mo
1M credits + 50 concurrency
PRO
$200/mo
3M credits + 100 concurrency
NOVA PRO
$30,000/mo
1.1B credits + 2,200 concurrency
Credits don't map one-to-one to requests. Each feature stacks a multiplier on top of the base call:
!JS rendering is ON by default — silently costs 5x base credits.
!LinkedIn profiles and Amazon Reviews cost 100 credits each.
!Free plan hard-caps at 1K credits/month with a 403 on overage.
Per-domain results (20 domains)▾
Domain
Success
Avg
P90
Cost/1K
Structured
amazon.com
100.0%
3.6s
8.3s
$0.20
✓
bestbuy.com
53.0%
12.4s
19.1s
$0.20
—
bing.com
100.0%
5.3s
7.2s
$0.20
✓
booking.com
86.7%
8.3s
12.4s
$5.00
—
capterra.com
100.0%
5.6s
9.1s
$0.20
—
ebay.com
100.0%
2.8s
3.4s
$1.00
✓
g2.com
0.0%
0.0s
0.0s
$0.00
—
github.com
100.0%
5.9s
7.6s
$0.20
—
google.com
100.0%
1.5s
2.2s
$1.00
✓
idealista.com
31.0%
11.7s
15.5s
$5.00
—
indeed.com
68.0%
6.4s
17.2s
$0.20
✓
instagram.com
100.0%
3.7s
5.7s
$1.00
✓
linkedin.com
100.0%
3.3s
4.9s
$10.00
✓
reddit.com
93.3%
11.7s
17.5s
$5.00
—
tripadvisor.com
24.0%
7.3s
8.7s
$5.00
—
trustpilot.com
99.0%
22.9s
29.6s
$5.00
—
walmart.com
100.0%
4.1s
6.1s
$1.00
✓
x.com
100.0%
1.5s
3.0s
$1.00
✓
youtube.com
100.0%
1.6s
3.1s
$1.00
✓
zillow.com
56.0%
3.9s
10.1s
$1.00
✓
#13
ScraperAPI
Success rate
75.47%
Avg response
13.2s
P90 latency
20.2s
Cost / 1K
$9.63
Free tier
Yes
Starting plan
$49/mo
AI implementation
Intermediate
Structured data
4 / 20
ScraperAPI is a credit-based scraping API founded in 2018, abstracting proxy rotation, CAPTCHA handling, and JavaScript rendering behind a single endpoint. The platform pairs general scraping with four structured endpoints for Amazon, eBay, Google, and Walmart, plus a no-code DataPipeline and async batch jobs supporting up to 50,000 URLs per submission.
Pros
+Per-successful-request credit billing means only HTTP 200 and 404 responses get charged, simplifying cost forecasting versus bandwidth.
+Four dedicated structured endpoints for Amazon, eBay, Google, and Walmart return pre-parsed JSON without writing or maintaining selectors.
+A pre-flight urlcost endpoint and max_cost parameter let teams cap credit spend per request before firing the job.
Cons
−Credit multipliers span 25x between tiers, with ultra_premium plus render hitting 75 credits and forcing careful per-domain budgeting.
−Hobby and Startup plans restrict geotargeting to US and EU regions, so country-level routing requires the $299 Business tier.
−x.com and twitter.com sit on the ToS denylist and return zero successful responses, with Zillow and Indeed weaker at default settings.
Pricing
Paid plans start at $49/month Hobby (100,000 credits, 20 threads, US/EU geo only) and scale through Startup ($149), Business ($299, full country geo), and Scaling ($475). A 7-day trial offers 5,000 credits without a card, and a 1,000-credit/month permanent free tier remains available.
Plan
Price
Credits / volume
Free
$0
1,000 credits/month
Hobby
$49/mo
100K credits + 20 threads, US/EU geo
Startup
$149/mo
1M credits + 50 threads, US/EU geo
Business
$299/mo
3M credits + 100 threads, full geo
Scaling
$475/mo
5M credits + 200 threads, full geo
Credits don't map one-to-one to requests. Each feature stacks a multiplier on top of the base call:
·Standard request: 1x credits
·Premium proxy: 10x
·Premium + render: 25x
·Ultra premium: 30x
·Ultra premium + render: 75x
A few things to watch out for before signing up:
!x.com / twitter.com on ToS denylist — blocked at API level on every tier.
!Hobby and Startup restricted to US/EU geo; country geo unlocks at $299.
!75x credit range forces per-domain budgeting to avoid silent quota burn.
Per-domain results (20 domains)▾
Domain
Success
Avg
P90
Cost/1K
Structured
amazon.com
100.0%
7.3s
10.9s
$2.45
✓
bestbuy.com
100.0%
1.2s
2.1s
$36.75
—
bing.com
100.0%
1.4s
2.1s
$26.95
—
booking.com
92.0%
36.2s
49.7s
$2.45
—
capterra.com
100.0%
0.5s
0.8s
$4.90
—
ebay.com
99.0%
5.9s
8.9s
$0.49
✓
g2.com
93.3%
6.7s
37.1s
$36.75
—
github.com
100.0%
2.6s
3.9s
$0.49
—
google.com
97.0%
5.5s
8.3s
$12.25
✓
idealista.com
100.0%
1.9s
2.9s
$0.00
—
indeed.com
60.0%
3.5s
5.3s
$4.90
—
instagram.com
0.0%
0.0s
0.0s
$0.00
—
linkedin.com
100.0%
3.6s
5.4s
$14.70
—
reddit.com
51.0%
50.0s
74.9s
$19.60
—
tripadvisor.com
64.0%
47.9s
56.2s
$12.25
—
trustpilot.com
2.0%
54.8s
82.1s
$12.25
—
walmart.com
100.0%
15.6s
23.3s
$0.00
✓
x.com
0.0%
0.0s
0.0s
$0.00
—
youtube.com
100.0%
5.8s
8.6s
$4.90
—
zillow.com
51.0%
13.9s
20.8s
$0.49
—
#14
Firecrawl
Success rate
66.50%
Avg response
3.2s
P90 latency
6.4s
Cost / 1K
$12.53
Free tier
Yes
Starting plan
$16/mo
AI implementation
Easy
Structured data
0 / 20
Firecrawl is an AI-focused web data API that converts pages into clean, LLM-ready markdown or structured JSON via endpoints like /v2/scrape, /crawl, /map, and /agent. Open source under AGPL-3.0, backed by Y Combinator, and popular with AI engineers building RAG pipelines and autonomous agents.
Pros
+Returns clean, LLM-ready markdown out of the box, removing the usual HTML-to-text cleanup step entirely.
+Open-source SDKs in Python, Node, Java, and Elixir, plus an MCP server and CLI for AI tooling.
+Fast latency on cooperative sites and a /map endpoint that returns full URL graphs for one credit.
Cons
−Hard edge-level block-list refuses Instagram, LinkedIn, and Reddit requests with 403 policy errors before any fetch.
−Google searches fail across every tier, returning reCAPTCHA challenges and 429 rate-limit responses on each attempt.
−Once JSON extraction or enhanced proxy modifiers are enabled, per-1K-page cost ranks highest in the benchmark category.
Pricing
Subscription-only tiers run from a free 500-credit trial through Hobby ($16/mo, 3K credits), Standard ($83/mo, 100K), Growth ($333/mo, 500K), and Scale ($599/mo, 1M). There is no pay-as-you-go option, plan credits never roll over, and JSON or enhanced-proxy modifiers stack additional credits per page.
Plan
Price
Credits / volume
Free
$0
500 credits one-time trial
Hobby
$16/mo
3K credits (billed yearly)
Standard
$83/mo
100K credits (billed yearly)
Growth
$333/mo
500K credits (billed yearly)
Scale
$599/mo
1M credits (billed yearly)
Credits don't map one-to-one to requests. Each feature stacks a multiplier on top of the base call:
!No pay-as-you-go — subscriptions only, and credits never roll over.
!FIRE-1 agent bills even on failed requests, rate-limited to 10/min.
!Enhanced proxy is US + Denmark only; auto-recharge capped at 4 packs/mo.
Per-domain results (20 domains)▾
Domain
Success
Avg
P90
Cost/1K
Structured
amazon.com
53.3%
6.3s
22.6s
$5.33
—
bestbuy.com
33.3%
14.2s
23.0s
$26.65
—
bing.com
100.0%
0.4s
0.5s
$5.33
—
booking.com
90.0%
4.1s
6.5s
$5.33
—
capterra.com
96.7%
2.0s
2.5s
$5.33
—
ebay.com
100.0%
0.5s
0.6s
$26.65
—
g2.com
83.3%
11.6s
19.1s
$26.65
—
github.com
100.0%
2.6s
5.1s
$5.33
—
google.com
0.0%
0.0s
0.0s
$0.00
—
idealista.com
100.0%
0.4s
0.5s
$26.65
—
indeed.com
40.0%
3.4s
14.9s
$26.65
—
instagram.com
0.0%
0.0s
0.0s
$0.00
—
linkedin.com
0.0%
0.0s
0.0s
$0.00
—
reddit.com
0.0%
0.0s
0.0s
$0.00
—
tripadvisor.com
100.0%
0.4s
0.5s
$26.65
—
trustpilot.com
100.0%
0.4s
0.6s
$26.65
—
walmart.com
100.0%
0.4s
0.5s
$26.65
—
x.com
100.0%
5.9s
8.8s
$0.00
—
youtube.com
100.0%
4.1s
9.0s
$5.33
—
zillow.com
33.3%
7.2s
12.4s
$5.33
—
#15
ScrapingAnt
Success rate
56.20%
Avg response
23.0s
P90 latency
38.4s
Cost / 1K
$1.38
Free tier
Yes
Starting plan
$19/mo
AI implementation
Intermediate
Structured data
0 / 20
ScrapingAnt is a credit-based scraping API with headless Chrome rendering, rotating datacenter and residential proxies, webhook async, persistent sessions, and custom JS evaluation up to 60 seconds. A generous 10,000-credit free tier and $19/month Enthusiast plan make entry cheap, but credit multipliers on protected targets add up fast.
Pros
+Free forever tier offers 10,000 credits monthly with no card, no trial clock, and unlimited concurrency on paid plans.
+Default headless Chrome with custom JS evaluation, screenshot capture, persistent sessions, and webhook async covers most rendering workflows out of the box.
+Hosted MCP server, n8n nodes, Python and JavaScript SDKs make integration into AI agents and no-code stacks straightforward.
Cons
−Datacenter response time averaged 33+ seconds in our benchmark, well behind providers that finish similar pages in under 10 seconds.
−Residential proxy costs 25 credits per request and 125 with JS rendering, making protected targets 5x to 12x more expensive than datacenter.
−Confirmed 423 anti-bot blocks on g2.com, linkedin.com, tripadvisor.com, trustpilot.com, and idealista, plus hard failures on X, Google, and Indeed.
Pricing
Plans run from a free 10,000-credit tier to Enthusiast at $19 for 100K credits, Startup at $49 for 500K, and Business at $249 for 3M. Credit multipliers matter: residential plus JS rendering burns 125 credits per call, so a nominal 100K plan can deliver as few as 800 protected requests.
Plan
Price
Credits / volume
Free
$0
10K credits
Enthusiast
$19/mo
100K credits
Startup
$49/mo
500K credits
Business
$249/mo
3M credits
Credits don't map one-to-one to requests. Each feature stacks a multiplier on top of the base call:
·Datacenter proxy: 1 credit
·JS render (browser + datacenter): 10 credits
·Residential proxy: 25 credits
·Residential + JS render: 125 credits
A few things to watch out for before signing up:
!browser=true is default — JS render silently costs 10x credits per call.
!423 anti-bot errors surface on hard targets (Google SERP, fingerprinted sites).
!No structured-data endpoints — relies on AI extractor for parsed output.
Per-domain results (20 domains)▾
Domain
Success
Avg
P90
Cost/1K
Structured
amazon.com
96.0%
17.8s
56.6s
$0.19
—
bestbuy.com
38.0%
13.3s
57.7s
$1.90
—
bing.com
100.0%
39.9s
46.8s
$0.19
—
booking.com
99.0%
56.2s
84.3s
$0.19
—
capterra.com
64.0%
57.9s
86.8s
$0.19
—
ebay.com
19.0%
21.3s
56.2s
$0.19
—
g2.com
0.0%
0.0s
0.0s
$0.00
—
github.com
100.0%
5.2s
11.7s
$0.19
—
google.com
42.0%
31.9s
48.7s
$23.75
—
idealista.com
0.0%
0.0s
0.0s
$0.00
—
indeed.com
54.0%
56.3s
60.6s
$0.19
—
instagram.com
100.0%
12.4s
18.6s
$0.00
—
linkedin.com
0.0%
0.0s
0.0s
$0.00
—
reddit.com
100.0%
9.3s
14.0s
$0.00
—
tripadvisor.com
0.0%
0.0s
0.0s
$0.00
—
trustpilot.com
0.0%
0.0s
0.0s
$0.00
—
walmart.com
100.0%
37.3s
56.0s
$0.00
—
x.com
30.0%
5.8s
28.1s
$0.19
—
youtube.com
91.0%
38.5s
57.3s
$0.19
—
zillow.com
91.0%
56.8s
85.2s
$0.19
—
#16
SerpApi
Success rate
10.00%
Avg response
0.8s
P90 latency
1.1s
Cost / 1K
$25.00
Free tier
No
Starting plan
$25/mo
AI implementation
Easy
Structured data
8 / 20
SerpApi is a SERP-only API returning parsed JSON for 50+ search engines, including Google verticals (News, Shopping, Maps, Flights, Hotels, Trends, Images) and select marketplaces like Amazon, eBay, Walmart, YouTube, and Tripadvisor. It is not a general-purpose web scraper, and 18 of 20 domains in our benchmark have no matching SerpApi engine.
Pros
+Structured JSON output across 50+ engines removes HTML parsing work for Google, Bing, Yandex, Baidu, and Naver.
+Dedicated endpoints for Google News, Shopping, Maps, Flights, Hotels, Trends, and Images cover most SERP feature blocks.
+Cached repeat queries within a 1-hour window are free and do not decrement the monthly search quota.
Cons
−SERP-only scope means no product pages, profiles, or arbitrary URLs outside the supported engine list.
−Starter pricing of $25 per 1,000 searches runs roughly 10x more than generalist scrapers for equivalent crawl volume.
−No shared schema across engines forces consumers to branch parsing logic for every distinct SerpApi endpoint.
Pricing
Pricing starts at $25/month for 1,000 searches on Starter, scaling through Developer ($75), Production ($150), and Big Data ($275 for 30,000 searches). Every successful call counts as one search regardless of engine, while cached, errored, and failed requests are not billed. Ludicrous Speed costs 2x per search.
Plan
Price
Credits / volume
Starter
$25/mo
1,000 searches
Developer
$75/mo
5,000 searches
Production
$150/mo
15,000 searches
Big Data
$275/mo
30,000 searches
Credits don't map one-to-one to requests. Each feature stacks a multiplier on top of the base call: