Cookie Consent by Free Privacy Policy Generator

Cost-Effective and Fast SERP Crawling API: Recommendations From The Community

Go to the Best Of the SEO Community.

Josh Tominus
Josh Tominus
Oct 22, 2024, 9:46 AM
Hey everyone! Does anyone have any recommendations for a SERP crawling API?
 
As anyone is - looking for a mix of cost effective and fast.
Forwarded thread from another channel:
JC
JC
Oct 22, 2024, 9:54 AM
DataForSEO is my go to
Ryan Siddle
Ryan Siddle
Oct 22, 2024, 10:56 AM
SERPAPI and ValueSERP has never been an issue
Joe Pawlikowski
Joe Pawlikowski
Oct 22, 2024, 11:06 AM
SerpApi has been very responsive when issues have arisen
Richard Gargan
Richard Gargan
Oct 22, 2024, 11:32 AM
I like ScrapingBee <https://www.scrapingbee.com/features/google/>
MIchael Buckbee
MIchael Buckbee
Oct 23, 2024, 6:16 AM
I keep a list of these with normalized prices if it's helpful - some may be out of date but they're generally correct.
Richard Gargan
Richard Gargan
Oct 23, 2024, 6:38 AM
Ooof looks like I may be switching from ScrapingBee!
 
When I was doing research on this, some of the others I was getting blocked when downloading the resulting HTML, eg if <http://xyz.com/result|xyz.com/result> was position 1 Scraping Bee was good at downloading <http://xyz.com/result|xyz.com/result>’s HTML and not getting blocked by cloudflare etc
MIchael Buckbee
MIchael Buckbee
Oct 23, 2024, 6:40 AM
I have a separate list of "Proxies" - ScrapingBee is a bit of hybrid between pure serp api and a proxy service.
Richard Gargan
Richard Gargan
Oct 23, 2024, 6:45 AM
If you could post that list too, I’d be very grateful ???? Yes I use both, would be prepared to use 2 different APIs if it’s significantly cheaper
MIchael Buckbee
MIchael Buckbee
Oct 23, 2024, 6:48 AM
Here it is, but it's wildly incomplete as it turned out proxy services are a lot less commodities -
Richard Gargan
Richard Gargan
Oct 23, 2024, 6:50 AM
Thanks that’s great
Josh Tominus
Josh Tominus
Oct 24, 2024, 12:06 PM
@mike647 This is AMAZING, thank you!!

Channels

  • agency (3)
  • ai-for-seo (11)
  • ai-llms (24)
  • analytics (13)
  • biz-of-seo (4)
  • career (4)
  • content (15)
  • cro (4)
  • data-viz-reporting (4)
  • datascience (2)
  • ecommerce (3)
  • events (1)
  • freelance (2)
  • general-seo (21)
  • in-house (2)
  • local-seo (12)
  • local-seo,biz-of-seo (1)
  • lounge (1)
  • reading-list-resources (3)
  • search-console (11)
  • shameless-plug (1)
  • technical-seo (37)
  • tools (1)


    • Join The Community

    The SEO Community is a free organization, with private Slack group and events, for those interested in search and AI optimization to learn, discuss, and meet others in the industry.

    Powered by MODX

    Resources

    The Community Story SEO Articles SEO Jobs SEO Conferences Top SEO Discussions Newsletter Free Tools Learn Claude Code

    The SEO Community © 2026

    Shop Merch Code of Conduct Partnerships Sitemap Update cookies preferences Terms of Service Privacy Policy