Screaming Frog SEO Spider is the desktop crawler most technical SEO work runs through. You point it at a domain, it crawls the way a search engine would, and it returns every status code, redirect chain, duplicate title, missing canonical and broken link it finds. It has been the category standard for years and nothing has meaningfully displaced it.
There is one thing about it that most reviews get wrong, and it changes the buying decision entirely: the free version is far less limited than its reputation suggests.
Executive Answer
If your site is under 500 URLs, the free version may be all you ever need — and it includes considerably more than older reviews claim. If your site is larger, or you audit client sites, the $279/year licence is one of the easiest purchases in SEO tooling to justify.
It is the wrong tool if you want polished client-facing reports or automated ongoing monitoring. Screaming Frog gives you data, not dashboards.
Quick Verdict
| Category | Verdict |
|---|---|
| Best for | SEO practitioners, agencies, developers auditing site health, anyone cleaning up after a migration |
| Not ideal for | Beginners learning SEO, anyone needing client-ready reports or scheduled monitoring dashboards |
| Biggest strength | Depth and speed — no crawl credits, no queue, no per-project limits |
| Biggest weakness | Dense interface that assumes you already know the concepts |
| Price | Free up to 500 URLs per crawl; $279/year for unlimited |
| Runs on | Windows, macOS and Ubuntu — your machine, not a vendor’s |
| Overall | Essential for technical SEO. Try the free version first — it may be enough |
The Free Version Is Better Than You’ve Been Told
Here’s the correction. Plenty of reviews — and a lot of accumulated SEO folklore — state that JavaScript rendering, integrations and advanced features require the paid licence. According to Screaming Frog’s own current pricing page, that is no longer the distinction. The free and paid versions carry substantially the same feature set, including JavaScript rendering, XML sitemap generation, structured data validation, Google Analytics integration and accessibility auditing.
The primary difference is the 500-URL crawl cap.
That reframes the decision completely. The question is not “can I afford the features?” but simply “is my site bigger than 500 URLs?” For a small business site, a portfolio, or a young blog, the answer is often no — and the free version does the whole job.
If you’ve previously dismissed the free version based on an older review, check the current feature comparison yourself before assuming you need to pay.
Do You Actually Need the Licence?
Free or paid licence?
The free version caps crawls at 500 URLs. Everything else follows from your site size.
Method: compares your URL count against the free version’s published 500-URL crawl limit, and divides the $279 annual licence by the number of audits you run to show cost per audit. Licence price is Screaming Frog’s published figure as of August 2026; bulk discounts apply from five licences. Assumes one licence.
The cost-per-audit figure is the one that settles it for professionals. Run a crawl monthly and the licence costs a little over $20 per audit — less than the time you'd spend assembling the same data by hand, by a wide margin.
Desktop, Not Cloud — and That's Deliberate
Screaming Frog runs on your own machine. Crawl speed depends on your hardware and connection rather than a vendor's queue, and large crawls benefit from allocating more memory and switching to database storage mode.
The advantage is that you're not paying per crawl or waiting for a scheduled job. You can re-crawl a section twenty times while debugging a redirect problem without thinking about credits. Cloud crawlers charge for that behaviour; Screaming Frog doesn't care.
The trade-off is that a genuinely large crawl — hundreds of thousands of URLs — will tax an ordinary laptop. Plan for RAM, and switch to database storage mode before starting rather than after it stalls.
What You'd Actually Use It For
- Finding broken links and redirect chains — the fastest way to clean up after a migration, and the most common reason people install it
- Auditing titles, descriptions and headings at scale — duplicates and missing values surface immediately
- Checking canonicals, hreflang and indexability — the errors that quietly suppress rankings without ever showing as a visible problem
- Validating structured data across the whole site rather than page by page
- Custom extraction with XPath or CSS selectors, which turns it into a general-purpose scraper
- Checking XML sitemaps against what's actually crawlable
- Pulling Analytics and Search Console data into crawl rows, so you can see which broken pages actually had traffic
That last one deserves emphasis. Crawl data alone tells you what's wrong; crawl data joined to traffic data tells you what's worth fixing first. It's the difference between a 400-row to-do list and a prioritised one.
Four Settings Worth Changing First
Screaming Frog ships with sensible defaults, but a handful of settings account for most of the confusion new users hit. Worth knowing before your first serious crawl.
Storage mode. The default keeps the crawl in memory, which is fast but limited by your RAM. For anything large, switch to database storage before you start — changing it mid-crawl means starting again.
JavaScript rendering. Off by default, and that's usually correct: rendering is much slower. But if your site is built on a JavaScript framework, a non-rendered crawl will show you almost nothing and you'll wrongly conclude the site is broken or empty. Turn it on for those sites specifically.
robots.txt handling. By default the crawler respects robots.txt, which mirrors what search engines do. When you're diagnosing why pages aren't being indexed, temporarily ignoring robots.txt reveals what's being blocked — often the answer to the whole question.
Crawl speed. The default rate is polite. On a small shared-hosting site you may still want to slow it further, because a fast crawl can look like a traffic spike and get you rate-limited by your own host. On your own robust server, speeding it up saves real time.
The Learning Curve
The interface is dense — tabs, filters and columns everywhere, with almost no hand-holding. It assumes you already know what a canonical tag is and why a 302 inside a redirect chain is a problem.
For someone learning SEO it's overwhelming, and that's a fair criticism. For someone who knows the concepts it's efficient in a way friendlier tools aren't, precisely because it doesn't hide anything behind a simplified summary.
If you're new: learn the concepts first, then come back. Screaming Frog will teach you nothing about why something matters — it only tells you that it's there.
Where It Falls Short
No Client-Ready Reporting
Output is raw and export-driven. If you need a branded PDF a client can read, you're building it yourself from exports. Cloud crawlers like OnCrawl and Sitebulb invest heavily here, and it's a real reason agencies run both.
No Ongoing Monitoring
Scheduling exists, but this is fundamentally a tool you point at a site when you want an answer, not a service that watches a site and tells you when something breaks. For continuous monitoring you want something cloud-based.
It Only Sees What a Crawler Sees
Screaming Frog reports what a crawler encounters. It cannot tell you what Google actually did with your pages — whether they were indexed, how they ranked, what queries they matched. That's Search Console's job, and neither tool replaces the other.
Screaming Frog vs. the Alternatives
| Screaming Frog | Cloud crawlers (OnCrawl, Sitebulb Cloud) | Google Search Console | |
|---|---|---|---|
| Price | Free to 500 URLs; $279/year | Subscription, often much higher | Free |
| Where it runs | Your machine | Vendor infrastructure | Google's data |
| Crawl limits | Your hardware | Plan credits | Not a crawler |
| Reporting | Raw, export-driven | Polished dashboards | Basic reports |
| Ongoing monitoring | Limited | Core feature | Continuous |
| Tells you what Google did | No | No | Yes |
| Best for | Hands-on auditing | Client reporting, monitoring | Ground truth on indexing |
Why the differences matter: these are complements, not substitutes. Search Console tells you what happened. Screaming Frog tells you why. Cloud crawlers tell your client about it in a format they'll read. Most working SEOs use at least the first two, and agencies usually all three.
Our Rating, and How We Reached It
Based on Screaming Frog's official pricing and feature documentation and aggregated practitioner reports, as of August 2026. No first-hand benchmarking of crawl performance was carried out for this review.
| Criterion | Weight | Assessment |
|---|---|---|
| Depth of technical data | 30% | Excellent — the category benchmark |
| Value for money | 25% | Excellent — generous free tier, low annual licence |
| Speed and absence of limits | 20% | Excellent — no credits, no queues |
| Ease of learning | 15% | Weak — dense and unforgiving for beginners |
| Reporting and presentation | 10% | Weak — raw exports only |
Limitations of this scoring: weights assume a practitioner who already understands technical SEO. Someone learning the field should weight ease of learning far higher and would be better served starting with Search Console and a friendlier auditing tool.
Frequently Asked Questions
Is the free version enough?
For a site under 500 URLs, often yes — and it includes more features than older reviews suggest. Check your URL count first.
What does the paid licence cost?
$279 per year, with discounts on bulk purchases of five or more licences.
Does the free version do JavaScript rendering?
Screaming Frog's current pricing page indicates the free and paid versions share substantially the same features, with the 500-URL crawl cap as the main difference. This contradicts many older reviews, so verify against the current comparison on their site.
Does it replace Google Search Console?
No. Search Console reports what Google actually did with your site; Screaming Frog reports what a crawler finds. You need both.
Will it run on my laptop?
For small and medium sites, comfortably. Large crawls need more RAM and database storage mode enabled.
Can I use it to scrape data?
Yes — custom extraction with XPath or CSS selectors makes it a capable general-purpose scraper, which is a common secondary use.
Should You Use Screaming Frog?
Choose it if:
- You do technical SEO and need crawl data you can actually interrogate
- You're cleaning up after a site migration
- You want unlimited crawls without credits or queues
- You audit client sites and need cost-per-audit to be low
Avoid it if:
- You're new to SEO and don't yet know what the data means
- You need branded, client-ready reports without building them
- You want continuous automated monitoring rather than on-demand audits
Best alternative if:
- You need dashboards and monitoring: OnCrawl or another cloud crawler
- You need indexing and ranking truth: Google Search Console, free
- You're learning: start with Search Console before adding a crawler
Best option for most users:
Start free. Crawl your site, see whether you hit the 500-URL cap, and buy the licence only when you actually do. There's no reason to pay in advance of needing to.
Best option for advanced users:
The paid licence with the Search Console and Analytics integrations configured, so every crawl row carries traffic data. That single setup step converts a list of technical problems into a prioritised work queue, and it's the feature most licence holders underuse.
Bottom line:
Screaming Frog remains the default technical SEO crawler because nothing else offers this depth at this price with no usage limits. The headline finding of this review is that the free version deserves a fresh look — if your site is small, you may not need to pay at all. If it isn't, $279 a year is among the least controversial expenses in the SEO toolkit.
Pricing and feature limits change. Figures cited are current as of August 2026 — verify on Screaming Frog's own pricing page before purchasing.
Disclosure: some links on this page may be affiliate links. If you purchase through them we may earn a commission at no extra cost to you. This does not affect our editorial recommendations.
Compare with a popular alternative
Free to 500 URLs; $279/year
Stronger at: Unmatched crawl depth with no credits, queues or per-project limits
Main limitation: Raw exports only u2014 no client-ready reporting or ongoing monitoring
Subscription
Stronger at: Cloud crawling with polished dashboards and continuous monitoring
Main limitation: Crawls are metered by plan credits, and it costs considerably more
Alternatives worth comparing
