Screaming Frog SEO Spider
The technical-SEO crawler everyone actually uses — a UK desktop tool at £199 a year, now with LLM content analysis and an official MCP server.
How we testScreaming Frog is not a suite; it is the de-facto site crawler, sold by a Henley-on-Thames company as a £199-per-user annual licence (free up to 500 URLs). It crawls as far as your machine's memory allows, renders JavaScript, pulls Lighthouse and PageSpeed data, and integrates Google Search Console, GA, Ahrefs, Majestic and Moz. Version 22 added LLM-powered semantic similarity, duplicate and off-topic detection with custom prompts to OpenAI, Gemini or Anthropic; version 24 (May 2026) shipped an official MCP server so you can run, analyse and export crawls from Claude.
It has no keyword research, rank tracking, backlink index or AI-visibility tracking, and no REST API — it's a crawler, and the best one. A companion Log File Analyser is £99 a year. Trustpilot is sparse (4.2/5, 14 reviews).
Pros
- +Unbeatable value for technical audits
- +UK vendor with GBP invoicing
- +Official MCP server (v24) and LLM-powered content analysis
Cons
- −Desktop-bound — limited by your RAM and hardware
- −No keyword, backlink, rank-tracking or AI-visibility data
- −Free tier too small for real sites
Pricing
Minimum commitment: £199 — £199/yr for the entry licence. The least you can spend before walking away; excludes numbers, minutes and add-ons.
SEO Spider licence
£199/yr · annual commitment
Month-to-month: not published
- ✓Per user per year; volume discounts to £169 at 20+; free edition capped at 500 URLs
Log File Analyser
£99/yr · annual commitment
Month-to-month: not published
- ✓Per user per year
Specifications
| Rating | 4.1 |
| Month-to-month (entry plan) | Annual only |
| Annual commit, per month | £199/yr |
| Minimum commitment* | £199 |
| Site audit | ✓ |
| API included | No |
| MCP server | ✓ |
| Trustpilot (reviews) | 4.2 (14) |
| Commitment for annual rate (months) | 12 |
*How we calculate minimum commitment. Headline per-user prices hide the real cost of trying a platform. Total cost of ownership is licence × seats × term, plus usage, add-ons, setup fees and any early-exit charges. Our "minimum commitment" figure is the floor of that: the entry plan's committed rate × the minimum seats the vendor will sell × the months you must commit to (one month at the month-to-month rate where there is no commitment; the licence price where it is sold per year). It deliberately excludes usage, add-ons and prerequisite licences, so your real first bill will be higher — but never lower than this.
Researched and drafted with AI assistance; reviewed and approved by Tim Meredith. How we use AI