SaasklyBot: what our crawler reads, and why

Last updated: 15 October 2026

If SaasklyBot has appeared in your server logs, this page says what it was doing and how to stop it if you would rather it did not.

What it reads

Public pages only: the pricing page and the plan or feature-comparison page of every product Saaskly reviews. For a product that a vendor has asked us to watch alongside its own, the product, changelog, integrations and terms pages too. Never anything behind a login, never a form, never a search, and never Trustpilot.

How often

A product's pricing and plan pages are read about once a fortnight. Products in a watched set are read weekly. The crawler makes at most one request to a site every few seconds and usually far fewer; a typical site sees a handful of requests a month.

Why

Two reasons. Prices and plans change, and every Saaskly profile promises the price you will actually pay, so the "prices checked" date on a profile is kept honest by reading the source. And vendors want to know what changed on their competitors' public pages; the record we keep answers that from pages anyone can read, and the vendor whose page changed can read the same page.

How it identifies itself

Its user agent is SaasklyBot/1.0 (+https://saaskly.com/bot). It honours robots.txt: a Disallow for SaasklyBot, or for all agents, stops it, and it does not try to get round one. A small number of pages only render in a browser; those we read through Oxylabs' rendering service, and that request carries Oxylabs' agent string rather than ours.

What we keep and what we publish

We keep the text of the pages we read, so that the next read can be compared with the last. We publish short before-and-after excerpts of a change, the kind of change it was, and the page address. We do not republish pages.

To exclude your site

Add Disallow: / under User-agent: SaasklyBot in your robots.txt, or email help@saaskly.com with the domain. The crawler stops at its next scheduled read and the exclusion is recorded.

Suppliers

Rendered reads use Oxylabs, a Lithuanian company in the Tesonet group. Tesonet is linked to Nord Security, the company behind NordVPN, a product we review and carry an affiliate link for. Buying that service has no effect on NordVPN's score or rank, like every relationship listed on the Advertise page.