SaaS Ranking

Our crawler

We identify ourselves. If you would rather we did not fetch your site, say so and we will stop.

How to recognise us

SaaSRankingBot/1.0 (+https://saas-ranking.com/bot)

What we fetch

A short list of well-known addresses on your own domain: your pricing page, your legal pages, your security or trust page, your status page, and /.well-known/security.txt. We also load your front page once in a browser to count third-party requests before any interaction.

We do not crawl your whole site, we do not log in, we do not accept NDAs and we do not submit forms. That is deliberate: the thing we measure is what you show to someone who has not talked to your sales team yet.

How often

At most one request every 2 seconds to the same host, and we honour a longer Crawl-delay if your robots.txt asks for one. If your server answers 429, we back off and try once more, later.

How to exclude us

User-agent: SaaSRankingBot
Disallow: /

If you do that, we will not rank you at all. You will not get a bad score for it: your entry says that your robots.txt excludes us. The same applies if your firewall blocks us, which we cannot always tell apart from a real absence, so we treat it as “not measured”.

Something is wrong

If we report a document as not found and it exists, send us the address. The next run picks it up and the page changes by itself.