AllTruckDataBot
How do I make it stop?
Email bot@alltruckdata.com with your domain name. We put it on our blocklist the same day, and if you ask, we remove the facts we took from it.
Or add this to your robots.txt — the bot reads it before it requests anything from your site:
User-agent: AllTruckDataBot
Disallow: /
Who is it?
The fetcher of AllTruckData, a free lorry specification site. It identifies itself on every request as:
AllTruckDataBot/0.1 (+https://alltruckdata.com/bot)
What does it take, and how often?
- Published open data files and their documentation, for the facts in them. We never republish text, images or documents.
- At most one request per second to a host, or slower if your robots.txt sets a Crawl-delay.
When does it stop on its own?
- On a 401, 403, 407, 418 or 451 response, or a bot challenge: that host is refused for the rest of the run.
- Where robots.txt disallows it — and if robots.txt cannot be read, it treats the whole site as disallowed.
A block is a final answer. It does not retry, and never tries another route: no proxy, no other user agent, no other network.