ArcheryTrailBot, the ArcheryTrail crawler
Every night, ArcheryTrailBot reads the public calendars of French regional and departmental archery committees to show competitions on archerytrail.com. Every competition links back to its official source.
Identification
User agent: ArcheryTrailBot/0.1 (+https://www.archerytrail.com/bot). IP addresses: 179.237.121.234, 2001:1600:18:20c::328 (current list: /archerytrailbot-ips.txt). Their reverse DNS points to bot.archerytrail.com, which resolves back to these addresses. Any request claiming to be ArcheryTrailBot from another address is not ours.
How it behaves
- One visit per night, between 1 am and 7 am (Paris time).
- At most one request per second per site, with random jitter, and slower if robots.txt asks for it (Crawl-delay).
- robots.txt is read before any page and obeyed: a single disallow is enough for a page never to be read.
- As soon as an anti-bot challenge appears, the crawler stops on that site for the night. It never works around it: no disguised browser, no proxy, no borrowed identity.
- It only reads calendar pages and published competition notices. Notices are archived only to be served when the official site is unavailable.
Blocking or limiting it
Add to your robots.txt: User-agent: ArcheryTrailBot then Disallow: / (applied from the next night), or write to us.
User-agent: ArcheryTrailBot Disallow: /
Contact
contact@archerytrail.com