Crawler

Trilarbot

Trilarbot is the crawler behind Trilar, an SEO and GEO audit tool. It crawls websites on behalf of their owners or the agencies that look after them.

User agents

Desktop

Mozilla/5.0 (compatible; Trilarbot/1.0; +https://trilar.io/bot/) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/141.0.0.0 Safari/537.36

Mobile

Mozilla/5.0 (Linux; Android 14; Pixel 8) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/141.0.0.0 Mobile Safari/537.36 (compatible; Trilarbot/1.0; +https://trilar.io/bot/)

Who starts a crawl

Crawls are started by Trilar customers who run or manage the website, for example to audit it before a relaunch. Trilarbot does not crawl the web on its own.

robots.txt

By default a crawl applies the robots.txt rules for Googlebot, so customers see their site the way Google sees it. A customer can choose a different user agent for the rules, or allow specific paths for an audit of their own site.

Crawl speed

Each crawl has a request limit, and Trilarbot slows down automatically when the server answers slowly or with errors such as 429 or 503.

Questions or exclusion

If Trilarbot visits a site it should not, write to us with the domain and we will exclude it. If you want to allow Trilarbot through your firewall or bot protection, allow requests whose user agent contains "Trilarbot"; we tell you the IP addresses of our crawlers on request.

support@trilar.io · +41 76 77 99 820