Headless browsers and testing tools
Headless browsers and page-testing tools load your pages the way a browser does, so they can run your scripts. Vireo recognises them by name in the user agent and keeps them out of your numbers.
8 known bots from 6 operators.
| Bot | Operator | Type |
|---|---|---|
| ApacheBench | The Apache Software Foundation | Benchmark |
| Elastic Synthetics | Elasticsearch B.V. | Site Monitor |
| FontRadar | EMDASH SAS | Crawler |
| GTmetrix | Carbon60 Operating Co. Ltd. | Crawler |
| Lighthouse | Lighthouse | Site Monitor |
| Phantomas | Not known | Site Monitor |
| WebPageTest | Not known | Site Monitor |
| WordPress.com mShots | Wordpress.org | Service Agent |
Names, operators and types from Matomo Device Detector (LGPL-3.0) and ai.robots.txt (MIT). Category from running Vireo Analytics' bot filter on each bot's user agent. About this data.
Other categories
AI crawlers
Training crawlers, AI search indexes and assistants fetching a page for a user.
89 bots
Search engines
Crawlers that fetch pages to build a search index.
128 bots
SEO tools
Backlink and site audit crawlers run by SEO tools.
17 bots
Uptime monitors
Services that request a page on a schedule to check it responds.
69 bots
Link previews
Fetchers that build a preview card when someone shares your link.
20 bots
Scripts and clients
HTTP libraries and command-line clients making requests from code.
5 bots
Archivers and validators
Archives saving a copy of a page and tools checking its markup.
16 bots
Other bots
Feed readers, security scanners, research crawlers and the long tail.
641 bots