ProRata
ProRata is an AI search crawler run by ProRata.
- Operator
- ProRata
- Type
- AI Search Crawler
- Official page
- platform.gist.ai
- Sends readers back
- Sometimes, when an answer cites you
- Follows robots.txt
- Yes, according to ProRata.
- In Vireo
- Excluded, reported under AI crawlers
What it does
Crawls licensed and public pages so ProRata's Gist.ai answer engine can retrieve and cite them.
The collected data is used to power a Retrieval-Augmented Generation (RAG) model that serves content on the Gist.ai website.
ProRata
User agent
Requests from ProRata carry a user agent like this:
ProRataInc (The ProRata Fair Use Crawler; https://prorata.ai; support@prorata.ai)Device Detector identifies it with this pattern (a case-insensitive regular expression):
ProRataAnyone can put any name in a user agent. Where the operator publishes IP ranges, checking the request's address against them is the way to confirm a visit is genuine.
Worth knowing
ProRata publishes its two crawler IP addresses, one for production and one for testing.
Our crawler uses the IP address(es): 172.190.46.235 (for production) and 172.171.95.51 (testing)
ProRata
Does ProRata send readers back?
It can. ProRata feeds an AI search or answer product, and answers built from it can link to their sources. Readers who follow those links arrive as visitors, and Vireo counts the ones from assistants it recognises under AI assistants.
How Vireo counts ProRata
Vireo keeps requests from ProRata out of your pageviews and visitors and counts them on its bot report under AI crawlers, so you can see how much it left out rather than wonder why your server logs show more traffic.
Because it's an AI crawler, its requests also count toward the pages AI crawlers took, which Vireo shows next to the readers AI assistants sent back. See how the AI assistants card works.
- Check any user agent against Vireo's bot filter
- Build robots.txt rules for AI crawlers
- Every bot Vireo reports under AI crawlers
Checked by running Vireo Analytics' own bot filter over ProRata's user agents.
Sources
- ProRata: crawler documentation (checked October 2026)
- ProRata information page (platform.gist.ai)
- Matomo Device Detector, bots.yml (LGPL-3.0)
More AI crawlers
- Ai2Bot (Allen Institute for AI (Ai2))
- Ai2Bot-DeepResearchEval (The Allen Institute for Artificial Intelligence)
- Ai2Bot-Dolma (The Allen Institute for Artificial Intelligence)
- Amazonbot (Amazon)
- Amazonbot-Video (Amazon.com, Inc.)
- AmazonBuyForMe (Amazon.com, Inc.)
- Amzn-SearchBot (Amazon.com, Inc.)
- Amzn-User (Amazon.com, Inc.)
- Andibot (Andi)
- Anthropic AI (Anthropic, PBC)
See the bots on your own site
Vireo Analytics is a free WordPress plugin. It keeps over 800 known crawlers out of your numbers and shows you what it filtered, by category.
Get Vireo free on WordPress.org