Link preview fetchers

When someone shares your URL on a social network or in a chat app, the service fetches the page to build a preview card. That fetch is a bot, not the person who shared it.

20 known bots from 13 operators. 13 have their own page with user agents, robots.txt tokens and sources.

BotOperatorType
AddThis.comClearspring Technologies, Inc.Social Media Agent
BlueskyBluesky Social PBCSocial Media Agent
Discord BotNot knownService Agent
Facebook CrawlerMetaSocial Media Agent
facebookexternalhitMeta/FacebookListed by ai.robots.txt
FediListNot knownSocial Media Agent
FriendicaNot knownSocial Media Agent
KeybaseBotZoom Video Communications, IncSocial Media Agent
LinkedIn BotLinkedInSocial Media Agent
Magpie-CrawlerBrandwatchSocial Media Agent
Mastodon BotNot knownSocial Media Agent
Meta-ExternalAdsMeta Platforms, Inc.Social Media Agent
Meta-ExternalFetcherMetaSocial Media Agent
Meta-WebIndexerMeta Platforms, Inc.Social Media Agent
PinterestPinterestCrawler
Reddit Botreddit inc.Social Media Agent
Skype URI PreviewSkype Communications S.à.r.l.Service Agent
SlackbotSlackCrawler
TelegramBotNot known
TwitterbotTwitterSocial Media Agent

Names, operators and types from Matomo Device Detector (LGPL-3.0) and ai.robots.txt (MIT). Category from running Vireo Analytics' bot filter on each bot's user agent. About this data.

Other categories