Baidu Spider

Operator

Baidu

Type

Search bot

Official page

help.baidu.com

robots.txt token

Baiduspider, Spider

Follows robots.txt

Yes, according to Baidu.

In Vireo

Excluded, reported under Search engines

What it does

Baidu's search crawler. It visits pages to build the index that Baidu Search runs on.

Baiduspider是百度搜索引擎的一个自动程序，它的作用是访问互联网上的网页，建立索引数据库，使用户能在百度搜索引擎中搜索到您网站上的网页。

Baidu

User agent

Requests from Baidu Spider carry user agents like these:

Baiduspider+(+http://www.baidu.com/search/spider.htm)

Baiduspider-image+(+http://www.baidu.com/search/spider.htm)

Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search

Device Detector identifies it with this pattern (a case-insensitive regular expression):

Baidu.*spider|baidu Transcoder

Anyone can put any name in a user agent. Where the operator publishes IP ranges, checking the request's address against them is the way to confirm a visit is genuine.

How to block or allow Baidu Spider

Add a group for its tokens to the robots.txt file at the root of your site. To keep it out of the whole site:

User-agent: Baiduspider
User-agent: Spider
Disallow: /

To let it crawl everything, use an empty Disallow: or Allow: / instead. WordPress serves a virtual robots.txt that many SEO plugins let you edit. A real robots.txt file uploaded to the site root takes its place.

User-agent: Baiduspider Disallow: /

Baidu

Baiduspider遵守互联网robots协议。

Baidu

robots.txt is a request, so it only works on crawlers that honour it. A bot that ignores it has to be blocked at the server or firewall, by user agent or IP address.

Worth knowing

Page is in Chinese. Baidu says its Baiduspider-cpro and Baiduspider-ads agents don't follow robots.txt. Verify by reverse DNS (*.baidu.com or *.baidu.jp).

Baiduspider-cpro抓取的网页并不会建入索引，只是执行与客户约定的操作，所以不遵守robots协议

Baidu

How Vireo counts Baidu Spider

Vireo keeps requests from Baidu Spider out of your pageviews and visitors and counts them on its bot report under Search engines, so you can see how much it left out rather than wonder why your server logs show more traffic.

Checked by running Vireo Analytics' own bot filter over Baidu Spider's user agents.

Sources

• Baidu: crawler documentation (checked October 2026)
• Baidu Spider information page (baidu.com)
• Matomo Device Detector, bots.yml (LGPL-3.0)
• ai.robots.txt (MIT)