Robots.txt Répartition des utilisations en Pologne

Distribution pour les sites Web utilisant Robots.txt technologies

Technologie	Sites Web	%
Googlebot Disallow	54 698	11,12
Baidu Bot Disallow	41 968	8,53
Yandex Bot Disallow	35 287	7,18
Sogou Bot Disallow	33 440	6,8
Alexa Bot Disallow	29 047	5,91
Yahoo Slurp Disallow	28 272	5,75
Microsoft BingBot Disallow	28 001	5,69
Soso Bot Disallow	26 696	5,43
Robots Disallow	22 606	4,6
Google AdsBot Disallow	22 545	4,58
Ahrefs Bot Disallow	19 886	4,04
Majestic Bot Disallow	17 309	3,52
Google AdsBot Mobile Disallow	17 296	3,52
Some Robots Disallow	14 816	3,01
Semrush Bot Disallow	10 157	2,07
Exalead Bot Disallow	7 874	1,6
Common Crawl Bot Disallow	7 563	1,54
GPTBot Disallow	7 282	1,48
Anthropic Claude Bot Disallow	5 949	1,21
AppleBot Disallow	5 392	1,1
Google Bard Disallow	5 362	1,09
ByteDance Bytespider Disallow	5 295	1,08
Facebook Bot Disallow	5 230	1,06
Cohere AI Disallow	4 889	0,99
Apple AI Bot Disallow	4 748	0,97
Perplexity	4 696	0,95
Webz Omgili Disallow	4 239	0,86
Diffbot Disallow	3 760	0,76
YOU Disallow	3 503	0,71
Google Media Partners Disallow	2 415 ^*	0,49
Google Image Bot Disallow	2 171	0,44
360 Bot Disallow	2 014	0,41
Microsoft MSNBot Disallow	1 727	0,35
Google AdsBot Mobile Apps Disallow	1 460	0,3
BuiltWithBot Disallow	1 279	0,26
DuckDuckGo Bot Disallow	529	0,11
Google News Bot Disallow	443	0,09
Google Video Bot Disallow	389	0,08
Google Favicon Disallow	371	0,08
Google API Bot Disallow	352	0,07
Youdao Bot Disallow	345	0,07
Google DuplexWeb Disallow	342	0,07
Pipl Disallow	89	0,02
Google FeedFetcher Disallow	12	0
Google Read Aloud Disallow	5	0
LLMS Text	2	0
Google Web Light Disallow	1	0