Robots.txt Nutzungsverteilung in Tschechien

Verteilung für Websites mit Robots.txt Technologien

Technologie	Websites	%
Googlebot Disallow	32.021	11,78
Baidu Bot Disallow	22.499	8,28
Yandex Bot Disallow	21.546	7,93
Microsoft BingBot Disallow	20.519	7,55
Alexa Bot Disallow	19.489	7,17
Sogou Bot Disallow	19.465	7,16
Yahoo Slurp Disallow	19.384	7,13
Soso Bot Disallow	18.491	6,8
Robots Disallow	16.062	5,91
Google AdsBot Disallow	12.402	4,56
Google AdsBot Mobile Disallow	10.635	3,91
Ahrefs Bot Disallow	7.009	2,58
Semrush Bot Disallow	5.528	2,03
Majestic Bot Disallow	5.322	1,96
GPTBot Disallow	3.853	1,42
Webz Omgili Disallow	3.578	1,32
Anthropic Claude Bot Disallow	3.506	1,29
Common Crawl Bot Disallow	3.258	1,2
Some Robots Disallow	2.809	1,03
AppleBot Disallow	2.448	0,9
Google Bard Disallow	2.222	0,82
Facebook Bot Disallow	2.171	0,8
ByteDance Bytespider Disallow	2.073	0,76
Apple AI Bot Disallow	1.974	0,73
Cohere AI Disallow	1.868	0,69
Perplexity	1.821	0,67
Microsoft MSNBot Disallow	1.372	0,5
Google AdsBot Mobile Apps Disallow	1.225	0,45
Google Media Partners Disallow	1.168 ^*	0,43
Diffbot Disallow	1.017	0,37
Exalead Bot Disallow	983	0,36
YOU Disallow	919	0,34
Google Image Bot Disallow	640	0,24
DuckDuckGo Bot Disallow	385	0,14
Google News Bot Disallow	370	0,14
Google Video Bot Disallow	366	0,13
Google Favicon Disallow	362	0,13
Google API Bot Disallow	341	0,13
Google DuplexWeb Disallow	338	0,12
360 Bot Disallow	222	0,08
BuiltWithBot Disallow	85	0,03
Pipl Disallow	27	0,01
Youdao Bot Disallow	16	0,01
Google Read Aloud Disallow	5	0
Google FeedFetcher Disallow	3	0
LLMS Text	3	0