Robots.txt Distribución de uso en República Checa

Distribución para sitios web que utilizan Robots.txt tecnologías

Tecnología	Sitios web	%
Googlebot Disallow	38.875	12,82
Baidu Bot Disallow	24.603	8,12
Yandex Bot Disallow	22.260	7,34
Microsoft BingBot Disallow	21.164	6,98
Alexa Bot Disallow	19.420	6,41
Yahoo Slurp Disallow	19.317	6,37
Sogou Bot Disallow	18.631	6,15
Google AdsBot Disallow	18.412	6,07
Soso Bot Disallow	18.047	5,95
Google AdsBot Mobile Disallow	16.144	5,33
Robots Disallow	15.570	5,14
Ahrefs Bot Disallow	10.121	3,34
Semrush Bot Disallow	8.510	2,81
Majestic Bot Disallow	8.104	2,67
Webz Omgili Disallow	4.584	1,51
GPTBot Disallow	4.465	1,47
Some Robots Disallow	4.010	1,32
Common Crawl Bot Disallow	3.471	1,15
Anthropic Claude Bot Disallow	3.398	1,12
AppleBot Disallow	2.555	0,84
Microsoft MSNBot Disallow	2.200	0,73
Google Bard Disallow	2.017	0,67
Facebook Bot Disallow	1.990	0,66
Apple AI Bot Disallow	1.751	0,58
Google AdsBot Mobile Apps Disallow	1.641	0,54
Cohere AI Disallow	1.590	0,52
Perplexity	1.506	0,5
ByteDance Bytespider Disallow	1.492	0,49
Exalead Bot Disallow	1.405	0,46
Google Media Partners Disallow	1.206 ^*	0,4
Google Image Bot Disallow	843	0,28
Google News Bot Disallow	434	0,14
Google Video Bot Disallow	432	0,14
Google Favicon Disallow	426	0,14
DuckDuckGo Bot Disallow	423	0,14
Diffbot Disallow	418	0,14
Google DuplexWeb Disallow	400	0,13
Google API Bot Disallow	399	0,13
360 Bot Disallow	383	0,13
YOU Disallow	324	0,11
BuiltWithBot Disallow	152	0,05
Youdao Bot Disallow	27	0,01
Pipl Disallow	18	0,01
Google Read Aloud Disallow	4	0
Google FeedFetcher Disallow	2	0