Robots.txt Nutzungsverteilung in Jamaika

Verteilung für Websites mit Robots.txt Technologien

Technologie	Websites	%
Google AdsBot Disallow	183	10,77
Googlebot Disallow	160	9,42
Google AdsBot Mobile Disallow	106	6,24
Ahrefs Bot Disallow	89	5,24
Robots Disallow	86	5,06
Baidu Bot Disallow	72	4,24
GPTBot Disallow	66	11,89
Common Crawl Bot Disallow	65	11,71
Google Bard Disallow	65	11,71
AppleBot Disallow	64	3,77
Anthropic Claude Bot Disallow	64	11,53
Facebook Bot Disallow	63	11,35
Sogou Bot Disallow	62	3,65
Cohere AI Disallow	62	11,17
Apple AI Bot Disallow	62	11,17
Perplexity	61	10,99
Google AdsBot Mobile Apps Disallow	61	3,59
Yandex Bot Disallow	44	2,59
Yahoo Slurp Disallow	43	2,53
Microsoft BingBot Disallow	42	2,47
Some Robots Disallow	39	2,3
Alexa Bot Disallow	37	6,67
Soso Bot Disallow	33	1,94
Majestic Bot Disallow	19	1,12
Google Media Partners Disallow	13 ^*	0,77
Microsoft MSNBot Disallow	11	0,65
Semrush Bot Disallow	9	0,53
Google Image Bot Disallow	9	0,53
Exalead Bot Disallow	3	0,18
ByteDance Bytespider Disallow	2	0,36
Webz Omgili Disallow	1	0,18
360 Bot Disallow	1	0,06
Diffbot Disallow	1	0,18
BuiltWithBot Disallow	1	0,06