Robots.txt Nutzungsverteilung in Jamaika

Verteilung für Websites mit Robots.txt Technologien

Technologie	Websites	%
Google AdsBot Disallow	260	13,28
Googlebot Disallow	181	9,24
Google AdsBot Mobile Disallow	144	7,35
Ahrefs Bot Disallow	96	4,9
Robots Disallow	85	4,34
Baidu Bot Disallow	74	3,78
GPTBot Disallow	72	11,67
Common Crawl Bot Disallow	72	11,67
Google Bard Disallow	72	11,67
AppleBot Disallow	71	3,63
Anthropic Claude Bot Disallow	71	11,51
Facebook Bot Disallow	70	11,35
Cohere AI Disallow	69	11,18
Apple AI Bot Disallow	69	11,18
Perplexity	68	11,02
Google AdsBot Mobile Apps Disallow	68	3,47
Sogou Bot Disallow	58	2,96
Yandex Bot Disallow	55	2,81
Yahoo Slurp Disallow	51	2,6
Microsoft BingBot Disallow	49	2,5
Alexa Bot Disallow	45	7,29
Some Robots Disallow	44	2,25
Soso Bot Disallow	42	2,15
Majestic Bot Disallow	20	1,02
Google Media Partners Disallow	15 ^*	0,77
Microsoft MSNBot Disallow	10	0,51
Semrush Bot Disallow	9	0,46
Google Image Bot Disallow	8	0,41
Exalead Bot Disallow	4	0,2
ByteDance Bytespider Disallow	2	0,32
Webz Omgili Disallow	1	0,16
360 Bot Disallow	1	0,05
Diffbot Disallow	1	0,16
BuiltWithBot Disallow	1	0,05