Robots.txt Nutzungsverteilung In Haiti

Verteilung für Websites mit Robots.txt Technologien

Technologie	Websites	%
GPTBot Disallow	59	6,45
Anthropic Claude Bot Disallow	57	6,23
Google Bard Disallow	57	6,23
Common Crawl Bot Disallow	56	6,12
Facebook Bot Disallow	56	6,12
AppleBot Disallow	55	6,01
Apple AI Bot Disallow	53	5,79
Perplexity	51	5,57
Cohere AI Disallow	50	5,46
Google AdsBot Mobile Apps Disallow	49	5,36
Yandex Bot Disallow	44	4,81
Ahrefs Bot Disallow	44	4,81
Robots Disallow	42	4,59
Alexa Bot Disallow	38	4,15
Sogou Bot Disallow	37	4,04
Soso Bot Disallow	36	3,93
Microsoft BingBot Disallow	33	3,61
Yahoo Slurp Disallow	33	3,61
Majestic Bot Disallow	15	1,64
Semrush Bot Disallow	9	0,98
Webz Omgili Disallow	9	0,98
ByteDance Bytespider Disallow	7	0,77
Exalead Bot Disallow	6	0,66
Google Image Bot Disallow	4	0,44
Diffbot Disallow	3	0,33
360 Bot Disallow	2	0,22
Microsoft MSNBot Disallow	1	0,11
BuiltWithBot Disallow	1	0,11
Google News Bot Disallow	1	0,11
Google Video Bot Disallow	1	0,11
DuckDuckGo Bot Disallow	1	0,11
Google Favicon Disallow	1	0,11
YOU Disallow	1	0,11
Google API Bot Disallow	1	0,11
Google DuplexWeb Disallow	1	0,11
Pipl Disallow	1	0,11