Robots.txt Distribución de uso en Yibuti

Distribución para sitios web que utilizan Robots.txt tecnologías

Tecnología	Sitios web	%
Some Robots Disallow	89	17,87
Robots Disallow	50	10,04
Sogou Bot Disallow	44	8,84
Microsoft BingBot Disallow	23	4,62
Soso Bot Disallow	23	4,62
Yahoo Slurp Disallow	21	4,22
Alexa Bot Disallow	20	4,02
Yandex Bot Disallow	18	3,61
Common Crawl Bot Disallow	18	3,61
Google Bard Disallow	18	3,61
Facebook Bot Disallow	18	3,61
Anthropic Claude Bot Disallow	17	3,41
GPTBot Disallow	16	3,21
Cohere AI Disallow	15	3,01
Apple AI Bot Disallow	11	2,21
Ahrefs Bot Disallow	10	2,01
AppleBot Disallow	10	2,01
Majestic Bot Disallow	10	2,01
Semrush Bot Disallow	10	2,01
Webz Omgili Disallow	10	2,01
Perplexity	9	1,81
Google AdsBot Mobile Apps Disallow	7	1,41
ByteDance Bytespider Disallow	7	1,41
Exalead Bot Disallow	7	1,41
360 Bot Disallow	6	1,2
BuiltWithBot Disallow	6	1,2
Microsoft MSNBot Disallow	3	0,6
Diffbot Disallow	1	0,2
YOU Disallow	1	0,2