Robots.txt Distribución de uso en Gabón

Distribución para sitios web que utilizan Robots.txt tecnologías

Tecnología	Sitios web	%
Robots Disallow	38	23,75
GPTBot Disallow	10	6,25
Common Crawl Bot Disallow	9	5,62
Anthropic Claude Bot Disallow	9	5,62
Google Bard Disallow	9	5,62
Facebook Bot Disallow	9	5,62
Cohere AI Disallow	9	5,62
AppleBot Disallow	8	5
Apple AI Bot Disallow	8	5
Perplexity	8	5
Google AdsBot Mobile Apps Disallow	8	5
Ahrefs Bot Disallow	6	3,75
Yahoo Slurp Disallow	4	2,5
Sogou Bot Disallow	3	1,88
Yandex Bot Disallow	3	1,88
Microsoft BingBot Disallow	3	1,88
Alexa Bot Disallow	3	1,88
Soso Bot Disallow	3	1,88
Majestic Bot Disallow	3	1,88
Semrush Bot Disallow	2	1,25
ByteDance Bytespider Disallow	2	1,25
Microsoft MSNBot Disallow	1	0,62
Webz Omgili Disallow	1	0,62
Diffbot Disallow	1	0,62