Robots.txt Distribución de uso en Birmania

Distribución para sitios web que utilizan Robots.txt tecnologías

Tecnología	Sitios web	%
Robots Disallow	197	11,75
Google AdsBot Disallow	192	11,46
Googlebot Disallow	168	10,02
Google AdsBot Mobile Disallow	158	9,43
AppleBot Disallow	65	3,88
Ahrefs Bot Disallow	63	3,76
Common Crawl Bot Disallow	63	3,76
GPTBot Disallow	59	3,52
Anthropic Claude Bot Disallow	58	3,46
Google Bard Disallow	58	3,46
Facebook Bot Disallow	58	3,46
Apple AI Bot Disallow	58	3,46
Perplexity	57	3,4
Cohere AI Disallow	55	3,28
Google AdsBot Mobile Apps Disallow	53	3,16
Some Robots Disallow	43	2,57
Yandex Bot Disallow	40	2,39
Microsoft BingBot Disallow	38	2,27
Yahoo Slurp Disallow	33	1,97
Alexa Bot Disallow	29	1,73
Majestic Bot Disallow	29	1,73
Soso Bot Disallow	28	1,67
Semrush Bot Disallow	26	1,55
ByteDance Bytespider Disallow	10	0,6
Exalead Bot Disallow	7	0,42
360 Bot Disallow	6	0,36
Webz Omgili Disallow	5	0,3
DuckDuckGo Bot Disallow	5	0,3
Microsoft MSNBot Disallow	4	0,24
Google Image Bot Disallow	3	0,18
Diffbot Disallow	3	0,18
BuiltWithBot Disallow	2	0,12
YOU Disallow	2	0,12
Youdao Bot Disallow	1	0,06