Robots.txt Distribución de uso en Argentina

Distribución para sitios web que utilizan Robots.txt tecnologías

Tecnología	Sitios web	%
Googlebot Disallow	17.268	13,46
Google AdsBot Disallow	11.317	8,82
Google AdsBot Mobile Disallow	10.156	7,92
Robots Disallow	9.985	7,78
Anthropic Claude Bot Disallow	8.479	6,61
Baidu Bot Disallow	7.541	5,88
Yandex Bot Disallow	6.330	4,93
Sogou Bot Disallow	5.779	4,5
Microsoft BingBot Disallow	5.771	4,5
Yahoo Slurp Disallow	5.725	4,46
Alexa Bot Disallow	5.593	4,36
Soso Bot Disallow	5.246	4,09
Some Robots Disallow	3.756	2,93
Ahrefs Bot Disallow	2.743	2,14
Majestic Bot Disallow	1.906	1,49
Semrush Bot Disallow	1.857	1,45
GPTBot Disallow	1.838	1,43
Common Crawl Bot Disallow	1.785	1,39
Google Bard Disallow	1.614	1,26
AppleBot Disallow	1.601	1,25
Facebook Bot Disallow	1.563	1,22
Cohere AI Disallow	1.441	1,12
Apple AI Bot Disallow	1.427	1,11
Google Media Partners Disallow	1.384 ^*	1,08
Perplexity	1.334	1,04
Google AdsBot Mobile Apps Disallow	1.284	1
Microsoft MSNBot Disallow	686	0,53
Google Image Bot Disallow	524	0,41
Exalead Bot Disallow	442	0,34
Pipl Disallow	388	0,3
Webz Omgili Disallow	353	0,28
ByteDance Bytespider Disallow	331	0,26
360 Bot Disallow	189	0,15
BuiltWithBot Disallow	150	0,12
Diffbot Disallow	109	0,08
YOU Disallow	80	0,06
DuckDuckGo Bot Disallow	58	0,05
Google Video Bot Disallow	57	0,04
Google News Bot Disallow	48	0,04
Google Favicon Disallow	38	0,03
Youdao Bot Disallow	37	0,03
Google API Bot Disallow	36	0,03
Google DuplexWeb Disallow	36	0,03
Google FeedFetcher Disallow	1	0