Robots.txt Répartition de l'utilisation dans Andorre

Distribution pour les sites Web utilisant Robots.txt les technologies

Technologie	Sites Internet	%
Googlebot Disallow	217	13,76
Google AdsBot Disallow	193	12,24
Google AdsBot Mobile Disallow	164	10,4
Some Robots Disallow	103	6,53
Robots Disallow	89	5,64
Baidu Bot Disallow	61	3,87
Ahrefs Bot Disallow	57	3,61
Yandex Bot Disallow	54	3,42
Alexa Bot Disallow	51	3,23
Yahoo Slurp Disallow	44	2,79
Sogou Bot Disallow	40	2,54
Microsoft BingBot Disallow	36	2,28
GPTBot Disallow	36	2,28
Anthropic Claude Bot Disallow	36	2,28
Soso Bot Disallow	35	2,22
Common Crawl Bot Disallow	34	2,16
AppleBot Disallow	34	2,16
Google Bard Disallow	32	2,03
Facebook Bot Disallow	32	2,03
Apple AI Bot Disallow	32	2,03
Perplexity	32	2,03
Google AdsBot Mobile Apps Disallow	32	2,03
Cohere AI Disallow	31	1,97
Majestic Bot Disallow	26	1,65
Semrush Bot Disallow	23	1,46
Google Media Partners Disallow	15 ^*	0,95
Microsoft MSNBot Disallow	11	0,7
ByteDance Bytespider Disallow	6	0,38
Google Image Bot Disallow	6	0,38
Exalead Bot Disallow	4	0,25
Youdao Bot Disallow	3	0,19
Webz Omgili Disallow	1	0,06
Google News Bot Disallow	1	0,06
Google Video Bot Disallow	1	0,06
DuckDuckGo Bot Disallow	1	0,06
Google Favicon Disallow	1	0,06
YOU Disallow	1	0,06
Google API Bot Disallow	1	0,06
Google DuplexWeb Disallow	1	0,06