Robots.txt Répartition des utilisations en Guyane

Distribution pour les sites Web utilisant Robots.txt technologies

Technologie	Sites Web	%
Googlebot Disallow	199	18,29
Baidu Bot Disallow	125	11,49
Sogou Bot Disallow	112	10,29
Robots Disallow	87	8
Yandex Bot Disallow	61	5,61
Microsoft BingBot Disallow	55	5,06
Yahoo Slurp Disallow	54	4,96
Alexa Bot Disallow	52	4,78
Soso Bot Disallow	51	4,69
Ahrefs Bot Disallow	33	3,03
Google Media Partners Disallow	29 ^*	2,67
GPTBot Disallow	23	2,11
Common Crawl Bot Disallow	19	1,75
AppleBot Disallow	19	1,75
Anthropic Claude Bot Disallow	19	1,75
Google Bard Disallow	19	1,75
Cohere AI Disallow	19	1,75
Facebook Bot Disallow	18	1,65
Apple AI Bot Disallow	18	1,65
Google AdsBot Mobile Apps Disallow	18	1,65
Perplexity	17	1,56
Majestic Bot Disallow	8	0,74
Semrush Bot Disallow	5	0,46
Exalead Bot Disallow	3	0,28
Microsoft MSNBot Disallow	3	0,28
ByteDance Bytespider Disallow	2	0,18
Webz Omgili Disallow	2	0,18
Google Image Bot Disallow	2	0,18
Diffbot Disallow	2	0,18
Google News Bot Disallow	2	0,18
Google Video Bot Disallow	2	0,18
DuckDuckGo Bot Disallow	2	0,18
Google Favicon Disallow	2	0,18
Google API Bot Disallow	2	0,18
Google DuplexWeb Disallow	2	0,18
360 Bot Disallow	1	0,09
YOU Disallow	1	0,09