Robots.txt Répartition des utilisations au Zimbabwe

Distribution pour les sites Web utilisant Robots.txt technologies

Technologie	Sites Web	%
Googlebot Disallow	374	16,33
Google AdsBot Disallow	374	16,33
Google AdsBot Mobile Disallow	338	14,76
Robots Disallow	294	12,84
Baidu Bot Disallow	79	3,45
Ahrefs Bot Disallow	63	2,75
Yandex Bot Disallow	62	2,71
Google Media Partners Disallow	44 ^*	1,92
GPTBot Disallow	42	1,83
AppleBot Disallow	42	1,83
Common Crawl Bot Disallow	41	1,79
Google AdsBot Mobile Apps Disallow	41	1,79
Microsoft BingBot Disallow	40	1,75
Anthropic Claude Bot Disallow	40	1,75
Google Bard Disallow	40	1,75
Facebook Bot Disallow	40	1,75
Apple AI Bot Disallow	40	1,75
Perplexity	40	1,75
Yahoo Slurp Disallow	39	1,7
Cohere AI Disallow	39	1,7
Semrush Bot Disallow	35	1,53
Alexa Bot Disallow	31	1,35
Soso Bot Disallow	29	1,27
Majestic Bot Disallow	29	1,27
Microsoft MSNBot Disallow	12	0,52
Google Image Bot Disallow	10	0,44
ByteDance Bytespider Disallow	4	0,17
Google News Bot Disallow	4	0,17
Google Video Bot Disallow	3	0,13
DuckDuckGo Bot Disallow	3	0,13
Google Favicon Disallow	3	0,13
Google API Bot Disallow	3	0,13
Google DuplexWeb Disallow	3	0,13
Exalead Bot Disallow	2	0,09
Webz Omgili Disallow	2	0,09
360 Bot Disallow	2	0,09
Diffbot Disallow	1	0,04
BuiltWithBot Disallow	1	0,04
YOU Disallow	1	0,04