Robots.txt Répartition de l'utilisation dans Ghana

Distribution pour les sites Web utilisant Robots.txt les technologies

Technologie	Sites Internet	%
Googlebot Disallow	820	11,74
Google AdsBot Disallow	675	9,66
Google AdsBot Mobile Disallow	575	8,23
Robots Disallow	510	7,3
Baidu Bot Disallow	367	5,25
Some Robots Disallow	269	3,85
Google Media Partners Disallow	254 ^*	3,64
Sogou Bot Disallow	251	3,59
Yandex Bot Disallow	234	3,35
Microsoft BingBot Disallow	221	3,16
Alexa Bot Disallow	203	2,91
Yahoo Slurp Disallow	201	2,88
GPTBot Disallow	196	2,81
Soso Bot Disallow	194	2,78
Common Crawl Bot Disallow	190	2,72
AppleBot Disallow	186	2,66
Google Bard Disallow	181	2,59
Anthropic Claude Bot Disallow	179	2,56
Facebook Bot Disallow	178	2,55
Perplexity	175	2,51
Apple AI Bot Disallow	174	2,49
Cohere AI Disallow	171	2,45
Ahrefs Bot Disallow	168	2,4
Google AdsBot Mobile Apps Disallow	164	2,35
Majestic Bot Disallow	61	0,87
Semrush Bot Disallow	60	0,86
ByteDance Bytespider Disallow	27	0,39
Microsoft MSNBot Disallow	14	0,2
Webz Omgili Disallow	14	0,2
Google Image Bot Disallow	11	0,16
Exalead Bot Disallow	10	0,14
YOU Disallow	10	0,14
360 Bot Disallow	9	0,13
Diffbot Disallow	8	0,11
DuckDuckGo Bot Disallow	5	0,07
Youdao Bot Disallow	5	0,07
BuiltWithBot Disallow	4	0,06
Google News Bot Disallow	3	0,04
Google Video Bot Disallow	2	0,03
Google Favicon Disallow	2	0,03
Google API Bot Disallow	2	0,03
Google DuplexWeb Disallow	2	0,03
Google FeedFetcher Disallow	1	0,01