Robots.txt Répartition de l'utilisation dans Niger

Distribution pour les sites Web utilisant Robots.txt les technologies

Technologie	Sites Internet	%
Alexa Bot Disallow	42	9,21
Microsoft BingBot Disallow	39	8,55
Yandex Bot Disallow	38	8,33
Yahoo Slurp Disallow	38	8,33
Sogou Bot Disallow	37	8,11
Soso Bot Disallow	37	8,11
Googlebot Disallow	36	7,89
Robots Disallow	35	7,68
Baidu Bot Disallow	22	4,82
Some Robots Disallow	16	3,51
Google Media Partners Disallow	15 ^*	3,29
Ahrefs Bot Disallow	12	2,63
Majestic Bot Disallow	10	2,19
GPTBot Disallow	6	1,32
Common Crawl Bot Disallow	6	1,32
AppleBot Disallow	6	1,32
Anthropic Claude Bot Disallow	6	1,32
Google Bard Disallow	6	1,32
Perplexity	6	1,32
Exalead Bot Disallow	6	1,32
Facebook Bot Disallow	5	1,1
Apple AI Bot Disallow	5	1,1
Google AdsBot Mobile Apps Disallow	5	1,1
Cohere AI Disallow	4	0,88
Semrush Bot Disallow	3	0,66
ByteDance Bytespider Disallow	2	0,44
Webz Omgili Disallow	2	0,44
Google Image Bot Disallow	2	0,44
Microsoft MSNBot Disallow	1	0,22
Diffbot Disallow	1	0,22
Google News Bot Disallow	1	0,22
Google Video Bot Disallow	1	0,22
DuckDuckGo Bot Disallow	1	0,22
Google Favicon Disallow	1	0,22
YOU Disallow	1	0,22
Google API Bot Disallow	1	0,22
Google DuplexWeb Disallow	1	0,22