Robots.txt Distribuzione dell'utilizzo In Burkina Faso

Distribuzione per i siti Web che utilizzano Robots.txt tecnologie

Tecnologia	Siti web	%
Robots Disallow	145	24,33
Googlebot Disallow	60	10,07
Google AdsBot Disallow	46	7,72
Google AdsBot Mobile Disallow	35	5,87
Baidu Bot Disallow	33	5,54
Ahrefs Bot Disallow	29	4,87
Microsoft MSNBot Disallow	15	2,52
Google Media Partners Disallow	15 ^*	2,52
Yandex Bot Disallow	14	2,35
Majestic Bot Disallow	14	2,35
GPTBot Disallow	13	2,18
Sogou Bot Disallow	12	2,01
Alexa Bot Disallow	12	2,01
Semrush Bot Disallow	12	2,01
Microsoft BingBot Disallow	11	1,85
Common Crawl Bot Disallow	11	1,85
Yahoo Slurp Disallow	10	1,68
Anthropic Claude Bot Disallow	10	1,68
Soso Bot Disallow	9	1,51
AppleBot Disallow	9	1,51
Facebook Bot Disallow	8	1,34
Apple AI Bot Disallow	8	1,34
Cohere AI Disallow	8	1,34
Perplexity	8	1,34
Google AdsBot Mobile Apps Disallow	8	1,34
Google Bard Disallow	6	1,01
Google Image Bot Disallow	5	0,84
Webz Omgili Disallow	4	0,67
ByteDance Bytespider Disallow	3	0,5
Diffbot Disallow	3	0,5
Google News Bot Disallow	3	0,5
Google Video Bot Disallow	3	0,5
DuckDuckGo Bot Disallow	3	0,5
Google Favicon Disallow	3	0,5
Google API Bot Disallow	3	0,5
Google DuplexWeb Disallow	3	0,5
Exalead Bot Disallow	2	0,34