Robots.txt Distribuzione dell'utilizzo In Ruanda

Distribuzione per i siti Web che utilizzano Robots.txt tecnologie

Tecnologia	Siti web	%
Common Crawl Bot Disallow	227	8,11
Ahrefs Bot Disallow	201	7,18
Sogou Bot Disallow	191	6,83
Googlebot Disallow	189	6,75
Soso Bot Disallow	182	6,5
Majestic Bot Disallow	182	6,5
Semrush Bot Disallow	180	6,43
Exalead Bot Disallow	161	5,75
360 Bot Disallow	155	5,54
BuiltWithBot Disallow	155	5,54
Robots Disallow	127	4,54
GPTBot Disallow	80	2,86
AppleBot Disallow	76	2,72
Google AdsBot Mobile Apps Disallow	71	2,54
Anthropic Claude Bot Disallow	70	2,5
Google Bard Disallow	70	2,5
Cohere AI Disallow	70	2,5
Perplexity	70	2,5
Facebook Bot Disallow	69	2,47
Apple AI Bot Disallow	69	2,47
Yandex Bot Disallow	54	1,93
Microsoft BingBot Disallow	36	1,29
Yahoo Slurp Disallow	36	1,29
Alexa Bot Disallow	33	1,18
Google Media Partners Disallow	17 ^*	0,61
Microsoft MSNBot Disallow	6	0,21
Google Image Bot Disallow	5	0,18
DuckDuckGo Bot Disallow	3	0,11
Google News Bot Disallow	2	0,07
Google Video Bot Disallow	2	0,07
Google Favicon Disallow	2	0,07
Google API Bot Disallow	2	0,07
Google DuplexWeb Disallow	2	0,07
ByteDance Bytespider Disallow	1	0,04
Webz Omgili Disallow	1	0,04
YOU Disallow	1	0,04