Robots.txt Distribuzione dell'utilizzo In Madagascar

Distribuzione per i siti Web che utilizzano Robots.txt tecnologie

Tecnologia	Siti web	%
Robots Disallow	179	17,24
Googlebot Disallow	136	13,1
Google AdsBot Disallow	112	10,79
Google AdsBot Mobile Disallow	101	9,73
Baidu Bot Disallow	34	3,28
Common Crawl Bot Disallow	29	2,79
GPTBot Disallow	27	2,6
Microsoft BingBot Disallow	25	2,41
Yandex Bot Disallow	24	2,31
Ahrefs Bot Disallow	23	2,22
Yahoo Slurp Disallow	23	2,22
AppleBot Disallow	23	2,22
Google Bard Disallow	23	2,22
Anthropic Claude Bot Disallow	22	2,12
Facebook Bot Disallow	22	2,12
Apple AI Bot Disallow	22	2,12
Cohere AI Disallow	22	2,12
Perplexity	22	2,12
Google AdsBot Mobile Apps Disallow	22	2,12
Sogou Bot Disallow	18	1,73
Alexa Bot Disallow	18	1,73
Soso Bot Disallow	16	1,54
Majestic Bot Disallow	16	1,54
Google Media Partners Disallow	15 ^*	1,45
Semrush Bot Disallow	14	1,35
DuckDuckGo Bot Disallow	7	0,67
Google Image Bot Disallow	6	0,58
Exalead Bot Disallow	5	0,48
Microsoft MSNBot Disallow	5	0,48
ByteDance Bytespider Disallow	4	0,39
360 Bot Disallow	3	0,29
BuiltWithBot Disallow	3	0,29
Google News Bot Disallow	3	0,29
Webz Omgili Disallow	2	0,19
Diffbot Disallow	2	0,19
Google Video Bot Disallow	2	0,19
Google Favicon Disallow	2	0,19
YOU Disallow	2	0,19
Google API Bot Disallow	2	0,19
Google DuplexWeb Disallow	2	0,19