Robots.txt Usage Distribution in San Marino

Distribution for websites using Robots.txt technologies

Technology	Websites	%
Robots Disallow	40	21.51
Googlebot Disallow	20	10.75
Ahrefs Bot Disallow	15	8.06
Semrush Bot Disallow	11	5.91
Anthropic Claude Bot Disallow	9	16.07
Yandex Bot Disallow	8	4.3
Some Robots Disallow	7	3.76
GPTBot Disallow	7	12.5
Majestic Bot Disallow	7	3.76
Common Crawl Bot Disallow	6	10.71
AppleBot Disallow	6	3.23
Microsoft BingBot Disallow	5	2.69
Google Bard Disallow	5	8.93
Facebook Bot Disallow	5	8.93
Apple AI Bot Disallow	5	8.93
Alexa Bot Disallow	4	7.14
Yahoo Slurp Disallow	4	2.15
Cohere AI Disallow	4	7.14
Perplexity	4	7.14
Google AdsBot Mobile Apps Disallow	4	2.15
Soso Bot Disallow	3	1.61
ByteDance Bytespider Disallow	2	3.57
Microsoft MSNBot Disallow	2	1.08
Exalead Bot Disallow	1	0.54
Webz Omgili Disallow	1	1.79
DuckDuckGo Bot Disallow	1	0.54