Robots.txt Usage Distribution in Solomon Islands

Top In Robots.txt Usage Distribution in Solomon Islands

Technology	Websites	%
Robots Disallow	154	42.78
Googlebot Disallow	20	5.56
Google Media Partners Disallow	15 *	4.17
GPTBot Disallow	12	3.33
Common Crawl Bot Disallow	11	3.06
Baidu Bot Disallow	10	2.78
Sogou Bot Disallow	10	2.78
Anthropic Claude Bot Disallow	10	2.78
Facebook Bot Disallow	10	2.78
AppleBot Disallow	9	2.5
Google Bard Disallow	9	2.5
Cohere AI Disallow	9	2.5
Apple AI Bot Disallow	9	2.5
Perplexity	8	2.22
Soso Bot Disallow	7	1.94
Ahrefs Bot Disallow	7	1.94
Google AdsBot Mobile Apps Disallow	7	1.94
Yandex Bot Disallow	6	1.67
Alexa Bot Disallow	6	1.67
Yahoo Slurp Disallow	6	1.67
Microsoft BingBot Disallow	5	1.39
Semrush Bot Disallow	3	0.83
ByteDance Bytespider Disallow	3	0.83
Webz Omgili Disallow	3	0.83
Majestic Bot Disallow	2	0.56
Exalead Bot Disallow	2	0.56
360 Bot Disallow	2	0.56
Diffbot Disallow	2	0.56
BuiltWithBot Disallow	2	0.56
Microsoft MSNBot Disallow	1	0.28

360 Detections

of Robots.txt in Solomon Islands. Last updated 07th Mar 2025.

Robots Disallow is currently the most popular technology in this category.