Robots.txt Usage Distribution in Heard Island and McDonald Islands

Top In Robots.txt Usage Distribution in Heard Island and McDonald Islands

Technology	Websites	%
Googlebot Disallow	44	18.18
Alexa Bot Disallow	30	12.4
Sogou Bot Disallow	29	11.98
Microsoft BingBot Disallow	28	11.57
Yahoo Slurp Disallow	28	11.57
Yandex Bot Disallow	27	11.16
Soso Bot Disallow	27	11.16
Robots Disallow	21	8.68
Common Crawl Bot Disallow	1	0.41
AppleBot Disallow	1	0.41
Anthropic Claude Bot Disallow	1	0.41
Google Bard Disallow	1	0.41
Facebook Bot Disallow	1	0.41
Apple AI Bot Disallow	1	0.41
Microsoft MSNBot Disallow	1	0.41
Webz Omgili Disallow	1	0.41

242 Detections

of Robots.txt in Heard Island and McDonald Islands. Last updated 18th Dec 2024.

Googlebot Disallow is currently the most popular technology in this category.