Robots.txt Nutzungsverteilung In Vatikanstadt

Verteilung für Websites mit Robots.txt Technologien

Technologie	Websites	%
Google Media Partners Disallow	17 ^*	26,15
Googlebot Disallow	3	4,62
Google AdsBot Disallow	3	4,62
Google AdsBot Mobile Disallow	3	4,62
Ahrefs Bot Disallow	3	4,62
Some Robots Disallow	2	3,08
Robots Disallow	2	3,08
Microsoft BingBot Disallow	2	3,08
GPTBot Disallow	2	3,08
Anthropic Claude Bot Disallow	2	3,08
Google AdsBot Mobile Apps Disallow	2	3,08
Majestic Bot Disallow	2	3,08
Semrush Bot Disallow	2	3,08
Microsoft MSNBot Disallow	2	3,08
Baidu Bot Disallow	1	1,54
Yandex Bot Disallow	1	1,54
Yahoo Slurp Disallow	1	1,54
Common Crawl Bot Disallow	1	1,54
AppleBot Disallow	1	1,54
Google Bard Disallow	1	1,54
Facebook Bot Disallow	1	1,54
Apple AI Bot Disallow	1	1,54
Cohere AI Disallow	1	1,54
Perplexity	1	1,54
ByteDance Bytespider Disallow	1	1,54
Google Image Bot Disallow	1	1,54
Google News Bot Disallow	1	1,54
Google Video Bot Disallow	1	1,54
DuckDuckGo Bot Disallow	1	1,54
Google Favicon Disallow	1	1,54
Google API Bot Disallow	1	1,54
Google DuplexWeb Disallow	1	1,54