Robot.txt Distribuzione dell'utilizzo in Danimarca

Distribuzione per siti web che utilizzano Robot.txt tecnologie

Tecnologia	Siti web	%
Google AdsBot Disallow	23.797	10,14
Ahrefs Bot Disallow	16.474	7,02
Googlebot Disallow	15.843	6,75
Google AdsBot Mobile Disallow	14.541	6,2
GPTBot Disallow	9.774	11,19
Common Crawl Bot Disallow	9.261	10,6
Robots Disallow	9.198	3,92
Anthropic Claude Bot Disallow	9.138	10,46
Majestic Bot Disallow	9.109	3,88
Google Bard Disallow	8.934	10,23
AppleBot Disallow	8.481	3,61
Facebook Bot Disallow	8.405	9,62
Cohere AI Disallow	8.193	9,38
Perplexity	8.170	9,35
Apple AI Bot Disallow	8.021	9,18
Microsoft BingBot Disallow	6.180	2,63
Google AdsBot Mobile Apps Disallow	6.138	2,62
Yandex Bot Disallow	6.012	2,56
Yahoo Slurp Disallow	5.811	2,48
Baidu Bot Disallow	5.215	2,22
Semrush Bot Disallow	4.750	2,02
Alexa Bot Disallow	4.214	4,82
Sogou Bot Disallow	4.118	1,75
Some Robots Disallow	3.605	1,54
Soso Bot Disallow	3.232	1,38
ByteDance Bytespider Disallow	2.965	3,39
Webz Omgili Disallow	2.894	3,31
Google Image Bot Disallow	2.514	1,07
Diffbot Disallow	2.201	2,52
YOU Disallow	2.158	2,47
Google Media Partners Disallow	1.300 ^*	0,55
Exalead Bot Disallow	1.204	0,51
Microsoft MSNBot Disallow	671	0,29
360 Bot Disallow	434	0,18
DuckDuckGo Bot Disallow	307	0,13
Google News Bot Disallow	276	0,12
Google Video Bot Disallow	272	0,12
Google Favicon Disallow	250	0,11
Google API Bot Disallow	232	0,1
Google DuplexWeb Disallow	215	0,09
BuiltWithBot Disallow	70	0,03
Pipl Disallow	67	0,03
Youdao Bot Disallow	5	0
Google FeedFetcher Disallow	2	0