Robot.txt Distribuzione dell'utilizzo in Cambogia

Distribuzione per siti web che utilizzano Robot.txt tecnologie

Tecnologia	Siti web	%
Googlebot Disallow	292	10,48
Google AdsBot Disallow	283	10,15
Google AdsBot Mobile Disallow	256	9,19
Robots Disallow	229	8,22
Baidu Bot Disallow	104	3,73
GPTBot Disallow	101	12,11
Sogou Bot Disallow	97	3,48
Anthropic Claude Bot Disallow	96	11,51
AppleBot Disallow	94	3,37
Google Bard Disallow	94	11,27
Google AdsBot Mobile Apps Disallow	94	3,37
Common Crawl Bot Disallow	93	11,15
Facebook Bot Disallow	93	11,15
Apple AI Bot Disallow	92	11,03
Perplexity	92	11,03
Cohere AI Disallow	91	10,91
Yandex Bot Disallow	76	2,73
Some Robots Disallow	75	2,69
Microsoft BingBot Disallow	69	2,48
Yahoo Slurp Disallow	63	2,26
Alexa Bot Disallow	61	7,31
Soso Bot Disallow	59	2,12
Ahrefs Bot Disallow	49	1,76
Google Media Partners Disallow	40 ^*	1,44
Semrush Bot Disallow	24	0,86
Majestic Bot Disallow	20	0,72
Google Image Bot Disallow	9	0,32
ByteDance Bytespider Disallow	6	0,72
Microsoft MSNBot Disallow	5	0,18
DuckDuckGo Bot Disallow	4	0,14
Exalead Bot Disallow	3	0,11
Webz Omgili Disallow	3	0,36
Google News Bot Disallow	3	0,11
Google Video Bot Disallow	3	0,11
Google Favicon Disallow	3	0,11
Google API Bot Disallow	3	0,11
Google DuplexWeb Disallow	3	0,11
Diffbot Disallow	2	0,24
YOU Disallow	1	0,12
Youdao Bot Disallow	1	0,04
Pipl Disallow	1	0,04