Robots.txt Distribución de uso en Albania

Distribución para sitios web que utilizan Robots.txt tecnologías

Tecnología	Sitios web	%
Googlebot Disallow	691	8,44
Google AdsBot Disallow	674	8,23
Google AdsBot Mobile Disallow	472	5,77
Ahrefs Bot Disallow	462	5,64
Baidu Bot Disallow	418	5,11
Robots Disallow	418	5,11
Yandex Bot Disallow	357	4,36
Anthropic Claude Bot Disallow	336	4,1
GPTBot Disallow	266	3,25
Semrush Bot Disallow	263	3,21
Common Crawl Bot Disallow	260	3,18
Some Robots Disallow	254	3,1
Sogou Bot Disallow	248	3,03
Alexa Bot Disallow	224	2,74
Google Bard Disallow	223	2,72
AppleBot Disallow	222	2,71
Facebook Bot Disallow	216	2,64
Google AdsBot Mobile Apps Disallow	216	2,64
Apple AI Bot Disallow	211	2,58
Yahoo Slurp Disallow	210	2,57
Cohere AI Disallow	209	2,55
Microsoft BingBot Disallow	208	2,54
Perplexity	207	2,53
Soso Bot Disallow	206	2,52
Google Media Partners Disallow	164 ^*	2
Majestic Bot Disallow	148	1,81
Exalead Bot Disallow	71	0,87
Microsoft MSNBot Disallow	48	0,59
Webz Omgili Disallow	40	0,49
360 Bot Disallow	40	0,49
BuiltWithBot Disallow	33	0,4
Google Image Bot Disallow	27	0,33
YOU Disallow	20	0,24
ByteDance Bytespider Disallow	18	0,22
Google News Bot Disallow	16	0,2
Google Video Bot Disallow	16	0,2
DuckDuckGo Bot Disallow	16	0,2
Google Favicon Disallow	16	0,2
Google API Bot Disallow	16	0,2
Google DuplexWeb Disallow	16	0,2
Diffbot Disallow	6	0,07
Pipl Disallow	3	0,04
Youdao Bot Disallow	1	0,01