Robots.txt Distribución de uso en Bosnia y Herzegovina

Distribución para sitios web que utilizan Robots.txt tecnologías

Tecnología	Sitios web	%
Googlebot Disallow	268	9,14
Robots Disallow	268	9,14
Google AdsBot Disallow	228	7,78
Google AdsBot Mobile Disallow	158	5,39
Ahrefs Bot Disallow	154	5,25
GPTBot Disallow	120	4,09
Sogou Bot Disallow	119	4,06
Soso Bot Disallow	110	3,75
Common Crawl Bot Disallow	107	3,65
Baidu Bot Disallow	105	3,58
Majestic Bot Disallow	91	3,1
Yandex Bot Disallow	86	2,93
Semrush Bot Disallow	82	2,8
Yahoo Slurp Disallow	77	2,63
Alexa Bot Disallow	76	2,59
Microsoft BingBot Disallow	71	2,42
Google Bard Disallow	64	2,18
ByteDance Bytespider Disallow	62	2,12
Anthropic Claude Bot Disallow	60	2,05
Some Robots Disallow	59	2,01
Exalead Bot Disallow	59	2,01
Facebook Bot Disallow	57	1,94
AppleBot Disallow	56	1,91
Perplexity	55	1,88
360 Bot Disallow	52	1,77
BuiltWithBot Disallow	48	1,64
Cohere AI Disallow	46	1,57
Apple AI Bot Disallow	45	1,54
Google AdsBot Mobile Apps Disallow	44	1,5
Microsoft MSNBot Disallow	19	0,65
Google Image Bot Disallow	16	0,55
Google Media Partners Disallow	15 ^*	0,51
Webz Omgili Disallow	14	0,48
Diffbot Disallow	13	0,44
YOU Disallow	12	0,41
Google News Bot Disallow	2	0,07
Google Video Bot Disallow	2	0,07
DuckDuckGo Bot Disallow	2	0,07
Google Favicon Disallow	2	0,07
Google API Bot Disallow	2	0,07
Google DuplexWeb Disallow	2	0,07
Youdao Bot Disallow	1	0,03
Pipl Disallow	1	0,03
Google FeedFetcher Disallow	1	0,03