Robots.txt Répartition de l'utilisation dans Kirghizistan

Distribution pour les sites Web utilisant Robots.txt les technologies

Technologie	Sites Internet	%
Yandex Bot Disallow	291	21,32
Robots Disallow	280	20,51
Googlebot Disallow	205	15,02
Alexa Bot Disallow	47	3,44
Ahrefs Bot Disallow	47	3,44
Microsoft BingBot Disallow	45	3,3
Majestic Bot Disallow	42	3,08
Baidu Bot Disallow	36	2,64
Semrush Bot Disallow	35	2,56
Yahoo Slurp Disallow	34	2,49
Google Media Partners Disallow	34 ^*	2,49
Google AdsBot Disallow	32	2,34
Sogou Bot Disallow	29	2,12
Soso Bot Disallow	28	2,05
Some Robots Disallow	26	1,9
Google AdsBot Mobile Disallow	24	1,76
Microsoft MSNBot Disallow	19	1,39
GPTBot Disallow	18	1,32
Common Crawl Bot Disallow	12	0,88
Anthropic Claude Bot Disallow	10	0,73
AppleBot Disallow	9	0,66
Google Bard Disallow	9	0,66
Facebook Bot Disallow	7	0,51
Cohere AI Disallow	5	0,37
Google AdsBot Mobile Apps Disallow	5	0,37
ByteDance Bytespider Disallow	5	0,37
Apple AI Bot Disallow	4	0,29
Perplexity	4	0,29
Exalead Bot Disallow	3	0,22
Webz Omgili Disallow	3	0,22
360 Bot Disallow	3	0,22
Google Image Bot Disallow	3	0,22
BuiltWithBot Disallow	2	0,15
YOU Disallow	2	0,15
DuckDuckGo Bot Disallow	2	0,15
Google Read Aloud Disallow	2	0,15
Diffbot Disallow	1	0,07
Google Favicon Disallow	1	0,07
Google FeedFetcher Disallow	1	0,07