Robots.txt Usage Distribution in Kyrgyzstan

Distribution for websites using Robots.txt technologies

Technology	Websites	%
Yandex Bot Disallow	269	21.85
Robots Disallow	220	17.87
Googlebot Disallow	212	17.22
Ahrefs Bot Disallow	42	3.41
Alexa Bot Disallow	42	3.41
Google AdsBot Disallow	40	3.25
Microsoft BingBot Disallow	38	3.09
Majestic Bot Disallow	37	3.01
Baidu Bot Disallow	33	2.68
Google AdsBot Mobile Disallow	32	2.6
Semrush Bot Disallow	32	2.6
Google Media Partners Disallow	30 ^*	2.44
Yahoo Slurp Disallow	28	2.27
Some Robots Disallow	24	1.95
Sogou Bot Disallow	24	1.95
Soso Bot Disallow	23	1.87
Microsoft MSNBot Disallow	17	1.38
GPTBot Disallow	14	1.14
Common Crawl Bot Disallow	9	0.73
Anthropic Claude Bot Disallow	8	0.65
Google Bard Disallow	8	0.65
AppleBot Disallow	7	0.57
Facebook Bot Disallow	6	0.49
Cohere AI Disallow	4	0.32
Google AdsBot Mobile Apps Disallow	4	0.32
ByteDance Bytespider Disallow	4	0.32
Apple AI Bot Disallow	3	0.24
Perplexity	3	0.24
Webz Omgili Disallow	3	0.24
Google Image Bot Disallow	3	0.24
Exalead Bot Disallow	2	0.16
360 Bot Disallow	2	0.16
DuckDuckGo Bot Disallow	2	0.16
Google Read Aloud Disallow	2	0.16
BuiltWithBot Disallow	1	0.08
Diffbot Disallow	1	0.08
Google Favicon Disallow	1	0.08
Google FeedFetcher Disallow	1	0.08