Robots.txt Usage Distribution in Iraq

Distribution for websites using Robots.txt technologies

Technology	Websites	%
Googlebot Disallow	303	19.37
Google AdsBot Disallow	300	19.18
Robots Disallow	166	10.61
Yandex Bot Disallow	114	7.29
Majestic Bot Disallow	95	6.07
Some Robots Disallow	60	3.84
Ahrefs Bot Disallow	57	3.64
Alexa Bot Disallow	33	2.11
Microsoft BingBot Disallow	32	2.05
AppleBot Disallow	31	1.98
Facebook Bot Disallow	30	1.92
GPTBot Disallow	29	1.85
Common Crawl Bot Disallow	29	1.85
Anthropic Claude Bot Disallow	29	1.85
Google Bard Disallow	29	1.85
Apple AI Bot Disallow	29	1.85
Yahoo Slurp Disallow	28	1.79
Perplexity	28	1.79
Google AdsBot Mobile Apps Disallow	27	1.73
Soso Bot Disallow	26	1.66
Cohere AI Disallow	26	1.66
Semrush Bot Disallow	18	1.15
Google Media Partners Disallow	15 ^*	0.96
Google Image Bot Disallow	6	0.38
Microsoft MSNBot Disallow	5	0.32
Exalead Bot Disallow	4	0.26
Webz Omgili Disallow	3	0.19
ByteDance Bytespider Disallow	2	0.13
Google News Bot Disallow	2	0.13
Google Video Bot Disallow	2	0.13
360 Bot Disallow	1	0.06
DuckDuckGo Bot Disallow	1	0.06
Youdao Bot Disallow	1	0.06
Google Favicon Disallow	1	0.06
Google API Bot Disallow	1	0.06
Google DuplexWeb Disallow	1	0.06