Robots.txt Nutzungsverteilung In Kongo

Verteilung für Websites mit Robots.txt Technologien

Technologie	Websites	%
Robots Disallow	274	19,3
Googlebot Disallow	216	15,21
Google AdsBot Disallow	174	12,25
Yandex Bot Disallow	57	4,01
Alexa Bot Disallow	54	3,8
Yahoo Slurp Disallow	54	3,8
Microsoft BingBot Disallow	51	3,59
Soso Bot Disallow	51	3,59
Common Crawl Bot Disallow	42	2,96
GPTBot Disallow	41	2,89
AppleBot Disallow	37	2,61
Ahrefs Bot Disallow	36	2,54
Anthropic Claude Bot Disallow	36	2,54
Google Bard Disallow	36	2,54
Facebook Bot Disallow	36	2,54
Apple AI Bot Disallow	36	2,54
Perplexity	34	2,39
Google AdsBot Mobile Apps Disallow	33	2,32
Cohere AI Disallow	32	2,25
Majestic Bot Disallow	23	1,62
Semrush Bot Disallow	21	1,48
ByteDance Bytespider Disallow	6	0,42
Exalead Bot Disallow	6	0,42
Microsoft MSNBot Disallow	6	0,42
Webz Omgili Disallow	5	0,35
360 Bot Disallow	4	0,28
Google Image Bot Disallow	2	0,14
BuiltWithBot Disallow	2	0,14
Diffbot Disallow	2	0,14
Google News Bot Disallow	2	0,14
Google Video Bot Disallow	2	0,14
DuckDuckGo Bot Disallow	2	0,14
Google Favicon Disallow	2	0,14
Google API Bot Disallow	2	0,14
Google DuplexWeb Disallow	2	0,14
Youdao Bot Disallow	1	0,07