Log In · Signup for Free
EN  DE  FR  ES  IT  Pусский  한국어  日本語  简体中文  عربي

Robots.txt Usage Distribution unknown

Distribution for websites using Robots.txt technologies

Explain Chart
Top In Robots.txt Usage Distribution unknown
Technology Websites %

0 Detections

of Robots.txt unknown. Last updated 07th Mar 2025.

Top 1m
Top 1,000,000 sites by traffic
923,374
Top 100k
Top 100,000 sites by traffic
170,370
Top 10k
Top 10,000 sites by traffic
25,671
Entire Internet
177,919,343
United States
42,128,593
Germany
7,124,348
United Kingdom
4,267,474
Russia
3,680,714
Australia
2,711,102
Canada
1,905,573
Italy
1,470,511
France
1,309,650
Brazil
1,239,422
Netherlands
961,291
.co
945,877
Spain
903,860
Switzerland
850,271
Japan
834,627
India
793,674
China
793,330
PL Poland
491,752
BE Belgium
433,399
SE Sweden
412,991
NZ New Zealand
399,113
ME .me
376,073
AT Austria
364,565
NO Norway
302,583
CZ Czech Republic
300,127
CC Cocos Islands
298,992
MX Mexico
289,559
DK Denmark
280,367
IO .io
265,037
ZA South Africa
258,802
KR South Korea
247,298
IE Ireland
235,749
TR Turkey
227,950
RO Romania
226,764
ID Indonesia
188,050
FI Finland
180,428
PH Philippines
165,593
PT Portugal
144,453
HU Hungary
132,125
TW Taiwan
129,905
SG Singapore
120,129
AR Argentina
119,472
TV .tv
107,380
CL Chile
106,745
GR Greece
101,914
AI Anguilla
101,043
HK Hong Kong
96,272
UA Ukraine
92,938
TH Thailand
89,967
VN Vietnam
88,249
IL Israel
81,331
SK Slovakia
80,145
AE UAE
73,870
MY Malaysia
65,528
VG British Virgin Islands
64,812
LU Luxembourg
58,865
PK Pakistan
41,358
WS Samoa
40,749
SA Saudi Arabia
39,927
LT Lithuania
38,527
BG Bulgaria
34,547
IR Iran
34,044
SI Slovenia
33,029
EE Estonia
32,938
LV Latvia
31,955
CM Cameroon
31,699
IS Iceland
31,660
PE Peru
30,894
HR Croatia
21,951
IM Isle of Man
21,209
NU Niue
20,185
PR Puerto Rico
19,217
RS Serbia
18,903
CR Costa Rica
18,779
PW Palau
18,173
EC Ecuador
17,700
NG Nigeria
17,524
BY Belarus
16,900
KE Kenya
16,403
RE Reunion
15,557
UY Uruguay
15,462
LI Liechtenstein
14,968
TO Tonga
14,590
KZ Kazakhstan
13,212
GG Guernsey
13,143
VC Saint Vincent and the Grenadines
13,100
BD Bangladesh
12,727
SH Saint Helena
12,655
DO Dominican Republic
12,550
MA Morocco
11,318
MT Malta
11,144
EG Egypt
10,412
GT Guatemala
9,822
PM Saint Pierre and Miquelon
8,244
BZ Belize
8,103
PA Panama
7,975
AL Albania
7,837
LB Lebanon
7,813
GE Georgia
7,797
LK Sri Lanka
7,576
AM Armenia
7,531
VE Venezuela
7,482
CY Cyprus
7,452
SO Somalia
7,374
UG Uganda
6,704
QA Qatar
6,560
FM Micronesia
6,428
GH Ghana
6,237
UZ Uzbekistan
5,960
TZ Tanzania
5,468
CX Christmas Island
5,251
KW Kuwait
5,229
NP Nepal
5,037
MK Macedonia
4,590
MD Moldova
4,527
JO Jordan
4,437
HN Honduras
4,179
PY Paraguay
3,791
MU Mauritius
3,758
TN Tunisia
3,432
GP Guadeloupe
3,422
MN Mongolia
3,373
ET Ethiopia
3,243
AG Antigua and Barbuda
3,214
AZ Azerbaijan
3,208
SV El Salvador
3,100
BH Bahrain
3,097
KH Cambodia
3,027
BS Bahamas
2,976
DZ Algeria
2,944
BO Bolivia
2,934
OM Oman
2,841
MC Monaco
2,831
BA Bosnia and Herzegovina
2,751
ST Sao Tome and Principe
2,653
NA Namibia
2,472
RW Rwanda
2,463
JE Jersey
2,325
KY Cayman Islands
2,323
VI United States Virgin Islands
2,299
ZW Zimbabwe
2,290
FO Faroe Islands
2,204
TT Trinidad and Tobago
2,081
AF Afghanistan
2,059
ZM Zambia
2,045
SC Seychelles
1,994
JM Jamaica
1,958
SX Sint Maarten
1,892
MQ Martinique
1,871
BM Bermuda
1,764
CI Cote d'Ivoire
1,708
MS Montserrat
1,677
LC Saint Lucia
1,636
YT Mayotte
1,587
IQ Iraq
1,564
MV Maldives
1,558
AD Andorra
1,545
NC New Caledonia
1,529
MM Myanmar
1,527
MZ Mozambique
1,502
NI Nicaragua
1,499
AS American Samoa
1,451
BB Barbados
1,409
AO Angola
1,394
KG Kyrgyzstan
1,269
GD Grenada
1,266
GI Gibraltar
1,241
SN Senegal
1,200
FJ Fiji
1,151
BW Botswana
1,142
CD Congo
1,121
GL Greenland
1,095
TC Turks and Caicos Islands
1,093
GY Guyana
1,088
MG Madagascar
1,005
AW Aruba
926
GS South Georgia and the South Sandwich Islands
907
HT Haiti
856
PS Palestine
820
BF Burkina Faso
706
WF Wallis and Futuna
678
NE Niger
674
TG Togo
660
GF French Guiana
613
VU Vanuatu
591
GM Gambia
582
CU Cuba
572
TJ Tajikistan
556
ML Mali
546
MW Malawi
532
DJ Djibouti
458
BJ Benin
446
BN Brunei
394
SB Solomon Islands
360
SL Sierra Leone
358
PG Papua New Guinea
357
AX Åland Islands
351
SR Suriname
311
SY Syria
303
BI Burundi
295
SD Sudan
295
GU Guam
294
YE Yemen
293
TL East Timor
287
LA Lao People's Democratic Republic
273
LR Liberia
239
PF French Polynesia
238
HM Heard Island and McDonald Islands
223
TM Turkmenistan
222
LY Libya
217
SM San Marino
183
SZ Swaziland
163
LS Lesotho
159
CW Curacao
159
BT Bhutan
157
MR Mauritania
156
KN Saint Kitts and Nevis
150
CK Cook Islands
127
GA Gabon
125
SJ Svalbard and Jan Mayen
114
MO Macao
111
MP Northern Mariana Islands
110
DM Dominica
101
GN Guinea
82
UM United States Minor Outlying Islands
81
NF Norfolk Island
77
CG Congo
64
SS South Sudan
54
TD Chad
53
CV Cabo Verde
47
FK Falkland Islands
40
PN Pitcairn
39
KI Kiribati
33
BL Saint Barthélemy
30
MH Marshall Islands
30
GW Guinea-Bissau
28
AQ Antarctica
25
GQ Equatorial Guinea
22
BQ Bonaire
20
NR Nauru
18
VA Vatican City
18
Robots.txt Categories
All Robots.txt AI Bot