Log In · Signup for Free
EN  DE  FR  ES  IT  Pусский  한국어  日本語  简体中文  عربي

Robots.txt Usage Distribution unknown

Distribution for websites using Robots.txt technologies

Explain Chart
Top In Robots.txt Usage Distribution unknown
Technology Websites %

0 Detections

of Robots.txt unknown. Last updated 21st Apr 2025.

Top 1m
Top 1,000,000 sites by traffic
925,730
Top 100k
Top 100,000 sites by traffic
175,352
Top 10k
Top 10,000 sites by traffic
26,065
Entire Internet
163,527,539
United States
38,491,541
Germany
6,241,616
United Kingdom
3,602,631
Russia
3,220,836
Australia
2,329,217
Canada
1,648,466
France
1,177,363
Italy
1,091,153
Brazil
1,043,711
Netherlands
826,791
Spain
825,722
China
817,140
Switzerland
735,215
.co
726,155
India
711,693
Japan
649,802
PL Poland
439,082
BE Belgium
370,227
SE Sweden
356,084
NZ New Zealand
329,097
ME .me
325,584
AT Austria
320,813
CC Cocos Islands
306,869
CZ Czech Republic
271,800
NO Norway
268,637
MX Mexico
245,058
IO .io
235,114
DK Denmark
234,651
ZA South Africa
218,292
RO Romania
209,799
IE Ireland
206,083
KR South Korea
194,456
TR Turkey
189,297
ID Indonesia
173,887
FI Finland
156,095
PT Portugal
131,974
HU Hungary
126,488
PH Philippines
122,122
SG Singapore
97,422
TV .tv
95,688
AI Anguilla
91,368
GR Greece
88,652
CL Chile
87,647
UA Ukraine
83,817
AR Argentina
82,155
HK Hong Kong
81,085
TW Taiwan
78,707
VN Vietnam
73,154
TH Thailand
71,370
SK Slovakia
69,832
AE UAE
62,712
IL Israel
61,879
MY Malaysia
56,242
LU Luxembourg
49,428
VG British Virgin Islands
46,088
PK Pakistan
37,303
WS Samoa
34,850
SA Saudi Arabia
34,807
LT Lithuania
34,358
BG Bulgaria
30,523
SI Slovenia
29,429
EE Estonia
28,666
CM Cameroon
28,278
LV Latvia
27,940
PE Peru
27,364
IR Iran
27,262
IS Iceland
26,455
IM Isle of Man
20,132
EC Ecuador
19,542
HR Croatia
18,345
TO Tonga
17,474
NU Niue
17,078
RS Serbia
16,616
NG Nigeria
16,426
PW Palau
16,398
CR Costa Rica
16,103
PR Puerto Rico
16,058
KE Kenya
15,610
BY Belarus
14,816
RE Reunion
13,510
LI Liechtenstein
13,202
UY Uruguay
12,952
KZ Kazakhstan
12,551
BD Bangladesh
11,994
SH Saint Helena
11,968
GG Guernsey
11,408
VC Saint Vincent and the Grenadines
11,308
DO Dominican Republic
10,807
MA Morocco
10,137
MT Malta
10,032
EG Egypt
9,452
GT Guatemala
8,615
PM Saint Pierre and Miquelon
8,223
BZ Belize
8,007
AM Armenia
7,275
AL Albania
7,017
PA Panama
6,944
VE Venezuela
6,933
LB Lebanon
6,897
CY Cyprus
6,813
SO Somalia
6,683
GE Georgia
6,587
LK Sri Lanka
6,462
UG Uganda
6,375
UZ Uzbekistan
5,799
FM Micronesia
5,599
GH Ghana
5,502
QA Qatar
5,473
TZ Tanzania
4,810
CX Christmas Island
4,751
NP Nepal
4,665
KW Kuwait
4,438
MD Moldova
4,132
MK Macedonia
4,040
ET Ethiopia
4,024
JO Jordan
3,840
HN Honduras
3,587
PY Paraguay
3,245
TN Tunisia
3,046
MN Mongolia
3,041
GP Guadeloupe
3,035
AG Antigua and Barbuda
3,034
MU Mauritius
2,946
SV El Salvador
2,859
DZ Algeria
2,800
KH Cambodia
2,787
AZ Azerbaijan
2,758
RW Rwanda
2,732
BO Bolivia
2,694
BH Bahrain
2,678
BS Bahamas
2,671
ST Sao Tome and Principe
2,607
MC Monaco
2,555
OM Oman
2,510
BA Bosnia and Herzegovina
2,476
KY Cayman Islands
2,272
BM Bermuda
2,250
JE Jersey
2,039
NA Namibia
1,993
AF Afghanistan
1,934
SC Seychelles
1,913
FO Faroe Islands
1,886
ZW Zimbabwe
1,790
TT Trinidad and Tobago
1,779
SX Sint Maarten
1,747
VI United States Virgin Islands
1,706
ZM Zambia
1,705
JM Jamaica
1,699
AD Andorra
1,596
LC Saint Lucia
1,596
CI Cote d'Ivoire
1,512
MQ Martinique
1,505
MS Montserrat
1,449
IQ Iraq
1,433
YT Mayotte
1,389
NI Nicaragua
1,356
MV Maldives
1,329
MZ Mozambique
1,325
KG Kyrgyzstan
1,287
AS American Samoa
1,285
MM Myanmar
1,242
BB Barbados
1,224
NC New Caledonia
1,185
AO Angola
1,184
SN Senegal
1,178
GY Guyana
1,070
CD Congo
1,057
GD Grenada
1,053
GL Greenland
1,023
GI Gibraltar
1,005
MG Madagascar
996
BW Botswana
952
FJ Fiji
925
TC Turks and Caicos Islands
916
GS South Georgia and the South Sandwich Islands
855
AW Aruba
824
ML Mali
820
HT Haiti
803
PS Palestine
719
TG Togo
594
DJ Djibouti
577
TJ Tajikistan
569
BF Burkina Faso
541
GM Gambia
532
GF French Guiana
528
CU Cuba
526
MW Malawi
500
WF Wallis and Futuna
484
VU Vanuatu
469
BJ Benin
462
LR Liberia
399
NE Niger
396
BN Brunei
358
SL Sierra Leone
309
SB Solomon Islands
305
SR Suriname
303
PG Papua New Guinea
302
GU Guam
286
BI Burundi
282
SY Syria
273
AX Åland Islands
268
TL East Timor
265
LA Lao People's Democratic Republic
260
YE Yemen
255
SD Sudan
254
PF French Polynesia
220
LY Libya
214
TM Turkmenistan
203
HM Heard Island and McDonald Islands
198
BT Bhutan
197
SM San Marino
186
SZ Swaziland
159
LS Lesotho
157
KN Saint Kitts and Nevis
145
CK Cook Islands
133
MR Mauritania
125
GA Gabon
123
CW Curacao
119
MO Macao
116
NF Norfolk Island
102
SJ Svalbard and Jan Mayen
88
DM Dominica
85
MP Northern Mariana Islands
79
UM United States Minor Outlying Islands
74
CG Congo
66
TD Chad
49
GN Guinea
48
SS South Sudan
45
CV Cabo Verde
43
PN Pitcairn
41
KI Kiribati
38
FK Falkland Islands
28
MH Marshall Islands
28
AQ Antarctica
27
BL Saint Barthélemy
20
BQ Bonaire
20
GQ Equatorial Guinea
20
VA Vatican City
19
GW Guinea-Bissau
17
NR Nauru
15
Robots.txt Categories
All Robots.txt AI Bot