Robots.txt Usage Distribution

Distribution for websites using Robots.txt technologies

Top In Robots.txt Usage Distribution

Technology	Websites	%

0 Detections

of Robots.txt . Last updated 18th Dec 2024.

Top 1m Top 1,000,000 sites by traffic: 874,020
Top 100k Top 100,000 sites by traffic: 153,037
Top 10k Top 10,000 sites by traffic: 22,876
Entire Internet: 178,790,857
United States: 50,588,778
Germany: 7,237,838
United Kingdom: 4,740,717
Russia: 3,939,848
Australia: 3,044,952
Canada: 2,171,895
Italy: 1,870,671
France: 1,316,306
Brazil: 1,252,692
.co: 1,028,587
Netherlands: 1,027,984
Spain: 948,549
Japan: 886,466
Switzerland: 840,439
India: 776,532
China: 603,997
Poland: 489,698
New Zealand: 476,834
Belgium: 459,548
Sweden: 431,930
Austria: 369,196
.me: 368,341
Norway: 325,445
Mexico: 304,901
Denmark: 304,179
Czech Republic: 303,144
South Africa: 272,058
Ireland: 255,473
South Korea: 249,673
Romania: 230,520
Turkey: 228,394
.io: 227,045
Cocos Islands: 208,810
Finland: 201,548
Indonesia: 188,071
Philippines: 166,891
Portugal: 147,793
Taiwan: 139,650
Singapore: 135,643
Argentina: 128,286
Hungary: 115,422
Thailand: 111,114
Chile: 110,976
Hong Kong: 104,263
.tv: 104,119
Greece: 102,772
Ukraine: 99,253
Vietnam: 92,562
Israel: 85,209
Anguilla: 81,414
Slovakia: 78,092
UAE: 76,621
British Virgin Islands: 68,550
Malaysia: 65,963
Luxembourg: 59,396
Saudi Arabia: 42,806
Samoa: 40,273
Pakistan: 39,825
Lithuania: 37,943
Iran: 37,152
Bulgaria: 36,334
Estonia: 34,581
Iceland: 33,355
Latvia: 32,987
Cameroon: 32,485
Peru: 31,868
Slovenia: 30,838
Croatia: 23,682
Niue: 22,071
Puerto Rico: 21,131
Costa Rica: 20,786
Serbia: 19,357
Ecuador: 18,587
Belarus: 18,512
Nigeria: 17,007
Kenya: 16,943
Isle of Man: 16,818
Palau: 16,358
Uruguay: 16,270
Liechtenstein: 14,113
Tonga: 13,912
Dominican Republic: 13,526
Reunion: 13,272
Kazakhstan: 13,255
Malta: 12,419
Saint Vincent and the Grenadines: 11,798
Guernsey: 11,714
Morocco: 11,397
Bangladesh: 11,269
Guatemala: 10,794
Egypt: 10,244
Saint Helena: 10,043
Lebanon: 9,052
Panama: 8,892
Albania: 8,186
Georgia: 8,119
Sri Lanka: 8,077
Cyprus: 7,994
Venezuela: 7,745
Qatar: 6,859
Armenia: 6,711
Belize: 6,594
Ghana: 6,551
Uganda: 6,311
Tanzania: 6,201
Uzbekistan: 6,010
Somalia: 5,959
Micronesia: 5,803
Kuwait: 5,663
Nepal: 5,371
Jordan: 4,690
Moldova: 4,548
Macedonia: 4,533
Honduras: 4,490
Christmas Island: 4,346
Paraguay: 3,853
Mauritius: 3,784
Tunisia: 3,563
Guadeloupe: 3,557
Cambodia: 3,349
Bahamas: 3,314
El Salvador: 3,233
Mongolia: 3,157
Rwanda: 3,128
Azerbaijan: 3,110
Bahrain: 3,098
Monaco: 3,081
Bolivia: 3,057
Antigua and Barbuda: 2,948
Bosnia and Herzegovina: 2,931
Oman: 2,872
Namibia: 2,833
United States Virgin Islands: 2,741
Cayman Islands: 2,718
Algeria: 2,686
Zimbabwe: 2,508
Sao Tome and Principe: 2,482
Trinidad and Tobago: 2,365
Jersey: 2,330
Faroe Islands: 2,253
Jamaica: 2,215
Zambia: 2,153
Afghanistan: 2,151
Bermuda: 2,113
Ethiopia: 2,077
Nicaragua: 2,035
Seychelles: 1,984
Saint Pierre and Miquelon: 1,948
Montserrat: 1,824
Barbados: 1,744
Sint Maarten: 1,696
Myanmar: 1,662
Iraq: 1,620
Mozambique: 1,619
New Caledonia: 1,614
Maldives: 1,607
Andorra: 1,577
Cote d'Ivoire: 1,548
Angola: 1,464
Mayotte: 1,384
Fiji: 1,361
Martinique: 1,328
Botswana: 1,314
Congo: 1,304
Saint Lucia: 1,302
Senegal: 1,281
Turks and Caicos Islands: 1,258
Kyrgyzstan: 1,231
American Samoa: 1,207
Greenland: 1,148
Mali: 1,074
Madagascar: 1,038
Gibraltar: 1,016
Aruba: 936
Haiti: 915
Palestine: 887
Guyana: 887
Grenada: 864
South Georgia and the South Sandwich Islands: 844
Vanuatu: 706
Togo: 626
Malawi: 622
Burkina Faso: 596
Tajikistan: 587
Wallis and Futuna: 584
Gambia: 574
Cuba: 534
Djibouti: 498
Papua New Guinea: 462
Niger: 456
French Guiana: 448
Guam: 445
Brunei: 432
Åland Islands: 430
Benin: 417
Sierra Leone: 379
Suriname: 378
Solomon Islands: 349
Yemen: 338
East Timor: 336
Sudan: 300
Liberia: 297
Cook Islands: 292
Lao People's Democratic Republic: 282
French Polynesia: 265
Burundi: 263
San Marino: 248
Heard Island and McDonald Islands: 242
Libya: 232
Turkmenistan: 218
Syria: 188
Curacao: 184
Northern Mariana Islands: 184
Bhutan: 182
Swaziland: 180
Saint Kitts and Nevis: 162
Gabon: 160
Svalbard and Jan Mayen: 160
Lesotho: 148
Mauritania: 142
Dominica: 130
Macao: 128
United States Minor Outlying Islands: 84
Norfolk Island: 80
Cabo Verde: 79
Vatican City: 73
Congo: 69
Guinea: 69
Chad: 63
Kiribati: 61
Falkland Islands: 52
South Sudan: 52
Saint Barthélemy: 50
Guinea-Bissau: 48
Marshall Islands: 47
Pitcairn: 32
Nauru: 28
Antarctica: 23
Bonaire: 20
Eritrea: 16
Equatorial Guinea: 12

Robots.txt Usage Distribution

Distribution for websites using Robots.txt technologies

Top In Robots.txt Usage Distribution

0 Detections

Categories