Skip to content
Roman's notes

Top domains lists

There are several lists of top domains on the internet. These lists are useful for various purposes, such as analyzing the most popular websites, creating a blacklist, or building a web crawler. Hsere are some of the most popular lists:

Tranco

You can use following bash script to download the top 5000 domains from Tranco list:

#!/bin/bash


# Retrieve the top 1m domain list from tranco-list.eu
ID=$(curl -sL https://tranco-list.eu/top-1m-id)
mkdir -p tmp
# Download the top 5000 domains (you can change number up to 1000000 domains)
curl -sL "https://tranco-list.eu/download/$ID/5000" -o tmp/domains.csv


# generate SQL lite db from the list
sqlite3 tmp/domains.s3db <<EOF
CREATE TABLE domains (rank INTEGER, domain TEXT);
.separator ","
.import tmp/domains.csv domains
EOF


mv tmp/domains.s3db top-5000-domains.s3db


rm -rf tmp

Script will generate top-5000-domains.s3db (a SQLLite database) contains table domains with columns rank and domain.

Cloudflare

Cisco Umbrella

Majestic

BuiltWith

Statvoo

DomCop