Building web scraper or doing marketing research you face a problem of obtaining domain lists for crawling. We collected and update them regularly for one of our projects and are happy to share. gTLD, ccTLD, and newgTLDs, everything in one place. According to Q4 2016 Domain Name Industry Brief, today approximately 329MM domain names registered worldwide in ccTLD, gTLD, and newGTLD zones. We have about 90% domains in our registered domains dataset.