I have a list with 100 million domain names like www.microsoft.com and would like to resolve the IP-number to www.microsoft.com
Running a local pdns server and query localhost using Python adns?
+1
A:
I'd probably use Twisted DNS libray to do the DNS resolution from Google's Public DNS (ip address: 8.8.8.8). It'd take some trial and error but I'd guess you could have at least a couple hundred outstanding queries going at once. Google's DNS infrastructure is designed to handle a huge load and Twisted is well suited to handling thousands of simultaneous asychronous operations.
Rakis
2010-09-13 19:17:24
... but trying to cram 100 million queries through any server at a high rate is likely to get your IP blacklisted and your ISP sent a nasty note.
Jim Garrison
2010-09-13 19:24:38
Ordinarily I'd agree with you but in this particular case if you were to call Google and ask for permission, I'll bet they'd say "Bring it!". Their DNS architecture is designed to handle extreme loads. A single machine pinging away as fast as it can won't make a dent.
Rakis
2010-09-13 19:46:22