views:

249

answers:

3

Hi there,

I'm building a website that allows users to check the availability of international domain names, much like http://instantdomainsearch.com/ . My approach was to do a simple whois lookup on each request, but I'm now realizing that there are pretty harsh daily or hourly limits, e.g. http://www.dns.pl/english/whois.html#11 "Allowed average daily response limit is set to 100 regarding one IP address."

Is there a way to work around this issue? How do all these sites (e.g. www.whois.net etc.) offer this kind of service, without running into problems with the query limits?

Thanks in advance for any advice!

Martin

+1  A: 

The reason for the rate limiting by those guys is to charge a premium for a service, not because the infrastructure can't handle actual lookup requests. It's called a business model ;) :p

drachenstern
A: 

Don't use third party sites to do the query. There's a surprising amount of information on Wikipedia about WHOIS but if I were you, I'd just rig something up to call the GNU whois command (assuming this is on a *nix machine).

Pretty simple and no limits.

Oli
thans for your answer, I'm not using 3rd parties (so I though), this is what i was doing: The python code on my linux server is calling the whois command and reading it's response like this:r = subprocess.Popen(['whois', sdomain], stdout=subprocess.PIPE)response = r.stdout.read()still, when investigating the reply, I get 'quota exceeded' messages for some top-level domains...I'll have a go with dig then, though I don't think this will return 100% accurate results, as domains can be registered, but have no nameservers accociated with them?
Hoff
The limits are in the authoritative whois serveur (for instance the one for .PL in the example mentioned) so your advice is useless.
bortzmeyer
Calling GNU whois is not necessary since whois is an ultra-simple protocol, you can always reimplement it yourself. The hard part is parsing the result (which will be the same, whether you use GNU whois or a custom client).
bortzmeyer
A: 

Your question is not in the programming domain, as is the answer.

WHOIS sites maintain a database of domain information, that is not easy, nor cheap, data to maintain.

You have no (legal) programmatic way to overcome this issue. What I'm sure you can do is work out a plan with a respected WHOIS provider that will give you access to it's data, without quotas, for a periodic fee.

Yuval A