A lot of those services aren’t doing realtime lookups – they often have their own local cache of the records that they’d use. And both registries and registrars do keep track of queries and will apply rate limits etc., on IPs / users that are abusing their systems We run a couple of public facing whois servers – one does use captcha, while the other uses rate limits per IP. Regards Michele -- Mr Michele Neylon Blacknight Solutions Hosting, Colocation & Domains http://www.blacknight.host/ http://blacknight.blog/ http://www.blacknight.press - get our latest news & media coverage http://www.technology.ie Intl. +353 (0) 59 9183072 Direct Dial: +353 (0)59 9183090 Social: http://mneylon.social Random Stuff: http://michele.irish ------------------------------- Blacknight Internet Solutions Ltd, Unit 12A,Barrowside Business Park,Sleaty Road,Graiguecullen,Carlow,R93 X265,Ireland Company No.: 370845 From: <gnso-rds-pdp-wg-bounces@icann.org> on behalf of Ayden Férdeline <icann@ferdeline.com> Reply-To: Ayden Férdeline <icann@ferdeline.com> Date: Wednesday 24 August 2016 at 23:58 To: Greg Shatan <gregshatanipc@gmail.com> Cc: RDS PDP WG <gnso-rds-pdp-wg@icann.org> Subject: Re: [gnso-rds-pdp-wg] For WG Review - Redlined Problem Statement If another anecdote is helpful, it took me all of one Google search to find a website which claims to be able to perform up to 2,500,000 WHOIS queries in as little as 5 days: https://www.whoisxmlapi.com/bulk-whois-lookup.php Another result was for an API that could perform 500 queries, free of charge, in as little as 15 minutes: https://jsonwhois.com/pricing I have not used either service, but it appears to be possible to perform bulk WHOIS queries without having to enter a CAPTCHA. - Ayden -------- Original Message -------- Subject: Re: [gnso-rds-pdp-wg] For WG Review - Redlined Problem Statement Local Time: August 24, 2016 11:44 PM UTC Time: August 24, 2016 10:44 PM From: gregshatanipc@gmail.com To: stephanie.perrin@mail.utoronto.ca gnso-rds-pdp-wg@icann.org Anecdotally, as a regular user of WHOISes, I would say that most if not all WHOIS access pages have "Captchas" or other bot-defenders. Not a direct answer to your question, perhaps, but at least an observation. GregBot On Wed, Aug 24, 2016 at 6:38 PM, Stephanie Perrin <stephanie.perrin@mail.utoronto.ca<mailto:stephanie.perrin@mail.utoronto.ca>> wrote: I too would like to heed Chuck's advice, but have a burning question: Do registries have any way of distinguishing between bots and people, in their citing of stats? If so, how? Could some kind of authentication protocol do this? thanks Stephanie On 2016-08-24 17:42, Ayden Férdeline wrote: I’m going to heed Chuck’s advice, but just to respond briefly to your message, Elaine, the number of queries you cited does not necessarily translate into human beings performing these searches. So to your comment that, “clearly people aware of whois are using it” – sure, but what is not clear to me from the figures you have extracted is how many unique individuals we talking about. - Ayden -------- Original Message -------- Subject: Re: [gnso-rds-pdp-wg] For WG Review - Redlined Problem Statement Local Time: August 24, 2016 10:28 PM UTC Time: August 24, 2016 9:28 PM From: elaine@donuts.email<mailto:elaine@donuts.email> To: gnso-rds-pdp-wg@icann.org<mailto:gnso-rds-pdp-wg@icann.org> I love statistics. Registries must self report whois look up data. https://www.icann.org/resources/pages/registry-reports For example, in .com April 2016 ALONE “Whois” Queries In Millions 15,000.3 Web-based Whois 6,960,159 Clearly people aware of whois are using it. On Tue, Aug 23, 2016 at 10:57 PM, Greg Shatan <gregshatanipc@gmail.com<mailto:gregshatanipc@gmail.com>> wrote: I've taken a deeper look at this 5% (or 8%) "awareness" number that is being bandied about. This is a misuse of the data. The question did not ask about awareness of WHOIS. The answer cannot be cited to demonstrate awareness of WHOIS; to do so is misleading. The more I look at the data, the less appropriate it is to cite as if it answers this question. As Mark Twain once said, "There are three kinds of lies. Lies, damned lies, and statistics." My primary conclusion after looking at the data is that it is useless to prove anything about "awareness of WHOIS." My secondary conclusion is that, even if one were to attempt extract some understanding of use of WHOIS (not even awareness, which is impossible), relying solely on the WHOIS subset is inappropriate and likely a significant underestimation of those who used WHOIS. First, this is a follow-up question to a users who had "tried to identify who created a particular website" (not "who owns a particular domain name," which would more likely lead to the use of WHOIS, since "who created a particular website" may have nothing to do with the question of domain ownership. Those who had tried were asked "What did you use to figure this out?" (i.e., figure out who "created a particular website"). It's unclear but possible thaqt only a single answer was allowed, even if the user used multiple tools. The fact that 5% or 8% chose to list their use of WHOIS to see who "created a particular website" (not "who owned a particular domain name") proves nothing about awareness of WHOIS among those who used other tools. Notably, WHOIS as an answer is grouped with other "Specific Site Search" answers - the rest being Google, Baidu, GoDaddy, DNS records and "other specific site search mentions." (The fact that "WHOIS" is listed as a "specific site search" is enough to make one question the validity of the analysis.) Of those who tried to figure who created a particular site, the greatest number turned to search engines -- not surprising among general users, as search is often the primary tool used to find out anything on the Internet. That does not in any way demonstrate their lack of awareness of WHOIS. Also, the WHOIS answer likely undercounts those who actually used WHOIS. There are other answers that may also refer to WHOIS, some with answers nearly as high as those who expressly identified WHOIS as the "specific site" they searched: Domain/IP Address search (5% in 2015, 5% in 2016) Online/Internet tools (Unspecified) (0%, 1%) Using specific sites that classify/provide information on sites (5%, 2%) Check registration/if it’s registered/certificate (2%, 2%) Research (Unspecified) (4%, 1%) GoDaddy (0%, less than 1%) TOTAL 16%, 11% It's impossible to know how many of these refer to WHOIS, but even a minority would double the percentage in each year. Finally, it's worth noting that the number who answered the same question with the answer "Google" were 10% in 2015 and 14% in 2016. It would be ludicrous to say that this indicates 10% "awareness" of Google in 2015 and 14% "awareness" of Google in 2016. Yet people somehow people feel comfortable applying this characterization to the WHOIS answer. I think this is a strong indication that Mark Twain was right. On Wed, Aug 24, 2016 at 12:55 AM, Winterfeldt, Brian J. <BWinterfeldt@mayerbrown.com<mailto:BWinterfeldt@mayerbrown.com>> wrote: +1 Susan also. Brian J. Winterfeldt Co-Head of Global Brand Management and Internet Practice Mayer Brown LLP bwinterfeldt@mayerbrown.com<mailto:bwinterfeldt@mayerbrown.com> 1999 K Street, NW Washington, DC 20006-1101 202.263.3284<tel:202.263.3284> direct dial 202.830.0330<tel:202.830.0330> fax 1221 Avenue of the Americas New York, New York 10020-1001 212.506.2345<tel:212.506.2345> direct dial On Aug 23, 2016, at 12:37 PM, Kiran Malancharuvil via gnso-rds-pdp-wg <gnso-rds-pdp-wg@icann.org<mailto:gnso-rds-pdp-wg@icann.org>> wrote: +1 Susan. Kiran Malancharuvil Policy Counselor MarkMonitor 415.222.8318<tel:415.222.8318> (t) 415.419.9138<tel:415.419.9138> (m) www.markmonitor.com<http://www.markmonitor.com> -----Original Message----- From: gnso-rds-pdp-wg-bounces@icann.org<mailto:gnso-rds-pdp-wg-bounces@icann.org> [mailto:gnso-rds-pdp-wg-bounces@icann.org] On Behalf Of Susan Kawaguchi Sent: Tuesday, August 23, 2016 9:35 AM To: Volker Greimann; gnso-rds-pdp-wg@icann.org<mailto:gnso-rds-pdp-wg@icann.org> Subject: Re: [gnso-rds-pdp-wg] For WG Review - Redlined Problem Statement Volker, I completely disagree with your statement most registrants do not even what whois isŠ. I might agree with most internet users do not know what registration data is or where to find it but a good portion of domain names are registered to commercial entities who completely understand the whois and use it daily for domain name management. I am sure you receive inquiries about whois from some registrants but I would guess the vast majority of registrants understand whois. Susan Kawaguchi Domain Name Manager Facebook Legal Dept. On 8/23/16, 9:27 AM, "gnso-rds-pdp-wg-bounces@icann.org<mailto:gnso-rds-pdp-wg-bounces@icann.org> on behalf of Volker Greimann" <gnso-rds-pdp-wg-bounces@icann.org<mailto:gnso-rds-pdp-wg-bounces@icann.org> on behalf of vgreimann@key-systems.net<mailto:vgreimann@key-systems.net>> wrote: I tend to agree. Most registrants do not even know what whois is... Volker Am 23.08.2016 um 18:17 schrieb Rob Golding: Are you suggesting that registrants do not have a vested interest in an RDS system? Correct - I believe they have a vested interest in there not being an RDS system Rob --- This email has been checked for viruses by Avast antivirus software. https://urldefense.proofpoint.com/v2/url?u=https-3A__www.avast.com_ant ivi rus&d=DQIF-g&c=5VD0RTtNlTh3ycd41b3MUw&r=gvEx8xF7ynrYQ7wShqEr-w&m=urT5C Zcn XwGvl43p6PPaxa7CQx8mZT7ZsafsbqAkLcc&s=zEmZ1lTVED4qGJFCLfh1cgrCvpUl5xhz j7Y HszgNSyg&e= _______________________________________________ gnso-rds-pdp-wg mailing list gnso-rds-pdp-wg@icann.org<mailto:gnso-rds-pdp-wg@icann.org> https://urldefense.proofpoint.com/v2/url?u=https-3A__mm.icann.org_mail man _listinfo_gnso-2Drds-2Dpdp-2Dwg&d=DQIF-g&c=5VD0RTtNlTh3ycd41b3MUw&r=gv Ex8 xF7ynrYQ7wShqEr-w&m=urT5CZcnXwGvl43p6PPaxa7CQx8mZT7ZsafsbqAkLcc&s=mQl2 M12 BbhsfrqiFs2wEm0WYIxRuKOmOPwf3fJvhD6w&e= -- Bei weiteren Fragen stehen wir Ihnen gerne zur Verfügung. Mit freundlichen Grüßen, Volker A. Greimann - Rechtsabteilung - Key-Systems GmbH Im Oberen Werk 1 66386 St. Ingbert Tel.: +49 (0) 6894 - 9396 901<tel:%2B49%20%280%29%206894%20-%209396%20901> Fax.: +49 (0) 6894 - 9396 851<tel:%2B49%20%280%29%206894%20-%209396%20851> Email: vgreimann@key-systems.net<mailto:vgreimann@key-systems.net> Web: www.key-systems.net<http://www.key-systems.net> / www.RRPproxy.net<http://www.rrpproxy.net> www.domaindiscount24.com<http://www.domaindiscount24.com> / www.BrandShelter.com<http://www.brandshelter.com> Folgen Sie uns bei Twitter oder werden Sie unser Fan bei Facebook: www.facebook.com/KeySystems<http://www.facebook.com/KeySystems> www.twitter.com/key_systems<http://www.twitter.com/key_systems> Geschäftsführer: Alexander Siffrin Handelsregister Nr.: HR B 18835 - Saarbruecken Umsatzsteuer ID.: DE211006534 Member of the KEYDRIVE GROUP www.keydrive.lu<http://www.keydrive.lu> Der Inhalt dieser Nachricht ist vertraulich und nur für den angegebenen Empfänger bestimmt. Jede Form der Kenntnisgabe, Veröffentlichung oder Weitergabe an Dritte durch den Empfänger ist unzulässig. Sollte diese Nachricht nicht für Sie bestimmt sein, so bitten wir Sie, sich mit uns per E-Mail oder telefonisch in Verbindung zu setzen. -------------------------------------------- Should you have any further questions, please do not hesitate to contact us. Best regards, Volker A. Greimann - legal department - Key-Systems GmbH Im Oberen Werk 1 66386 St. Ingbert Tel.: +49 (0) 6894 - 9396 901<tel:%2B49%20%280%29%206894%20-%209396%20901> Fax.: +49 (0) 6894 - 9396 851<tel:%2B49%20%280%29%206894%20-%209396%20851> Email: vgreimann@key-systems.net<mailto:vgreimann@key-systems.net> Web: www.key-systems.net<http://www.key-systems.net> / www.RRPproxy.net<http://www.rrpproxy.net> www.domaindiscount24.com<http://www.domaindiscount24.com> / www.BrandShelter.com<http://www.brandshelter.com> Follow us on Twitter or join our fan community on Facebook and stay updated: www.facebook.com/KeySystems<http://www.facebook.com/KeySystems> www.twitter.com/key_systems<http://www.twitter.com/key_systems> CEO: Alexander Siffrin Registration No.: HR B 18835 - Saarbruecken V.A.T. ID.: DE211006534 Member of the KEYDRIVE GROUP www.keydrive.lu<http://www.keydrive.lu> This e-mail and its attachments is intended only for the person to whom it is addressed. Furthermore it is not permitted to publish any content of this email. You must not use, disclose, copy, print or rely on this e-mail. If an addressing or transmission error has misdirected this e-mail, kindly notify the author by replying to this e-mail or contacting us by telephone. _______________________________________________ gnso-rds-pdp-wg mailing list gnso-rds-pdp-wg@icann.org<mailto:gnso-rds-pdp-wg@icann.org> https://urldefense.proofpoint.com/v2/url?u=https-3A__mm.icann.org_mailm an_ listinfo_gnso-2Drds-2Dpdp-2Dwg&d=DQIF-g&c=5VD0RTtNlTh3ycd41b3MUw&r=gvEx 8xF 7ynrYQ7wShqEr-w&m=urT5CZcnXwGvl43p6PPaxa7CQx8mZT7ZsafsbqAkLcc&s=mQl2M12 Bbh sfrqiFs2wEm0WYIxRuKOmOPwf3fJvhD6w&e= _______________________________________________ gnso-rds-pdp-wg mailing list gnso-rds-pdp-wg@icann.org<mailto:gnso-rds-pdp-wg@icann.org> https://mm.icann.org/mailman/listinfo/gnso-rds-pdp-wg _______________________________________________ gnso-rds-pdp-wg mailing list gnso-rds-pdp-wg@icann.org<mailto:gnso-rds-pdp-wg@icann.org> https://mm.icann.org/mailman/listinfo/gnso-rds-pdp-wg __________________________________________________________________________ This email and any files transmitted with it are intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the system manager. If you are not the named addressee you should not disseminate, distribute or copy this e-mail. _______________________________________________ gnso-rds-pdp-wg mailing list gnso-rds-pdp-wg@icann.org<mailto:gnso-rds-pdp-wg@icann.org> https://mm.icann.org/mailman/listinfo/gnso-rds-pdp-wg _______________________________________________ gnso-rds-pdp-wg mailing list gnso-rds-pdp-wg@icann.org<mailto:gnso-rds-pdp-wg@icann.org> https://mm.icann.org/mailman/listinfo/gnso-rds-pdp-wg -- [onuts Inc.]<http://www.donuts.domains> Elaine Pruis, Vice President, Operations Donuts Inc.<http://www.donuts.domains> 10500 NE 8th Street, Suite 350, Bellevue Washington, 98004, U.S.A. | Telephone: 509.899.3161[witter][acebook][inked In]<tel:509.899.3161> _______________________________________________ gnso-rds-pdp-wg mailing list gnso-rds-pdp-wg@icann.org<mailto:gnso-rds-pdp-wg@icann.org> https://mm.icann.org/mailman/listinfo/gnso-rds-pdp-wg _______________________________________________ gnso-rds-pdp-wg mailing list gnso-rds-pdp-wg@icann.org<mailto:gnso-rds-pdp-wg@icann.org> https://mm.icann.org/mailman/listinfo/gnso-rds-pdp-wg