June 2018 - Gnso-rpm-data - lists.icann.org

Proposed Agenda and Documents: Meeting 07 June at 1600 UTC
by Julie Hedlund June 8, 2018

June 8, 2018

Dear Data Sub Team Members, In preparation for today’s meeting at 16:00 UTC (extended to 120 minutes), please see the proposed Sunrise & Claims survey questions from the Analysis Group in the following Google docs for discussion and comment. NOTE: please use the Google docs to avoid the confusion that would result from multiple redlined documents: Registry Operators: https://docs.google.com/document/d/13atDQ54Sf3ICNn1-thaSldhxB8XwCAq5w7lXiyp… Registrars: https://docs.google.com/document/d/1sVyYahCcRY8HGoIXOO2kJXy48gQnsbms2xFeAbD… TM/Brand Owners: https://docs.google.com/document/d/1yWzLPfI9o0D3vD09Nf8zudcLF4sChl4dvMV_fyg… Registrants: https://docs.google.com/document/d/18K-zhP541IGCR0bXJpBtdmWdpfQ6BbKhFZaaZsf… Potential Registrants: https://docs.google.com/document/d/1iY4KsWpioC8Sacs-pWurfnKxhOsiQA7YaSo1wux… Please see the proposed agenda for today’s meeting: 1. Review agenda 2. Discussion of the proposed survey questions and suggested changes by Analysis Group 3. AOB Please also see attached the RFP appendix that includes the original questions as developed by the Sub Team, which is also uploaded on the agenda wiki page here: https://community.icann.org/x/FysFBQ [community.icann.org] Best Regards, Mary, Julie, Ariel, and Berry

1 0

Re: [Gnso-rpm-data] [Ext] RE: Action Items from RPM Data Sub Team Meeting 06 June
by Julie Hedlund June 7, 2018

June 7, 2018

Thanks so much Kristine for your very helpful suggestion. Best, Julie From: "Dorrain, Kristine" <dorraink(a)amazon.com> Date: Wednesday, June 6, 2018 at 7:21 PM To: Julie Hedlund <julie.hedlund(a)icann.org>, "gnso-rpm-data(a)icann.org" <gnso-rpm-data(a)icann.org> Subject: [Ext] RE: Action Items from RPM Data Sub Team Meeting 06 June Thanks Julie and all~ Might I propose that we each *start with* the section we drafted? We should all absolutely weigh in on all sections, but we have each already dedicated time to these sections and we recall what we were trying to get at. I think the person that drafted the section is going to be best positioned to call out any issues and to make an initial assessment if items changed by the AG accurately reflect the group’s intent. Best, Kristine From: Gnso-rpm-data [mailto:gnso-rpm-data-bounces@icann.org] On Behalf Of Julie Hedlund Sent: Wednesday, June 06, 2018 12:24 PM To: gnso-rpm-data(a)icann.org Subject: [Gnso-rpm-data] Action Items from RPM Data Sub Team Meeting 06 June Dear RPM Data Sub Team members, Thank you very much to all of you who participated in today’s call. Here are the action items staff captured: Action Items: Staff: 1. Extend the meeting on 07 June at 1600 UTC by 30 minutes to 120 minutes total (done – calendar invite updated and sent) 2. Schedule a call on 08 June at 1600 UTC for 120 minutes (ongoing) 3. Schedule a contingency call on Monday 11 June at 1600 UTC for 120 minutes (ongoing) Sub Team members: Provide comments/suggestions/questions on the draft surveys. NOTE: please use the following Google docs to avoid the confusion that would result from multiple redlined documents: Registry Operators: https://docs.google.com/document/d/13atDQ54Sf3ICNn1-thaSldhxB8XwCAq5w7lXiyp… [docs.google.com] Registrars: https://docs.google.com/document/d/1sVyYahCcRY8HGoIXOO2kJXy48gQnsbms2xFeAbD… [docs.google.com] TM/Brand Owners: https://docs.google.com/document/d/1yWzLPfI9o0D3vD09Nf8zudcLF4sChl4dvMV_fyg… [docs.google.com] Registrants: https://docs.google.com/document/d/18K-zhP541IGCR0bXJpBtdmWdpfQ6BbKhFZaaZsf… [docs.google.com] Potential Registrants: https://docs.google.com/document/d/1iY4KsWpioC8Sacs-pWurfnKxhOsiQA7YaSo1wux… [docs.google.com] Staff will follow up with the brief notes that were captured and also post them to the wiki. Best regards, Mary, Ariel, Berry and Julie

1 0

Action Items from RPM Data Sub Team Meeting 06 June
by Julie Hedlund June 7, 2018

June 7, 2018

Dear RPM Data Sub Team members, Thank you very much to all of you who participated in today’s call. Here are the action items staff captured: Action Items: Staff: 1. Extend the meeting on 07 June at 1600 UTC by 30 minutes to 120 minutes total (done – calendar invite updated and sent) 2. Schedule a call on 08 June at 1600 UTC for 120 minutes (ongoing) 3. Schedule a contingency call on Monday 11 June at 1600 UTC for 120 minutes (ongoing) Sub Team members: Provide comments/suggestions/questions on the draft surveys. NOTE: please use the following Google docs to avoid the confusion that would result from multiple redlined documents: Registry Operators: https://docs.google.com/document/d/13atDQ54Sf3ICNn1-thaSldhxB8XwCAq5w7lXiyp… Registrars: https://docs.google.com/document/d/1sVyYahCcRY8HGoIXOO2kJXy48gQnsbms2xFeAbD… TM/Brand Owners: https://docs.google.com/document/d/1yWzLPfI9o0D3vD09Nf8zudcLF4sChl4dvMV_fyg… Registrants: https://docs.google.com/document/d/18K-zhP541IGCR0bXJpBtdmWdpfQ6BbKhFZaaZsf… Potential Registrants: https://docs.google.com/document/d/1iY4KsWpioC8Sacs-pWurfnKxhOsiQA7YaSo1wux… Staff will follow up with the brief notes that were captured and also post them to the wiki. Best regards, Mary, Ariel, Berry and Julie

2 1

Actions & Notes: RPM Data Sub Team 06 June 2018
by Ariel Liang June 7, 2018

June 7, 2018

Dear All, Please see below the action items and notes captured by staff from the Data Sub Team call held on 06 June 2018 (1700 UTC). Staff have posted to the wiki space the action items and notes. Please note that these will be high-level notes and are not meant as a substitute for the transcript or recording. The recording, AC chat, and attendance records are posted on the wiki at: https://community.icann.org/x/FysFBQ Best Regards, Ariel Ariel Xinyue Liang Policy Analyst | Washington, DC Internet Corporation for Assigned Names and Numbers (ICANN) ---------------- ACTION ITEMS For Sub Team: * Sub Team to provide comments/suggestions/questions on the draft surveys via Google docs to avoid the confusion that would result from multiple redlined documents. * Sub Team to discuss internally about Q12 and see whether specific additional questions/clarifications are needed. * Sub Team to suggest to AG additional options associated with Q12. * Sub Team to reference the elements in the original questions associated with Q16/17 and see whether/how to revise the wording. For AG: * AG to change 60 days to 30 days. For Staff: * Staff to extend the meeting on 07 June at 1600 UTC by 30 minutes to 120 minutes total (done – calendar invite updated and sent) * Staff to schedule a call on 08 June at 1600 UTC for 120 minutes (ongoing) * Staff to schedule a contingency call on Monday 11 June at 1600 UTC for 120 minutes NOTES Registry Operator Survey * General Comments: * Analysis Group (AG) made high level changes to reduce the number of open ended questions, remove leading questions, and simplify the language. Some original questions were removed. These high-level changes also apply to other surveys * Sub Team members Strongly favor allowing respondents to either not answer questions, or to indicate "Not Answering" in some gentle way. There is interest to aggregate the raw data, but some ROs may want to keep their survey responses confidential. Make it clear if the respondent skips certain questions, we still count their responses as valid. All questions will provide the option for the respondents to skip. * There should be one questionnaire going to one company, and we should avoid one RO sending back multiple responses if they manage multiple TLDs. * The current survey is quite long, so AG suggests dividing the survey into two parts, asking some ROs to respond one set, the other ROs to respond the other set. This approach may generate more responses in total. Sub Team feels that while this approach may be welcomed by the respondents, there may not be a big enough pool of ROs to do this. How valid the responses would be based on this approach? Sub Team don't want to send separate surveys to ROs but can parse the data once they are collected. * Sub Team would want to be able to quote responses that are text based. * Q1 * The question should ask the name of the respondent’s company/business? * This question can be removed; the intent is to it know the respondent. If this question remains, it should be optional. * Can we make the Q1 mandatory if the RO operates more than one TLD, so they can identify themselves? It may be useful to include such question. * The survey could ask ROs approximately how many TLDs that they operate, to provide more insight into the RO's operation. Or could provide a drop down, so large/medium/small ROs could identify themselves. * This question depends on how the RO selection is done. If specific ROs are invited to respond, it does not matter too much if they identify or not identify themselves. If a bulk invitation is sent to the RySG, for example, it would become more challenging, and the instruction needs to clarify that a RO only should complete one survey. * Staff believes that all registry operators will be asked to fill out the survey, i.e. no particular solicitation or invitation to some only * Q3/Q4 * This question may be reworded. Among the TLDs that you operate, what percentage approximately are community related, geo related, restricted by edibility terms? The intent of the question is to ask respondents to identify these specific TLDs that people have concerns with. * Perhaps lump in the IDN TLDs for the further consolidation of the questions. * Q7-Q9 * AG suggested to take out some of the pricing related questions to shorten the survey. Based on previous experience, such questions would be hard to answer by the ROs. Asking these questions in a survey instrument would be hard to illicit responses and may lead to higher dropout rate for the survey. * These are things (on premium pricing) that the Sub Team need to know. AG is willing to add questions back, with the caveat that it would raise potential issues of higher drop off rate. * Q7 * ROs do not know the names reserved in the TMCH. AG will revise the language. * Q8 * This question may potentially be removed if other pricing related questions are added in. * Q8a * This question may also be removed if other pricing related questions are added in. * Q9 * It has the same issue like Q7, as the RO has to establish premium pricing before launches. The RO does not know what is in the TMCH and wouldn't know whether they are eligible for Sunrise. ROs would not be able to answer this question. * The original question in the data table is a part of a series of questions. The Sub Team want to know whether the ROs consciously try to avoid situation where they price brand names as premium names. There are some allegations that ROs 'targeted' brand names. So the series questions aim to set the stage about sunrise pricing/premium pricing, and then lead to this question. * AG will redraft this question based on Sub Team input. * Q10 * This question should be placed before Q9, or merge with Q9. * Q11 * As some ROs read through the survey, they might get confused this question with the one related geo/community TLDs (e.g., Q22). Make it clear that they are not the same questions. * AG will consider merging Q11 and Q22 as they are related. * Q12 * It is a technical matter and want to make sure ROs understand the language when taking the survey. * The word "required" -- clarify that it is an already existing policy * References to the Spec may not be necessary. * ACTION ITEM: Sub Team to discuss internally about Q12 and see whether specific additional questions/clarifications are needed. * ACTION ITEM: Sub Team to suggest to AG additional options associated with Q12. * Q14 * ROs would not know the names in TMCH. So would Q14 be unanswerable? * This question tries to address the gap related to the quasi perpetual claims period. * Not sure whether this question is clear enough for the respondent. But from RO perspective, this would not be a confusing question. If a similar question is asked from the brand owners or other parties, the wording needs to be clarified. * The RO does not need to know what is in the TMCH in order to comply with the spec. * Q15 * ACTION ITEM: AG to change 60 days to 30 days. * Q16/Q17 * AG suggested a few outcomes based on the intent of the original question. * This question needs to be clarified so the respondent knows why they are being asked. Some respondent might believe that Sunrise period can be unlimited. * Should AG suggest different lengths of Sunrise period, or ask respondents what ideal length would be? * As to the comparison of 30 day and more than 30 day charts -- how can we make this comparative? One could see answering all 30 days as GREAT and all More than 30 days as GREAT -- which tells us nothing. * Could we also ask the general question: Do you believe increasing the 30 day period would improve any of these results? How many days would you suggest? * Q16/17 do not seem to reflect the balance concerning all parties in the original question. * Should this question be deleted? There is a potential to turn the original open-ended questions into quantifiable questions. It may be helpful to come up with some alternative wordings for this question, as data is needed. Sub Team want the respondents to provide data, but also give feedback, so they would know what to do differently. AG should read deeper into the questions and see what they can pull from the responses. * ACTION ITEM: Sub Team to reference the elements in the original questions associated with Q16/17 and see whether/how to revise the wording. Procedure Matters * Sub Team would need to homework in order to provide targeted input for AG. * We cannot sacrifice the quality of surveys just to meet the timeline. This is not the place to cut the corner, so we may need to have more calls. Taking the time now to ensure the BEST survey and metrics will dramatically reduce the time spent "discussing" reality based on narrative, perception, and preconceptions. * The RFP / contract includes the timeline. There is flexibility, but the contract contemplates that Analysis Group's work will be more or less completed by August. * ACTION ITEM: * Staff to extend the meeting on 07 June at 1600 UTC by 30 minutes to 120 minutes total (done – calendar invite updated and sent) * Staff to schedule a call on 08 June at 1600 UTC for 120 minutes (ongoing) * Staff to schedule a contingency call on Monday 11 June at 1600 UTC for 120 minutes * Sub Team to provide comments/suggestions/questions on the draft surveys via Google docs to avoid the confusion that would result from multiple redlined documents.

1 0

Recording, Attendance & AC Chat / RPM Sub Team for Data Call / Wednesday, 06 June 2018 at 17:00 UTC
by Andrea Glandon June 7, 2018

June 7, 2018

Dear All, Please find the attendance and AC chat of the call attached to this email, and the MP3 and AC recording below for the Review of all Rights Protection Mechanisms (RPMs) Sub Team for Data call held Wednesday, 06 June 2018 at 17:00 UTC. Attendance of the call is also posted on the agenda wiki page: https://community.icann.org/x/FysFBQ MP3: https://audio.icann.org/gnso/gnso-rpm-review-data-06jun18-en.mp3 <https://urldefense.proofpoint.com/v2/url?u=https-3A__audio.icann.org_gnso_g…> AC Recording: https://participate.icann.org/p5lozwx59jj/<https://participate.icann.org/p5lozwx59jj/?OWASP_CSRFTOKEN=b26ccfc1d7ce5fa0…> The recordings and transcriptions of the calls are posted on the GNSO Master Calendar page: https://gnso.icann.org/en/group-activities/calendar [gnso.icann.org]<https://urldefense.proofpoint.com/v2/url?u=https-3A__gnso.icann.org_en_grou…> ** Please let me know if your name has been left off the list ** Mailing list archives: http://mm.icann.org/pipermail/gnso-rpm-data/ Main wiki page for the working group: https://community.icann.org/x/eI1EB [community.icann.org]<https://urldefense.proofpoint.com/v2/url?u=https-3A__community.icann.org_x_…> Thank you. Kind Regards, Andrea Glandon

1 0

Re: [Gnso-rpm-data] Please postpone today's call
by Julie Hedlund June 7, 2018

June 7, 2018

Hi Susan, Lori, and Kristine (and Sub Team members), Thank you for your request and perhaps staff can provide some further explanation for why we are pressed for time. But first, staff should clarify that it was not expected that the Sub Team members would have read through and analyzed all of the materials from Analysis Group by today’s meeting. Given that the deadline for Analysis Group to provide the draft surveys was to be 05 June, that timeline in any case would not have provided enough time for the Sub Team members to review all of the materials. Instead, it was the staff’s understanding that the purpose of the calls today and tomorrow was to review the draft surveys and address the comments and questions from Analysis Group during the call. Second, it is the timeline, which is part of the RFP, that is driving this work. According to the timeline the Sub Team must provide its feedback to Analysis Group by this Friday, in order for Analysis Group to provide the final surveys to the WG by next Wednesday, 13 June, and then for Analysis Group to be able to start sending the surveys by 20 June. If we slip even by a few days we will not be able to meet the deadline of getting the surveys out by the end of the month. If we don't get the surveys out by the end of the month (which is predicated on AG getting the feedback this week), we won't get the results back by August and a report by September at the latest to review - which pushes out the development of initial recommendations. We do realize the challenges in this process and staff will do everything possible to help the review of the draft surveys go as smoothly as possible. However, given that today’s call is already scheduled with many Sub Team members expecting to attend, staff would suggest that the Sub Team can use the call as noted above to review the draft surveys and work with Analysis Group to address the questions. The work can continue on tomorrow’s call if needed. Following both calls staff will send the comments to the Sub Team to review before they are sent to Analysis Group on Friday. Kind regards, Mary, Ariel, Berry, and Julie From: Gnso-rpm-data <gnso-rpm-data-bounces(a)icann.org> on behalf of "Dorrain, Kristine via Gnso-rpm-data" <gnso-rpm-data(a)icann.org> Reply-To: "Dorrain, Kristine" <dorraink(a)amazon.com> Date: Wednesday, June 6, 2018 at 11:05 AM To: Lori Schulman <lschulman(a)inta.org>, Susan Payne <susan.payne(a)valideus.com>, Ariel Liang <ariel.liang(a)icann.org>, "gnso-rpm-data(a)icann.org" <gnso-rpm-data(a)icann.org> Subject: Re: [Gnso-rpm-data] Please postpone today's call Hi everyone, I also support postponing the call. As I am one of the west-coasters, I just came in to the email which I cannot get through before our scheduled call today, particularly in light of the RySG call this morning. I don’t think this time will be well-used if we’re looking at the docs together for the first time. Best, Kristine From: Gnso-rpm-data [mailto:gnso-rpm-data-bounces@icann.org] On Behalf Of Lori Schulman Sent: Wednesday, June 06, 2018 7:37 AM To: Susan Payne <susan.payne(a)valideus.com>; Ariel Liang <ariel.liang(a)icann.org>; gnso-rpm-data(a)icann.org Subject: Re: [Gnso-rpm-data] Please postpone today's call Dear All, I echo Susan’s concerns. I will not be making the call this afternoon as I believe that we cannot possibly be prepared. It’s 10:30 am my time and I cannot get through this by 1 pm given my other priorities at the moment. I strongly believe that we need a “rethink” on how we will proceed and do plan on attending tomorrow’s call in which have held slot. Lori Lori S. Schulman Senior Director, Internet Policy International Trademark Association (INTA) +1-202-704-0408, Skype: lsschulman From: Gnso-rpm-data [mailto:gnso-rpm-data-bounces@icann.org] On Behalf Of Susan Payne Sent: Wednesday, June 06, 2018 10:29 AM To: Ariel Liang <ariel.liang(a)icann.org>; gnso-rpm-data(a)icann.org Subject: [Gnso-rpm-data] Please postpone today's call Importance: High All Apologies in advance for being blunt. I am not seeking to cast blame on anyone, but I am extremely concerned that this exercise is being pushed forward with such haste. It is completely unreasonable and unrealistic to expect us all to have read all these documents, considered the extensive redlines and comments, and be in a position to discuss this meaningfully in the space of 4 hours from them landing in our Inboxes. Half of our subgroup are on the US West Coast – they are only just waking up so they don’t even get that long! I may have the advantage of this being the middle of my working day, but I still have multiple other calls on my time this afternoon. The meeting later this afternoon was set when we were due to receive these documents on Tuesday. Frankly, even that was a ludicrously short turn-around time, but that’s academic, since we didn’t receive the documents on Tuesday (and just to be clear, I’m not blaming AG for missing the deadline – they also have been given a wholly unrealistic timeline). I know that there is pressure to move this survey exercise along. I’ve been vocal myself about concerns on the WG timeline, but those concerns have been as much about the need to be realistic about what tasks should be undertaken and how long they will take. The RFP exercise to appoint AG has taken months (which is no surprise to me). It’s unfair and false economy to try to make up the time by truncating the preparatory work on the actual surveys. It’s wholly unreasonable to allow only 2-3 weeks for AG to review the initial input from the Subteam, create surveys, discuss and finalise with the Subteam, identify survey respondents, report to the full WG, and get these surveys deployed. We seem to be working towards a completely arbitrary date for reporting to the full WG – what is the reason for this 13 June deadline? We aren’t discussing on a WG call before, or during Panama, so what’s the justification for this? Whilst I have strongly questioned the value of this whole exercise from the outset, I, and the others on this subgroup, have also made a commitment to do what we can to try to ensure that some useful information will be generated. Without adequate consideration and input into the surveys before they are launched we are setting this whole exercise up for failure, which will be a shameful waste of the time spent to date and ICANN’s financial resources. Susan Payne Head of Legal Policy | Valideus Ltd E: susan.payne(a)valideus.com D: +44 20 7421 8255 T: +44 20 7421 8299 M: +44 7971 661175 From: Gnso-rpm-data [mailto:gnso-rpm-data-bounces@icann.org] On Behalf Of Ariel Liang Sent: 06 June 2018 14:00 To: gnso-rpm-data(a)icann.org Subject: [Gnso-rpm-data] Proposed Sunrise & Claims Survey Questions Dear Data Sub Team Members, In preparation for today’s meeting at 17:00 UTC, please find attached the redline and clean versions of the proposed Sunrise & Claims survey questions from the Analysis Group. Kindly see below the text provided by the Analysis Group to accompany the files. Apologies for the short time window for circulating the proposed survey questions, and we hope you will have a chance to review them prior to the call. Please see the proposed agenda for today’s meeting below: 1. Review agenda 2. Discussion of the proposed survey questions and suggested changes by Analysis Group 3. AOB All files attached to this email are also uploaded on the agenda wiki page here: https://community.icann.org/x/FysFBQ [community.icann.org] Best Regards, Mary, Julie, Ariel, and Berry ---------- Text from Analysis Group -------- Dear All, Attached please find our suggested revisions to the survey questions for each target group of the RPM survey (and, for reference, the Word version of the appendix to the RFP). We copied the questions from the RFP appendix into a Word document to follow a questionnaire format and have suggested edits to the survey in redline. We have also attached a clean version of each revised document. It may be easiest to review the clean version of our documents next to the RFP appendix, as the versions with tracked changes can be more difficult to follow. Please note that there may be minor formatting inconsistencies across the documents, as well as some minor differences in similar questions. We will clean these up this week, but wanted to provide you with the revised questions as soon as possible. As we discussed last week, the goal of our proposed edits is to limit the length of the survey while still allowing the capture of as much information as possible. To the extent possible, we converted open-ended questions to multiple choice. In some instances, we would like to request assistance with defining the multiple choice answers. In those instances, we have placed the request in double square brackets and highlighted the text in yellow. For some "anecdotal" questions, we could not think of an easy or clear way to translate the questions into closed-end responses. In those cases, we will allow open-text responses (marked by "open text field" responses). We removed some questions from several of the surveys, but believe more should still be removed from both the registry and trademark holder surveys. We have noted this in the relevant Word documents, and are hoping you can assist us in identifying several questions in each survey to remove. Best, Stacey and Greg Stacey Chan, Ph.D. | Manager Analysis Group, Inc. | Economic, Financial, and Strategy Consulting 1900 16th Street, Suite 1100, Denver, CO 80202 720-963-5307 (direct) | 720-963-5300 (main) stacey.chan(a)analysisgroup.com l www.analysisgroup.com [analysisgroup.com]

3 2

Please postpone today's call
by Susan Payne June 7, 2018

June 7, 2018

All Apologies in advance for being blunt. I am not seeking to cast blame on anyone, but I am extremely concerned that this exercise is being pushed forward with such haste. It is completely unreasonable and unrealistic to expect us all to have read all these documents, considered the extensive redlines and comments, and be in a position to discuss this meaningfully in the space of 4 hours from them landing in our Inboxes. Half of our subgroup are on the US West Coast – they are only just waking up so they don’t even get that long! I may have the advantage of this being the middle of my working day, but I still have multiple other calls on my time this afternoon. The meeting later this afternoon was set when we were due to receive these documents on Tuesday. Frankly, even that was a ludicrously short turn-around time, but that’s academic, since we didn’t receive the documents on Tuesday (and just to be clear, I’m not blaming AG for missing the deadline – they also have been given a wholly unrealistic timeline). I know that there is pressure to move this survey exercise along. I’ve been vocal myself about concerns on the WG timeline, but those concerns have been as much about the need to be realistic about what tasks should be undertaken and how long they will take. The RFP exercise to appoint AG has taken months (which is no surprise to me). It’s unfair and false economy to try to make up the time by truncating the preparatory work on the actual surveys. It’s wholly unreasonable to allow only 2-3 weeks for AG to review the initial input from the Subteam, create surveys, discuss and finalise with the Subteam, identify survey respondents, report to the full WG, and get these surveys deployed. We seem to be working towards a completely arbitrary date for reporting to the full WG – what is the reason for this 13 June deadline? We aren’t discussing on a WG call before, or during Panama, so what’s the justification for this? Whilst I have strongly questioned the value of this whole exercise from the outset, I, and the others on this subgroup, have also made a commitment to do what we can to try to ensure that some useful information will be generated. Without adequate consideration and input into the surveys before they are launched we are setting this whole exercise up for failure, which will be a shameful waste of the time spent to date and ICANN’s financial resources. Susan Payne Head of Legal Policy | Valideus Ltd E: susan.payne(a)valideus.com<mailto:susan.payne@valideus.com> D: +44 20 7421 8255 T: +44 20 7421 8299 M: +44 7971 661175 From: Gnso-rpm-data [mailto:gnso-rpm-data-bounces@icann.org] On Behalf Of Ariel Liang Sent: 06 June 2018 14:00 To: gnso-rpm-data(a)icann.org Subject: [Gnso-rpm-data] Proposed Sunrise & Claims Survey Questions Dear Data Sub Team Members, In preparation for today’s meeting at 17:00 UTC, please find attached the redline and clean versions of the proposed Sunrise & Claims survey questions from the Analysis Group. Kindly see below the text provided by the Analysis Group to accompany the files. Apologies for the short time window for circulating the proposed survey questions, and we hope you will have a chance to review them prior to the call. Please see the proposed agenda for today’s meeting below: 1. Review agenda 2. Discussion of the proposed survey questions and suggested changes by Analysis Group 3. AOB All files attached to this email are also uploaded on the agenda wiki page here: https://community.icann.org/x/FysFBQ Best Regards, Mary, Julie, Ariel, and Berry ---------- Text from Analysis Group -------- Dear All, Attached please find our suggested revisions to the survey questions for each target group of the RPM survey (and, for reference, the Word version of the appendix to the RFP). We copied the questions from the RFP appendix into a Word document to follow a questionnaire format and have suggested edits to the survey in redline. We have also attached a clean version of each revised document. It may be easiest to review the clean version of our documents next to the RFP appendix, as the versions with tracked changes can be more difficult to follow. Please note that there may be minor formatting inconsistencies across the documents, as well as some minor differences in similar questions. We will clean these up this week, but wanted to provide you with the revised questions as soon as possible. As we discussed last week, the goal of our proposed edits is to limit the length of the survey while still allowing the capture of as much information as possible. To the extent possible, we converted open-ended questions to multiple choice. In some instances, we would like to request assistance with defining the multiple choice answers. In those instances, we have placed the request in double square brackets and highlighted the text in yellow. For some "anecdotal" questions, we could not think of an easy or clear way to translate the questions into closed-end responses. In those cases, we will allow open-text responses (marked by "open text field" responses). We removed some questions from several of the surveys, but believe more should still be removed from both the registry and trademark holder surveys. We have noted this in the relevant Word documents, and are hoping you can assist us in identifying several questions in each survey to remove. Best, Stacey and Greg Stacey Chan, Ph.D. | Manager Analysis Group, Inc. | Economic, Financial, and Strategy Consulting 1900 16th Street, Suite 1100, Denver, CO 80202 720-963-5307 (direct) | 720-963-5300 (main) stacey.chan(a)analysisgroup.com<mailto:stacey.chan@analysisgroup.com> l www.analysisgroup.com<http://www.analysisgroup.com>

4 3

Proposed Sunrise & Claims Survey Questions
by Ariel Liang June 6, 2018

June 6, 2018

Dear Data Sub Team Members, In preparation for today’s meeting at 17:00 UTC, please find attached the redline and clean versions of the proposed Sunrise & Claims survey questions from the Analysis Group. Kindly see below the text provided by the Analysis Group to accompany the files. Apologies for the short time window for circulating the proposed survey questions, and we hope you will have a chance to review them prior to the call. Please see the proposed agenda for today’s meeting below: 1. Review agenda 2. Discussion of the proposed survey questions and suggested changes by Analysis Group 3. AOB All files attached to this email are also uploaded on the agenda wiki page here: https://community.icann.org/x/FysFBQ Best Regards, Mary, Julie, Ariel, and Berry ---------- Text from Analysis Group -------- Dear All, Attached please find our suggested revisions to the survey questions for each target group of the RPM survey (and, for reference, the Word version of the appendix to the RFP). We copied the questions from the RFP appendix into a Word document to follow a questionnaire format and have suggested edits to the survey in redline. We have also attached a clean version of each revised document. It may be easiest to review the clean version of our documents next to the RFP appendix, as the versions with tracked changes can be more difficult to follow. Please note that there may be minor formatting inconsistencies across the documents, as well as some minor differences in similar questions. We will clean these up this week, but wanted to provide you with the revised questions as soon as possible. As we discussed last week, the goal of our proposed edits is to limit the length of the survey while still allowing the capture of as much information as possible. To the extent possible, we converted open-ended questions to multiple choice. In some instances, we would like to request assistance with defining the multiple choice answers. In those instances, we have placed the request in double square brackets and highlighted the text in yellow. For some "anecdotal" questions, we could not think of an easy or clear way to translate the questions into closed-end responses. In those cases, we will allow open-text responses (marked by "open text field" responses). We removed some questions from several of the surveys, but believe more should still be removed from both the registry and trademark holder surveys. We have noted this in the relevant Word documents, and are hoping you can assist us in identifying several questions in each survey to remove. Best, Stacey and Greg Stacey Chan, Ph.D. | Manager Analysis Group, Inc. | Economic, Financial, and Strategy Consulting 1900 16th Street, Suite 1100, Denver, CO 80202 720-963-5307 (direct) | 720-963-5300 (main) stacey.chan(a)analysisgroup.com<mailto:stacey.chan@analysisgroup.com> l www.analysisgroup.com

1 0

Re: [Gnso-rpm-data] [Ext] RE: Meeting Schedule re: / Doodle / RPMs Data Sub Team
by Julie Hedlund June 2, 2018

June 2, 2018

Hi Susan, With the WG call cancelled on Wednesday, we’ll now have 5 people (with Phil and Kathy) who can join on Wednesday. Also, the concern is that meeting Friday may not allow enough time for comments to be finalized by the Friday deadline. Thus, the Co-Chairs suggested going with Wednesday and Thursday. Kind regards, Julie From: Susan Payne <susan.payne(a)valideus.com> Date: Friday, June 1, 2018 at 1:31 PM To: Julie Hedlund <julie.hedlund(a)icann.org>, "gnso-rpm-data(a)icann.org" <gnso-rpm-data(a)icann.org> Cc: "gnso-secs(a)icann.org" <gnso-secs(a)icann.org> Subject: [Ext] RE: Meeting Schedule re: / Doodle / RPMs Data Sub Team Hi all, based on the responses to the Doodle Poll that does not seem ideal. Only 3 people indicated they can join the call on Weds, compared to 5 on Thurs and 6 on Fri. S Susan Payne Head of Legal Policy | Valideus Ltd E: susan.payne(a)valideus.com D: +44 20 7421 8255 T: +44 20 7421 8299 M: +44 7971 661175 From: Gnso-rpm-data [mailto:gnso-rpm-data-bounces@icann.org] On Behalf Of Julie Hedlund Sent: 01 June 2018 18:17 To: gnso-rpm-data(a)icann.org Cc: gnso-secs(a)icann.org Subject: [Gnso-rpm-data] Meeting Schedule re: / Doodle / RPMs Data Sub Team Dear Data Sub Team members, Thank you to those of you who completed the Doodle. After reviewing the responses to the Doodle, consulting with the RPM WG Co-Chairs, and considering the deadline to provide comments to Analysis Group by Friday, 08 June, it was decided to schedule two Data Sub Team calls for next week as follows: Wednesday, 06 June: 1700-1830 UTC (instead of a full WG meeting), and Thursday, 07 June: 1600-1730 UTC Note that if the work can be completed on Wednesday, we’ll cancel the Thursday call. Holding the meetings on Wednesday and Thursday (as opposed to Thursday and Friday) would ensure that comments can provided to Analysis Group as early as possible on Friday, 08 June. Best regards, Mary, Ariel, Berry, and Julie From: Ntfy-gnso-rpm-data <ntfy-gnso-rpm-data-bounces(a)icann.org> on behalf of Julie Bisland <julie.bisland(a)icann.org> Date: Thursday, May 31, 2018 at 7:19 PM To: "ntfy-gnso-rpm-data(a)icann.org" <ntfy-gnso-rpm-data(a)icann.org> Cc: "gnso-secs(a)icann.org" <gnso-secs(a)icann.org> Subject: [Ntfy-gnso-rpm-data] **REMINDER** / Doodle / RPMs Data Sub Team Dear Data Sub Team members, Please complete the following Doodle poll to identify an appropriate date and time for the next Data Sub Team call. Note that the times will automatically adjust for your time zone. Doodle: https://doodle.com/poll/7np4vqtxhwegutg2 [doodle.com] Kind regards, Julie Julie Bisland Secretariat Operations Coordinator for the GNSO Internet Corporation for Assigned Names and Numbers (ICANN) Email: julie.bisland(a)icann.org Skype ID: 79613b691cb8a6c1 Find out more about the GNSO by visiting the GNSO Newcomer pages [gnso.icann.org]

4 5

Meeting Schedule re: / Doodle / RPMs Data Sub Team
by Julie Hedlund June 2, 2018

June 2, 2018

Dear Data Sub Team members, Thank you to those of you who completed the Doodle. After reviewing the responses to the Doodle, consulting with the RPM WG Co-Chairs, and considering the deadline to provide comments to Analysis Group by Friday, 08 June, it was decided to schedule two Data Sub Team calls for next week as follows: Wednesday, 06 June: 1700-1830 UTC (instead of a full WG meeting), and Thursday, 07 June: 1600-1730 UTC Note that if the work can be completed on Wednesday, we’ll cancel the Thursday call. Holding the meetings on Wednesday and Thursday (as opposed to Thursday and Friday) would ensure that comments can provided to Analysis Group as early as possible on Friday, 08 June. Best regards, Mary, Ariel, Berry, and Julie From: Ntfy-gnso-rpm-data <ntfy-gnso-rpm-data-bounces(a)icann.org> on behalf of Julie Bisland <julie.bisland(a)icann.org> Date: Thursday, May 31, 2018 at 7:19 PM To: "ntfy-gnso-rpm-data(a)icann.org" <ntfy-gnso-rpm-data(a)icann.org> Cc: "gnso-secs(a)icann.org" <gnso-secs(a)icann.org> Subject: [Ntfy-gnso-rpm-data] **REMINDER** / Doodle / RPMs Data Sub Team Dear Data Sub Team members, Please complete the following Doodle poll to identify an appropriate date and time for the next Data Sub Team call. Note that the times will automatically adjust for your time zone. Doodle: https://doodle.com/poll/7np4vqtxhwegutg2 [doodle.com] Kind regards, Julie Julie Bisland Secretariat Operations Coordinator for the GNSO Internet Corporation for Assigned Names and Numbers (ICANN) Email: julie.bisland(a)icann.org Skype ID: 79613b691cb8a6c1 Find out more about the GNSO by visiting the GNSO Newcomer pages [gnso.icann.org]

2 1