Re: RSP Selection
HI Lars, Thanks for the explanation, but I’m afraid that just won’t do. If the RSP evaluation window is to shut down on the last day that an application can be submitted, ICANN is unnaturally closing off the ability for new competitors to enter the RSP space/industry. I hope you all can find another way to provide certainty that ICANN have applied the same evaluation criteria to all RSP applicants. Elaine From: Lars Hoffmann via SubPro-IRT <subpro-irt@icann.org> Reply-To: Lars Hoffmann <lars.hoffmann@icann.org> Date: Wednesday, February 12, 2025 at 3:49 PM To: Cheryl Langdon-Orr via SubPro-IRT <subpro-irt@icann.org> Subject: [EXTERNAL] [SubPro-IRT] RSP Selection Caution: This email originated from outside the organization. Do not click links or open attachments unless you recognize the sender and know the content is safe. Dear IRT members, Following today’s (12 Feb 13 UTC) discussion, please, find attached the redline language and the clean language for RSP selection. In addition, there was a question from Elaine about the opening and closing of the RSP application window. Here is our explanation: ICANN org has developed internal evaluation guides for performing the RSP evaluation based on the criteria in the RSP handbook. The evaluation works by having a person with multiple years of industry experience doing the evaluation and another with similar skills doing quality assurance. Once all the evaluations are performed, the team will have multiple alignment sessions to confirm that the same criteria have been applied uniformly. This process provides certainty that we have applied the same evaluation criteria. If we don't close the application window, it's not possible to follow this process, as new entities could be joining at any time. Once the pre-evaluation period ends, we will publish the list of evaluated RSPs for the first time to provide the gTLD applicants an opportunity to start establishing business relationships with the RSPs. The RSP program was developed specifically for the NxR. Therefore, the second application window closes simultaneously with the gTLD application window. I hope this information is helpful. Please note, the clean document will post for public comment on Friday with the remainder of the materials. Best. Lars Redline: https://docs.google.com/document/d/13PCoLz3vBNB5dmuiACoIF6dI5Q9SMune-Ij5qIGh... Clean: https://docs.google.com/document/d/1RHHRPGMs0XRStOpnoOgY_4PL_gn8MncSAXLRC3C2... PDF attached
Elaine, I hadn't realized what you were pointing out in the call, and it makes a lot of sense now what you were saying. This is what I'll call a HELLO KIWI event. Lars' narrative of the Tech Panel reviews matched the reality I lived through, which was experience, consistency and alignment across the three firms and ICANN org (ECA3F+I). That is 100% what happened while the tents were still up and the evaluation process was flowing. I recall, as we were taking down the tents at the tech evaluation firms, once the reviews of the 1930ish applications post-2012 reviews of the tech panels, that there were people switching between reviewed platforms using change requests, most of which were moving from a provider that had been vetted among the population of applications, but I think the crux of what you are identifying is a situation like when all the technical panel reviews had concluded, and the tents had been torn down. The real example of this is where .KIWI moved from the minds and machines back end (a ECA3F+I vetted platform) to a new provider that had not had their platform undergo the same ECA3F+I technical panel reviews, CIRA's Hello (formerly FURY). That was a real world scenario, because it happened. And likely more since. The platform and the situation around it not going through the same ECA3F+I Technical panel review ended up going through, but for consistency, a similar situation should be in place for similarly timed RSP evals. There likely needs to be some kind of consideration for 'pop-up' events of change like this where a new entrant RSP needs to be appropriately reviewed with some consistency when the first situation akin to "HELLO KIWI" occurs after this next round eval comes. Jothan Frakes On Thu, Feb 13, 2025 at 7:04 AM Pruis, Elaine via SubPro-IRT < subpro-irt@icann.org> wrote:
HI Lars,
Thanks for the explanation, but I’m afraid that just won’t do.
If the RSP evaluation window is to shut down on the last day that an application can be submitted, ICANN is unnaturally closing off the ability for new competitors to enter the RSP space/industry.
I hope you all can find another way to provide certainty that ICANN have applied the same evaluation criteria to all RSP applicants.
Elaine
*From: *Lars Hoffmann via SubPro-IRT <subpro-irt@icann.org> *Reply-To: *Lars Hoffmann <lars.hoffmann@icann.org> *Date: *Wednesday, February 12, 2025 at 3:49 PM *To: *Cheryl Langdon-Orr via SubPro-IRT <subpro-irt@icann.org> *Subject: *[EXTERNAL] [SubPro-IRT] RSP Selection
*Caution:* This email originated from outside the organization. Do not click links or open attachments unless you recognize the sender and know the content is safe.
Dear IRT members,
Following today’s (12 Feb 13 UTC) discussion, please, find attached the redline language and the clean language for RSP selection. In addition, there was a question from Elaine about the opening and closing of the RSP application window. Here is our explanation:
ICANN org has developed internal evaluation guides for performing the RSP evaluation based on the criteria in the RSP handbook. The evaluation works by having a person with multiple years of industry experience doing the evaluation and another with similar skills doing quality assurance. Once all the evaluations are performed, the team will have multiple alignment sessions to confirm that the same criteria have been applied uniformly. This process provides certainty that we have applied the same evaluation criteria. If we don't close the application window, it's not possible to follow this process, as new entities could be joining at any time. Once the pre-evaluation period ends, we will publish the list of evaluated RSPs for the first time to provide the gTLD applicants an opportunity to start establishing business relationships with the RSPs.
The RSP program was developed specifically for the NxR. Therefore, the second application window closes simultaneously with the gTLD application window.
I hope this information is helpful.
Please note, the clean document will post for public comment on Friday with the remainder of the materials.
Best. Lars
Redline: https://docs.google.com/document/d/13PCoLz3vBNB5dmuiACoIF6dI5Q9SMune-Ij5qIGh... <https://secure-web.cisco.com/131UyS6-u-kiZsI5Gt1FiHzfsGEkToYOGzlWW670hqS_nUm...>
Clean: https://docs.google.com/document/d/1RHHRPGMs0XRStOpnoOgY_4PL_gn8MncSAXLRC3C2... <https://secure-web.cisco.com/1EhRsRk2ueMSr46ypODn0tzU6hegMfAuba9fhLvW-NapqFK...>
PDF attached _______________________________________________ SubPro-IRT mailing list -- subpro-irt@icann.org To unsubscribe send an email to subpro-irt-leave@icann.org
_______________________________________________ By submitting your personal data, you consent to the processing of your personal data for purposes of subscribing to this mailing list accordance with the ICANN Privacy Policy (https://www.icann.org/privacy/policy) and the website Terms of Service (https://www.icann.org/privacy/tos). You can visit the Mailman link above to change your membership status or configuration, including unsubscribing, setting digest-style delivery or disabling delivery altogether (e.g., for a vacation), and so on.
Hello Lars, Is there an update from ICANN Org on removing the end date for RSP testing? As discussed below, closing the window (for RSPs to be evaluated) at the same time as the application window closes significantly impacts the ability for new competitors to enter the RSP space. Thanks Elaine From: Jothan Frakes <jothan@jothan.com> Date: Thursday, February 13, 2025 at 7:32 AM To: Elaine Pruis <epruis@verisign.com> Cc: "lars.hoffmann@icann.org" <lars.hoffmann@icann.org>, "subpro-irt@icann.org" <subpro-irt@icann.org> Subject: [EXTERNAL] Re: [SubPro-IRT] Re: RSP Selection Caution: This email originated from outside the organization. Do not click links or open attachments unless you recognize the sender and know the content is safe. Elaine, I hadn't realized what you were pointing out in the call, and it makes a lot of sense now what you were saying. This is what I'll call a HELLO KIWI event. Lars' narrative of the Tech Panel reviews matched the reality I lived through, which was experience, consistency and alignment across the three firms and ICANN org (ECA3F+I). That is 100% what happened while the tents were still up and the evaluation process was flowing. I recall, as we were taking down the tents at the tech evaluation firms, once the reviews of the 1930ish applications post-2012 reviews of the tech panels, that there were people switching between reviewed platforms using change requests, most of which were moving from a provider that had been vetted among the population of applications, but I think the crux of what you are identifying is a situation like when all the technical panel reviews had concluded, and the tents had been torn down. The real example of this is where .KIWI moved from the minds and machines back end (a ECA3F+I vetted platform) to a new provider that had not had their platform undergo the same ECA3F+I technical panel reviews, CIRA's Hello (formerly FURY). That was a real world scenario, because it happened. And likely more since. The platform and the situation around it not going through the same ECA3F+I Technical panel review ended up going through, but for consistency, a similar situation should be in place for similarly timed RSP evals. There likely needs to be some kind of consideration for 'pop-up' events of change like this where a new entrant RSP needs to be appropriately reviewed with some consistency when the first situation akin to "HELLO KIWI" occurs after this next round eval comes. Jothan Frakes On Thu, Feb 13, 2025 at 7:04 AM Pruis, Elaine via SubPro-IRT <subpro-irt@icann.org> wrote: HI Lars, Thanks for the explanation, but I’m afraid that just won’t do. If the RSP evaluation window is to shut down on the last day that an application can be submitted, ICANN is unnaturally closing off the ability for new competitors to enter the RSP space/industry. I hope you all can find another way to provide certainty that ICANN have applied the same evaluation criteria to all RSP applicants. Elaine From: Lars Hoffmann via SubPro-IRT <subpro-irt@icann.org> Reply-To: Lars Hoffmann <lars.hoffmann@icann.org> Date: Wednesday, February 12, 2025 at 3:49 PM To: Cheryl Langdon-Orr via SubPro-IRT <subpro-irt@icann.org> Subject: [EXTERNAL] [SubPro-IRT] RSP Selection Caution: This email originated from outside the organization. Do not click links or open attachments unless you recognize the sender and know the content is safe. Dear IRT members, Following today’s (12 Feb 13 UTC) discussion, please, find attached the redline language and the clean language for RSP selection. In addition, there was a question from Elaine about the opening and closing of the RSP application window. Here is our explanation: ICANN org has developed internal evaluation guides for performing the RSP evaluation based on the criteria in the RSP handbook. The evaluation works by having a person with multiple years of industry experience doing the evaluation and another with similar skills doing quality assurance. Once all the evaluations are performed, the team will have multiple alignment sessions to confirm that the same criteria have been applied uniformly. This process provides certainty that we have applied the same evaluation criteria. If we don't close the application window, it's not possible to follow this process, as new entities could be joining at any time. Once the pre-evaluation period ends, we will publish the list of evaluated RSPs for the first time to provide the gTLD applicants an opportunity to start establishing business relationships with the RSPs. The RSP program was developed specifically for the NxR. Therefore, the second application window closes simultaneously with the gTLD application window. I hope this information is helpful. Please note, the clean document will post for public comment on Friday with the remainder of the materials. Best. Lars Redline: https://docs.google.com/document/d/13PCoLz3vBNB5dmuiACoIF6dI5Q9SMune-Ij5qIGh... Clean: https://docs.google.com/document/d/1RHHRPGMs0XRStOpnoOgY_4PL_gn8MncSAXLRC3C2... PDF attached _______________________________________________ SubPro-IRT mailing list -- subpro-irt@icann.org To unsubscribe send an email to subpro-irt-leave@icann.org _______________________________________________ By submitting your personal data, you consent to the processing of your personal data for purposes of subscribing to this mailing list accordance with the ICANN Privacy Policy (https://www.icann.org/privacy/policy) and the website Terms of Service (https://www.icann.org/privacy/tos). You can visit the Mailman link above to change your membership status or configuration, including unsubscribing, setting digest-style delivery or disabling delivery altogether (e.g., for a vacation), and so on.
participants (2)
-
Jothan Frakes -
Pruis, Elaine