Dear Jared,

Given the extremely short turnaround time, I was only able to work with 2 ALAC colleagues to review the earlier version of the Draft Selection Criteria. I also subsequently reviewed the updated version and offer our aggregated feedback on the updated version for consideration.

Kind regards,

Justine

****
Feedback on Updated Version

(per Anne's comment) It is unclear what "evaluation projects" means so we suggest stipulating that provider must have significant demonstrated expertise in projects which call for evaluating applications against a defined set of criteria.
Agree with deletion of "train" as provider should be expected to have or engage employees and/or subcontractors who already possess relevant expertise
If feasible, consider specifying in the RFP how each type of experience - relevant project management and community application evaluation - will be assessed (see also 2A below)
Would the RFP also address how provider should handle publication of the status of each evaluation, up to conclusion and including evaluation challenges?

Consider including emphasizing timelines - we suggest that provider must demonstrate the ability to develop efficient work methods, evaluation/assessment approaches ....

Consider elaborating on what "diverse panel" means.
Consider strengthening reliance on supplemental non-evaluator expertise as mandatory or at the very least, a strongly advisable action, rather than leaving that to the panel's discretion, assuming assessment of expertise in evaluating community applications may not be strictly measurable or determinable without clear and specific metrics
Consider suggesting that a panel has the option to draw on ICANN community volunteers as supplemental non-evaluators

Panelist must have the necessary capabilities and/or experience to evaluate applications etc rather than just "should have"
Unless panelists possess the requisite experience in community-focused work across sectors, such as community development, community organization, engagement, management and/or community studies, then provider and panelists will need to rely on supplemental experience and/or expertise in a specific community - we should as far as possible avoid having provider and panelists insisting that supplemental non-evaluators are not needed when they should
Panel may need to perform other limited validating research as required

Please include the element of "fair and consistent outcomes" in the demonstration required

3B and 6B

Processes governing changes in panel composition under circumstances such as conflict of interest or clear biasness, should reflect short timelines for the same, and at no cost to applicant.

Provider must provide reference checks of relevant prior on evaluation services.

Separately, how would ICANN org establish whether selected provider is carrying out its contracted services satisfactorily during the contracted period?

On Sat, 16 Aug 2025 at 01:25, Jared Erwin via SubPro-IRT <subpro-irt@icann.org> wrote:

Dear IRT Members,

As discussed, please see here the updated version of the Draft Selection Criteria (please give the link a moment to load to the relevant spot on the page). This includes redlines based on IRT feedback from our call on 12 August 2025.

I would kindly request any other feedback ASAP so that we can incorporate that by our publication date of Monday, 18 August 2025.

Should you have trouble with the link above, the document is on the working documents page, under Topic 34.

Thank you

Jared

From: Jared Erwin <jared.erwin@icann.org>
Date: Saturday, August 9, 2025 at 10:00
To: "subpro-irt@icann.org" <subpro-irt@icann.org>
Subject: Draft CPE Vendor Selection Criteria

Dear IRT Members,

As discussed on Thursday, 7 August, I’m sharing here the draft CPE vendor selection criteria, which we will review in our call on Tuesday, 12 August at 12:00 UTC. The document can be found on the respective meeting page here: https://icann-community.atlassian.net/wiki/spaces/SPIR/pages/328105985/2025-08-12+SubPro+IRT+Meeting+151#:~:text=CPE%20RFP%20Vendor-,Selection,-Criteria.pdf.

Thank you,

Jared

--

Jared Erwin

Senior Director, New gTLD Program

Global Domains & Strategy

Internet Corporation for Assigned Names and Numbers (ICANN)

jared.erwin@icann.org

_______________________________________________
SubPro-IRT mailing list -- subpro-irt@icann.org
To unsubscribe send an email to subpro-irt-leave@icann.org

_______________________________________________
By submitting your personal data, you consent to the processing of your personal data for purposes of subscribing to this mailing list accordance with the ICANN Privacy Policy (https://www.icann.org/privacy/policy) and the website Terms of Service (https://www.icann.org/privacy/tos). You can visit the Mailman link above to change your membership status or configuration, including unsubscribing, setting digest-style delivery or disabling delivery altogether (e.g., for a vacation), and so on.