December 2013 - atrt2 - lists.icann.org

ATRT2 Final Report
by Brian Cute Jan. 1, 2014

Jan. 1, 2014

Steve, On behalf of ATRT2 and pursuant to the Affirmation of Commitments, attached is the ATRT2 Final Report and Recommendations for submission to the ICANN Board of Directors. ATRT2 wishes to recognize and thank the ICANN Staff for its support and diligence during the course of ATRT2's work. Led by Denise Michel and her staff, particular recognition is given to Larisa Gurnick, Alice Jansen and Charla Shambley whose tireless work and attention to detail assisted the ATRT2 in producing this Final Report. We also thank the entire ICANN Community, the Board, and Steve as a member of ATRT2, for thoughtful engagement and feedback throughout the process. Regards, Brian Cute Chair Accountability and Transparency Review Team 2

3 2

ATRT2 Final Report and Recommendations
by Brian Cute Dec. 31, 2013

Dec. 31, 2013

ATRT2, Attached is the Final Report and Recommendations that I will send to the Board on our behalf. The final version of the Final Report and Recommendations reflects the input from "editors" received over the past two weeks. A redlined version of the Final Report that reflects those edits is also attached. Thank you to all for their focus and effort to the end of the drafting process. Please note a few items: Lise and Joergen's December 28, 2013 email offered clarification concerning the intent behind Recommendation 12.3 and benchmarking. Given my own experience at Public Interest Registry, clear benchmarking and flexibility in organizational benchmarking exercises are both important factors that provide an organization appropriate measures as well as the ability to effectively staff and manage its operations. Steve, I hope the email provides some guidance in response to your email request to Lise and Joergen when you address implementation issues. Also, I added a statement to Appendix E concerning the One World Trust Report on metrics as follows: "Staff provided a confidential copy of the One World Trust report to ATRT2 on December 17, 2013. The copy was provided on a confidential basis because it was a work in progress and because One World Trust and ICANN Staff were working out details with respect to the Report. Given the timing of the submission, the One World Trust report was not discussed in detail by ATRT2 and did not figure into the Final Report and Recommendations of ATRT2. As part of One World Trust’s data gathering at the outset of its work, the Chair of ATRT2 was interviewed along with other members of the Community. Also, a public session was held at the ICANN Buenos Aires meeting where One World Trust discussed certain aspects of its report in progress and engaged in Q&A with the Community. ATRT2 expects that ICANN Staff will make the One World Trust report available to the Community and that action to adopt metrics will be communicated and will serve as a basis for future review teams to measure ICANN’s progress on implementation of Recommendations." Finally, thank you to everyone for their efforts on this important exercise. I want to recognize the support provided by ICANN throughout the process led by Denise and her staff. As "newcomers" to ICANN AoC Reviews, Larisa and Charla provided excellent support with great attention to detail and Alice, who has more experience with the day-to-day workings of AoC Review processes than anyone, provided seasoned guidance throughout. Much appreciation to the Work Stream Chairs, Olivier Crepin-Leblond, David Conrad, Michael Yakushev and Fiona Asonga for taking on the responsibility and time to develop the work throughout the process. Thank you Avri, Lise and Alan for serving as Vice Chairs and guiding the work of ATRT2 throughout. Finally, thanks to Paul Diaz from Public Interest Registry who did yeoman's work in managing the Draft Report and Final Report to ensure a quality product was delivered. This is how much of ICANN's work gets accomplished. Best regards, Brian

5 4

Comment from reading the sections of Draft #3 (Clean)
by Avri Doria Dec. 30, 2013

Dec. 30, 2013

Hi, Mostly trivial things I noticed. While these come from reading the text, one of the observations points out a wording defect in one of the recommendations (9.3.B). I do not think the recommended fix changes the meeting of the recommendation. It is a good report. Though at times reading things I 'held the pen' for, I wish I had done a better job. avri ~ Page 13 In the course of its deliberations, ATRT1 found that the Nominating Committee (NomCom) had failed to implement previous recommendations from, did not have (never says from when the recommendations were not taken. Maybe the from is a superfluous word?) ~ page 25 (the 9.3 b issue) In the course of its deliberations, ATRT1 found that the Nominating Committee (NomCom) had failed to implement previous recommendations from, did not have Yet in recommendation 9.3 B we say administrative function instead of administration or administrative matters. 2 instances page 7 and 59 'administrative function' should be changed to 'administration' ~ page 32 , the idea of "reverse" liaisons from ACs and SOs, as well as a Board liaison to the GAC (nowhere do we define reverse liaisons. perhaps a footnote. I know comments are supposed to include text, but in this case, I don't know how to define it. The closest I can get is "reverse liaison: a liaison from a group with which the GAC does have a By-Laws defined relationship.") ~ page 45 The effectiveness of implementation is qualified, but its partial success is not entirely due to staff performance. . (double period) ~ page 46 During calls72 with ATRT2, (footnote indicator in wrong font) ~ Page 53 in fact ran counter to the concept of accountability.83 [Multistakeholder Model].”84 (footnote indicators in wrong font) ~ Page 60 Report Section 12. Assessment of ATRT2 Recommendation 21 (should that be ATRT1 Recommendation?)

2 1

small items on the recommendations in Draft #3 (Clean)
by Avri Doria Dec. 30, 2013

Dec. 30, 2013

Hi, I don't think any of these are contentful, except maybe the last one, but probably not even that one. Am now going to try and read through the rest of it for one last time. avri page 2 only an assessment of ICANN’s implementation of those Recommendations only (double 'only') in 9.5 page 8 don't need both the parenthetical with url and the footnote with the url. page 10 it believes that it may establish gTLD policy7 in the event that the (in line footnote number in wrong font.) page 11 12.4. In order to improve accountability and transparency ICANN’s Board should base the yearly budgets on a multi-annual strategic plan and corresponding financial framework [covering e.g. a three-year period]. This rolling plan and framework should reflect the planned activities and the corresponding expenses in that multi-annual period. This should include specified budgets for the ACs and SOs. ICANN’s [yearly] financial reporting shall ensure that it is possible to track ICANN’s activities and the related expenses with particular focus on the implementation of the [yearly] budget. The financial report shall be subject to public consultation. (what does it mean that some text is in square brackets. Is it using diplomatic convention of listing controversial text that way. It is the only instance in the recommendations of [] so I don't understand their usage. Should they be parenthesis? )

2 1

Final review
by Brian Cute Dec. 30, 2013

Dec. 30, 2013

Lise, I have completed final review, taking into account emails from the Recommendation editors to ensure accuracy and consistency. You offered some questions in an email to Larisa as follows: "I am not happy with the changes Sabra made on page 12 to recommendation 12.4. I think the new wording changes the recommendation too much. I furthermore don’t understand why the review team suddenly is a part of the recommendation. The changes are not in the same recommendation on page 81. I prefer the “original” version on page 81. At page 79 there is a comment from [s36] about “whose comments is this?” The section referred to is a part of the section above and is a part of the RySG comments to recommendation 12.4." Would you kindly look at the latest version of the Report as sent to the ATRT2 by Larisa and confirm whether your issues have been resolved. If not, please direct me to the specific language that must be modified. Thank you. Regards, Brian

3 3

Final Review
by Brian Cute Dec. 29, 2013

Dec. 29, 2013

Fiona, Noting an email exchange you had with Olivier where you proposed a draft of Recommendation 8, please note that Recommendation 8 now reads (as modified during our final conference calls): "8. To support public participation, the Board should review the capacity of the language services department versus the community need for the service using Key Performance Indicators (KPIs) and make relevant adjustments such as improving translation quality and timeliness and interpretation quality. ICANN should implement continuous improvement of translation and interpretation services including benchmarking of procedures used by international organizations such as the United Nations." Regards, Brian

2 2

ATRT2 Final Report - Draft#2 For Your Review
by Larisa B. Gurnick Dec. 28, 2013

Dec. 28, 2013

Dear Review Team members, Attached are documents comprising ATRT2 Final Report – Draft #2. Please review these documents and provide staff with your final edits by 23 UTC on Friday, 20 December. Staff will circulate ATRT2 Final Report – Draft #3 on Monday 23 December. Appendix B has not changed since the Draft Report. Appendix C reflects all the submitted changes. Appendix D is new. Staff made every effort to reflect your intended changes consistently and accurately, and the quality control effort is still continuing. However, due to the volume of changes, please take care to check your portions of the document to ensure accuracy. Formatting and table of contents will be updated in the next draft. As a reminder, ICANN will be closed for the holidays from noon on 24 December through 1 January, and the editor that has been engaged to assist with the Final Report will not be available after 23 December. Staff will be available to assist with any last minute edits upon return on 2 January. Staff will submit the final report for translation and coordinate the posting on the web site as soon as ATRT2 confirms the Final Report documents after the holidays. Best regards, Larisa B. Gurnick Consultant/Senior Director, Organizational Reviews Internet Corporation for Assigned Names and Numbers (ICANN) larisa.gurnick(a)icann.org<mailto:larisa.gurnick@icann.org> 310 383-8995

8 25

Re: [atrt2] ATRT2 Final Report - Draft#2 For Your Review
by Jørgen C Abild Andersen Dec. 24, 2013

Dec. 24, 2013

________________________________ Fra: Jørgen C Abild Andersen Sendt: 24. december 2013 11:47 Til: 'Lise Fuhr'; 'Larisa B. Gurnick'; 'Brian Cute' Cc: 'Sabra Chartrand' Emne: SV: [atrt2] ATRT2 Final Report - Draft#2 For Your Review Hi Larisa and Brian. Also I can confirm that the text below in Larisa's e-mail of 23 December is the correct text to be inserted in the final report. Merry Christmas and Happy New Year to you all. Best wishes Jørgen ________________________________ Fra: Lise Fuhr [mailto:lise.fuhr@difo.dk] Sendt: 23. december 2013 16:53 Til: 'Larisa B. Gurnick'; 'Brian Cute' Cc: 'Sabra Chartrand'; Jørgen C Abild Andersen Emne: SV: [atrt2] ATRT2 Final Report - Draft#2 For Your Review Hi Larisa, Thank you for your email. In order to avoid any misunderstandings I confirm this text. Best, Lise Fra: Larisa B. Gurnick [mailto:larisa.gurnick@icann.org] Sendt: 23. december 2013 00:42 Til: Lise Fuhr; 'Brian Cute' Cc: 'ATRT2'; Sabra Chartrand (Chartrand(a)att.net) Emne: RE: [atrt2] ATRT2 Final Report - Draft#2 For Your Review Lise, Confirmed. The following wording is currently included in the report, in the Executive Summary as well as the body of the report. 12.3 Every three years the Board should conduct a benchmark study on relevant parameters, (e.g. size of organization, levels of staff compensation and benefits, cost of living adjustments, etc.) suitable for a non-profit organization. If the result of the benchmark is that ICANN as an organization is not in line with the standards of comparable organizations, the Board should consider aligning the deviation. In cases where the Board chooses not to align, this has to be reasoned in the Board decision and published to the Internet community. 12.4 In order to improve accountability and transparency ICANN's Board should base the yearly budgets on a multi-annual strategic plan and corresponding financial framework [covering e.g. a three-year period] This rolling plan and framework should reflect the planned activities and the corresponding expenses in that multi-annual period. This should include specified budgets for the ACs and SOs. ICANN's [yearly] financial reporting shall ensure that it is possible to track ICANN's activities and the related expenses with particular focus on the implementation of the [yearly] budget. The financial report shall be subject to public consultation. Larisa From: Lise Fuhr [mailto:lise.fuhr@difo.dk] Sent: Sunday, December 22, 2013 11:03 AM To: 'Brian Cute' Cc: Larisa B. Gurnick; 'ATRT2' Subject: SV: [atrt2] ATRT2 Final Report - Draft#2 For Your Review Hi Brian, I would like to keep the previous edition of 12.4 and I hope that 12.3 still reads: 12.3 Every three years the Board should conduct a benchmark study on relevant parameters, (e.g. size of organization, levels of staff compensation and benefits, cost of living adjustments, etc.) suitable for a non-profit organization. If the result of the benchmark is that ICANN as an organization is not in line with the standards of comparable organizations, the Board should consider aligning the deviation. In cases where the Board chooses not to align, this has to be reasoned in the Board decision and published to the Internet community. Best regards and have a happy holiday, Lise Fra: Brian Cute [mailto:brianacute@gmail.com] Sendt: 22. december 2013 18:24 Til: Lise Fuhr Cc: Larisa B. Gurnick; ATRT2 Emne: Re: [atrt2] ATRT2 Final Report - Draft#2 For Your Review Lise, I have added footnotes with quotes from public comments to the report as well as a few edits. I intended those edits to add support to the recommendations. If you are uncomfortable with the impact on the recommendations you drafted, by all means fell free to change th to reflect the intent of your draft. Beat, Brian Sent from my iPhone On Dec 20, 2013, at 3:31 PM, "Lise Fuhr" <lise.fuhr(a)difo.dk<mailto:lise.fuhr@difo.dk>> wrote: Hi Larisa, I have a few remarks. I am not happy with the changes Sabra made on page 12 to recommendation 12.4. I think the new wording changes the recommendation too much. I furthermore don't understand why the review team suddenly is a part of the recommendation. The changes are not in the same recommendation on page 81. I prefer the "original" version on page 81. At page 79 there is a comment from [s36] about "whose comments is this?" The section referred to is a part of the section above and is a part of the RySG comments to recommendation 12.4. I hope this is understandable. Have a nice weekend - and a Merry Christmas/holidays Best, Lise Fra: atrt2-bounces(a)icann.org<mailto:atrt2-bounces@icann.org> [mailto:atrt2-bounces@icann.org] På vegne af Larisa B. Gurnick Sendt: 20. december 2013 08:30 Til: ATRT2 (atrt2(a)icann.org<mailto:atrt2@icann.org>) Emne: [atrt2] ATRT2 Final Report - Draft#2 For Your Review Dear Review Team members, Attached are documents comprising ATRT2 Final Report - Draft #2. Please review these documents and provide staff with your final edits by 23 UTC on Friday, 20 December. Staff will circulate ATRT2 Final Report - Draft #3 on Monday 23 December. Appendix B has not changed since the Draft Report. Appendix C reflects all the submitted changes. Appendix D is new. Staff made every effort to reflect your intended changes consistently and accurately, and the quality control effort is still continuing. However, due to the volume of changes, please take care to check your portions of the document to ensure accuracy. Formatting and table of contents will be updated in the next draft. As a reminder, ICANN will be closed for the holidays from noon on 24 December through 1 January, and the editor that has been engaged to assist with the Final Report will not be available after 23 December. Staff will be available to assist with any last minute edits upon return on 2 January. Staff will submit the final report for translation and coordinate the posting on the web site as soon as ATRT2 confirms the Final Report documents after the holidays. Best regards, Larisa B. Gurnick Consultant/Senior Director, Organizational Reviews Internet Corporation for Assigned Names and Numbers (ICANN) larisa.gurnick(a)icann.org<mailto:larisa.gurnick@icann.org> 310 383-8995 _______________________________________________ atrt2 mailing list atrt2(a)icann.org<mailto:atrt2@icann.org> https://mm.icann.org/mailman/listinfo/atrt2

1 0

Re: [atrt2] ATRT2 Final Report - Draft #3 LATEST
by Alan Greenberg Dec. 24, 2013

Dec. 24, 2013

See embedded. Also, there is a reference at the end of your note to "implantation". Don't know where it comes from, but presume it should be implementation. At 23/12/2013 06:35 PM, Larisa B. Gurnick wrote: >Dear ATRT2, >Attached is the latest version of the ATRT2 >Report, along with separate documents for >Appendices B- E (Appendix A is the ICC report). >All changes have been incorporated and Table of >Contents has been updated. These are the master >files and should be used if you plan to make any >further changes to the report prior to >submitting it to the Board. Please copy me, >Denise and Alice when you submit your Final Report to the Board. > >Staff flagged several items (previously included >as notes in the document) for you to consider as >you finalize the report please see the listing below. > >As a reminder, ICANN will be closed for the >holidays from noon on 24 December through 1 >January. Staff will be available to assist with >any last minute edits upon return on 2 >January. Staff will submit the final report for >translation and coordinate the posting on the >web site as soon as ATRT2 confirms the Final >Report documents after the holidays. > >Happy Holidays, >Larisa > >Items for ATRT2 consideration prior to finalizing the report: >1. Recommendation #4 Paul indicated that >the Review Team should develop a footnote >explaining change from prior language, i.e. only >mention policy development and implementation, >not administrative matters. Executive Summary and body of the report. >2. Recommendation #6 Confirm that the >following should be deleted: Increase GAC >early involvement in the various ICANN policy >processes (tied to ATRT 1 Recommendation >12). Recommendation was merged and concepts >included in the recommendations related to >cross-community development >processes. Executive Summary and body of the report. I cannot locate that line, so presume it was already deleted. In any case, I can see no reason to keep it. If we really want a link, it could be worded "Another GAC-related recommendation can be found at Recommendation 10.2". However, I see no real need for that. >3. Report Section 1; Findings of >ATRT1: In the course of its deliberations, >ATRT1 found that the Nominating Committee >(NomCom) had failed to implement previous recommendations from, [S1] > > >4. In several sections of the report, >references to ATRT1 recommendations have been >footnoted. This has not been done consistently throughout the report. > > > > > >5. Report Section 5; Findings of ATRT1 - capacity[S2] . > > > >6. Report Section Headings Alan made a >change to Report Section 13, which was >incorporated. He took out the parenthetical >reference; yet other Report Sections still have >it and earlier, there was an agreement to >include these references for further >clarity. ATRT2 should make a decision to address this consistently. What I removed was factually incorrect - it referred to earlier versions which were focused on the GNSO PDP. What you have for sections 14 and 15 is: Report Section 14. AoC REVIEW PROCESS EFFECTIVENESS: ATRT2 Recommendation 11 (New Recommendation on Effectiveness of the Review Process) Report Section 15. FINANCIAL ACCOUNTABIILITY AND TRANSPARENCY: ATRT2 Recommendation #12 (New Recommendation on Finance Accountability and Transparency) The parenthetical seems rather redundant to me, but if you want one for Section 13, it should be: Report Section 13. CROSS-COMMUNITY DELIBERATIONS: ATRT2 Recommendation #10 (New Recommendation on Cross-community Deliberations) >7. P.54 Summary of other relevant >information Staff has previously submitted a >correction: Correction: Page 45 of the Draft >Report: Reconsideration review on 13-3, the >Board, through the NGPC, actually accepted >reconsideration of the issue, though the >ultimate decision was that the action should not >be overturned. This is different from the Board >denying reconsideration, which is what happened in the other instances cited. > > >8. Appendix E p. E-4; Metrics and >criteria for measuring progress; last sentence - >ATRT2 requested that it be able to interact with >One World Trust directly so that ATRT2 could >reflect the need for metrics in its Final Report >in a coordinated way. [LBG3] > > > > > > >Larisa B. Gurnick >Consultant/Senior Director, Organizational Reviews >Internet Corporation for Assigned Names and Numbers (ICANN) ><mailto:larisa.gurnick@icann.org>larisa.gurnick(a)icann.org >310 383-8995 > > > [S1]PD7 asks do we know what entity made this > recommendation? Would need citations LG > response: Not sure could be the structural review mandated by the bylaws. > > [S2]PD19 says reference explanatory text on > why ATRT2 is only focusing on policy development and implantation? > [LBG3]Staff suggestion: update the comment > based on the draft report that has been shared confidentially with the ATRT2.

1 0

Final Report
by Brian Cute Dec. 24, 2013

Dec. 24, 2013

All, Thank you for the inputs, including those that came in today. Most of all, an enormous thanks to ICANN staff who has been working diligently to absorb the final offered edits to the Report and Recommendations. I have seen all the inputs and will turn my attention to them on Thursday and Friday after the holiday to try to ensure that to the Final Recommendations are accurately reflected as intended by the editors and the ATRT2 as a whole. I will indicate to the ATRT2 and Staff when I have completed the task and will send to the Board by the 31st. Speak to you soon. Best, Brian Sent from my iPhone

1 0