- Gnso-improvem-impl-sc - lists.icann.org

Draft WG Self-Assessment Questionnaire Now Online
by Ken Bour July 26, 2013

July 26, 2013

SCI Team Members: As I indicated in my last email message to the SCI list, I have completed programming the Draft v3 WG Self-Assessment questionnaire within QuestionPro <http://www.questionpro.com/> (QP) for which ICANN maintains an active membership account. I created an illustrative Working Group called "SCI Test," which can be accessed at: http://scitestwg.questionpro.com. Unless we elect to make any subsequent changes, this is exactly how the online questionnaire would appear to a prospective WG member providing a self-assessment. I understand that many, if not most of you, are shortly en route to Durban, South Africa for the ICANN meeting; however, if you have an opportunity to take a test drive between now and our next SCI teleconference (6 Aug), please feel free to do so. If you would like to invite any other Durban attendees to test the online questionnaire, such additional feedback would also be welcome. Please be assured that any data entered is considered "test" only and will be discarded once we complete this final design phase. If you have any suggestions or comments about the instrument, language, methodology, online presentation, etc., you can use the questionnaire's free-form text fields to document them or, if you prefer, send them to the SCI email list. I will browse through each response submitted and collect all feedback until we deactivate this informal test. Please note that you will need to click the "Record My Answers!" button on the last page in order to commit a complete questionnaire to the QP database. Once we are satisfied with the final product, perhaps we can find a recently disbanded Working Group that will agree to be our first customer as a way of putting the entire process, including analysis, through an exhaustive test. Regards, Ken Bour

3 2

Meeting Invitation: Standing Committee on Improvements Implementation - Tuesday 6 August 2013 at 19:00 UTC
by Julia Charvolen July 25, 2013

July 25, 2013

Dear All, The Standing Committee on Improvements Implementation meeting teleconference is scheduled on Tuesday 6 August 2013 at 19:00 UTC for 1 hour. 12:00 PDT , 15:00 EDT, 20:00 London, 21:00 CET For other times: http://tinyurl.com/pnvzfs4 Adobe Connect: http://icann.adobeconnect.com/standcommdraft/ Dial-in details are below. If you require a dial-out, please email us (gnso-secs(a)icann.org<mailto:gnso-secs@icann.org>) your preferred contact number. ____________________________________________________________________________ Participant passcode: SCI For security reasons, the passcode will be required to join the call. ____________________________________________________________________________ Dial in numbers: Country Toll Numbers Freephone/Toll Free Number ARGENTINA 0800-777-0519 AUSTRALIA ADELAIDE: 61-8-8121-4842 1-800-657-260 AUSTRALIA BRISBANE: 61-7-3102-0944 1-800-657-260 AUSTRALIA CANBERRA: 61-2-6100-1944 1-800-657-260 AUSTRALIA MELBOURNE: 61-3-9010-7713 1-800-657-260 AUSTRALIA PERTH: 61-8-9467-5223 1-800-657-260 AUSTRALIA SYDNEY: 61-2-8205-8129 1-800-657-260 AUSTRIA 43-1-92-81-113 0800-005-259 BELGIUM 32-2-400-9861 0800-3-8795 BRAZIL 0800-7610651 CHILE 1230-020-2863 CHINA* 86-400-810-4789 10800-712-1670 10800-120-1670 COLOMBIA 01800-9-156474 CZECH REPUBLIC 420-2-25-98-56-64 800-700-177 DENMARK 45-7014-0284 8088-8324 ESTONIA 800-011-1093 FINLAND Land Line: 106-33-203 0-800-9-14610 FINLAND Mobile: 09-106-33-203 0-800-9-14610 FRANCE LYON: 33-4-26-69-12-85 080-511-1496 FRANCE MARSEILLE: 33-4-86-06-00-85 080-511-1496 FRANCE PARIS: 33-1-70-70-60-72 080-511-1496 GERMANY 49-69-2222-20362 0800-664-4247 GREECE 30-80-1-100-0687 00800-12-7312 HONG KONG 852-3001-3863 800-962-856 HUNGARY 06-800-12755 INDIA 000-800-852-1268 INDONESIA 001-803-011-3982 IRELAND 353-1-246-7646 1800-992-368 ISRAEL 1-80-9216162 ITALY 39-02-3600-6007 800-986-383 JAPAN OSAKA: 81-6-7739-4799 0066-33-132439 JAPAN TOKYO: 81-3-5539-5191 0066-33-132439 LATVIA 8000-3185 LUXEMBOURG 352-27-000-1364 MALAYSIA 1-800-81-3065 MEXICO 001-866-376-9696 NETHERLANDS 31-20-718-8588 0800-023-4378 NEW ZEALAND 64-9-970-4771 0800-447-722 NORWAY 47-21-590-062 800-15157 PANAMA 011-001-800-5072065 PERU 0800-53713 PHILIPPINES 63-2-858-3716 POLAND 00-800-1212572 PORTUGAL 8008-14052 RUSSIA 8-10-8002-0144011 SINGAPORE 65-6883-9230 800-120-4663 SLOVAK REPUBLIC 421-2-322-422-25 SOUTH AFRICA 080-09-80414 SOUTH KOREA 82-2-6744-1083 00798-14800-7352 SPAIN 34-91-414-25-33 800-300-053 SWEDEN 46-8-566-19-348 0200-884-622 SWITZERLAND 41-44-580-6398 0800-120-032 TAIWAN 886-2-2795-7379 00801-137-797 THAILAND 001-800-1206-66056 UNITED KINGDOM BIRMINGHAM: 44-121-210-9025 0808-238-6029 UNITED KINGDOM GLASGOW: 44-141-202-3225 0808-238-6029 UNITED KINGDOM LEEDS: 44-113-301-2125 0808-238-6029 UNITED KINGDOM LONDON: 44-20-7108-6370 0808-238-6029 UNITED KINGDOM MANCHESTER: 44-161-601-1425 0808-238-6029 URUGUAY 000-413-598-3421 USA 1-517-345-9004 866-692-5726 VENEZUELA 0800-1-00-3702 *Access to your conference call will be either of the numbers listed, dependent on the participants' local telecom provider. Restrictions may exist when accessing freephone/toll free numbers using a mobile telephone. ---------------------------- Thank you Kind regards, Julia Charvolen For GNSO Secretariat

1 0

FW: SCI transcript - Saturday 13 July 2013 - Durban
by Ron Andruff July 22, 2013

July 22, 2013

Dear Committee Members, We will discuss this on our next call, however as previously noted please find the transcript attached. Thanks to Julie and Julia for your prompt response on this matter. Kind regards, RA Ron Andruff RNA Partners www.rnapartners.com <http://www.rnapartners.com> From: Julia Charvolen [mailto:julia.charvolen@icann.org] Sent: Tuesday, July 16, 2013 05:32 To: Ron Andruff Cc: Julie Hedlund; gnso-secs(a)icann.org Subject: SCI transcript - Saturday 13 July 2013 - Durban Dear Ron, Please find the transcript for the SCI meeting held on Saturday 13 July 2013 at 17:30 local time. Thank you, Best regards, Julia Charvolen For GNSO Secretariat

2 2

Recommended Amendments to WG Guidelines and Summary
by Ken Bour July 18, 2013

July 18, 2013

SCI Team Members: I understand that most of you have not had the time or opportunity to review the online WG Self-Assessment DRAFT that I forwarded just prior to the Durban meeting. For your convenience, that link, again, is: http://scitestwg.questionpro.com. Feel free to complete the questionnaire and provide any feedback via the embedded comment sections or this email list. As of today, two committee members have tested the instrument (Angie & Mikey) and I thank them for their reviews. In the meantime, while we continue evaluating the proposed design and online questionnaire presentation, I took the liberty of recommending specific modifications to the WG Guidelines <http://gnso.icann.org/council/annex-1-gnso-wg-guidelines-08apr11-en.pdf> document (and its Summary <http://gnso.icann.org/council/summary-gnso-wg-guidelines-06apr11-en.pdf> version) consistent with having a formal self-assessment questionnaire available for Chartering Organizations to utilize. For brevity’s sake, I only included the sections of those documents which, in my judgment, would need to be modified. My suggested changes are presented below in maroon text. Procedurally, given the way online survey forms work, I think it would be best to copy the master questionnaire and create a new link (URL) for each WG. For example, if the GNSO Council wishes to request self-assessment feedback from the IRTP Part D WG, we might create a link such as http://irtp-part-d.questionpro.com (sample only). The downside is that the QuestionPro link would change for each WG; however, the upside is that (a) there should be no confusion or misdirection about which questionnaire is applicable to which WG, (b) it would be straightforward to store and subsequently archive the results under that specific identification, and (c) the link could be made active/inactive based upon when that WG’s members are invited to complete the form. What I propose is that, when a WG Charter is written, the CO could merely specify that it wants participants to complete a formal Self-Assessment. During the WG’s actual closure process, the Chair (via Staff reminder) would provide the exact questionnaire link to WG members along with the timeframe (open and close dates). A Staff Administrator, such as myself, would have the names of WG members and could monitor QuestionPro to see who has and has not completed the questionnaire. Reminders could then be sent out periodically to those who had not yet registered their feedback. At the conclusion of the survey period, the Staff Administrator would compile the results and produce a report for the CO and, upon approval, publish it on the Wiki and/or other locations as deemed appropriate. I welcome your feedback. Ken Bour Working Group Guidelines (ANNEX 1 <http://gnso.icann.org/council/annex-1-gnso-wg-guidelines-08apr11-en.pdf> - GNSO Operating Procedures) 2.1.4.3: Items for Review At the first meeting of the WG or as soon thereafter as practicable, the following documents should be reviewed in order to ensure all members have a common understanding of the WG’s mission, goals, objectives, deliverables, decision-making process and timeframes: Charter, Working Group Guidelines and any other documents relevant for the WGs discussion (e.g., Policy Development Process Guidebook, Issues Paper). These documents are normally transmitted to the WG prior to the first meeting. It is required that WGs develop a work plan that outlines the necessary steps and expected timing in order to achieve the milestones set out in the WG Charter. If a WG does not develop a work plan, it will need to provide a justification to the Chartering Organization. If the Chartering Organization has specified that it would like the WG to complete a formal Self-Assessment, it may be helpful to participants to review the questionnaire (see Section 7.0) in advance so that, as plans unfold and deliberations proceed, members have an understanding of the information that will be asked at the conclusion of the team’s work. The WG Chair may use the following checklist for assistance: (see Addendum) for further details. Addendum: Chair Checklist [Note: given its small size, I suggest eliminating the separate Addendum and inserting the table here in Section 2.1.4.3] Checklist Yes/No Have all WG members submitted Statements of Interest? Introduction of WG members Inform members that WG will operate under the principles of transparency and openness (i.e., mailing lists are publicly archived, meetings are recorded / transcribed) Review of WG’s mission, goals, objectives, deliverables, decision-making process, timeframes and any other documents relevant for the WG‟s discussion Review WG Self-Assessment Questionnaire (see Section 7.0) Development of a work plan Schedule for future meetings of the WG Section 5.0: Products and Outputs The products and outputs of a Working Group may be prescribed by the Charter such as a report, recommendations, guidelines, self-assessment or defined by the process under which the WG operates (e.g., Policy Development Process). In addition, the Working Group might decide that additional products or outputs are required in order to carry out its Charter in an efficient and productive manner such as a statement of work or a project plan. Working Groups should be encouraged to review products and outputs from other WGs and/or consult with ICANN Staff to decide what additional products or outputs would be advisable to develop. Links to some examples of products and outputs produced by other GNSO Working Groups can be found hereunder: · [Skipping other bullets for brevity] · WG Self-Assessment (see Section 7.0) 6.2.4.4: Closure and Working Group Self-Assessment This section of the Charter should describe any instructions for WG final closure including any feedback and/or self-assessment that is requested by the Chartering Organization. This section might also indicate if there is any specific format, template, or prescribed manner in which the feedback is to be provided; for example, a recommended questionnaire (illustrative) is included in Section 7.0 and can be made available online for WG members to complete at the appropriate time. [NEW] Section 7.0: Working Group Self-Assessment A WG Self-Assessment instrument has been developed as a means for Chartering Organizations to formally request feedback from a WG as part of its closure process. WG members are asked a series of questions about the team’s inputs, processes (e.g., norms, decision-making, logistics), and outputs as well as other relevant dimensions and participant experiences. Screenshots of the questionnaire have been assembled into a PDF (see link below) so that WG participants can review, in advance, how it is designed and what specific information will be solicited. During the WG’s closure process, coordinating with the Chair, Staff will provide a unique link (URL) to the online questionnaire along with open and close dates and any specific instructions. Staff will then perform the following actions: · Monitor the online process providing status updates to the WG Chair; · Provide technical assistance to WG members if requested; · Notify the Chair when all team members have completed the questionnaire; and, following the close date, · Summarize the feedback in a written report to the Chartering Organization. Link to WG Self-Assessment (illustrative PDF): [Note: the PDF link (TBD) would be maintained on the GNSO website <http://gnso.icann.org/en/council/procedures> together with ANNEX 1. For now, I have attached an example of the PDF based on the current draft questionnaire]. Working Group Guidelines Summary 2. First meeting of the Working Group The first meeting of the Working Group should address the following issues: · Introductions - members of the Working Group should be provided with the opportunity, at the start of the first meeting, to share information regarding interests, background, skills, experience, especially as related to any requirements in the Charter. · Members of the Working Group should be informed that all Working Groups are normally expected to operate under the principles of transparency and openness, which means, inter alia, that mailing lists are publicly archived, meetings are normally recorded and/or transcribed, and Statements of Interest (SOIs) are required from Working Group participants which will be publicly posted. · Election of the WG Leaders – Normally a Chair will be selected at the first meeting of the WG. A working Group may elect to have co-chairs, vice-chairs. Once selected, a working Group Chair will need to be confirmed by the Chartering Organization (CO). · Items for review - At the first meeting of the WG or as soon thereafter as practicable, the following documents should be reviewed in order to ensure all members have a common understanding of the WG’s mission, goals, objectives, deliverables, decision-making process and timeframes: Charter, Working Group Guidelines and any other documents relevant for the WGs discussion (e.g., Policy Development Process Guidebook, Issues Paper). It is required that WGs develop a work plan that outlines the necessary steps and expected timing in order to achieve the milestones set out in the WG Charter. If the Chartering Organization has specified that it would like the WG to complete a formal Self-Assessment, it may be helpful to participants to review the questionnaire (see Section 7.0) in advance so that, as plans unfold and deliberations proceed, members have an understanding of the information that will be asked at the conclusion of the team’s work.

1 0

RE: [gnso-improvem-impl-sc] Ron's report to the GNSO Council
by Ron Andruff July 16, 2013

July 16, 2013

Avri and all, Your comments are unfounded. Following your forceful intervention in response to my report, I made clear my coments. I encourage you to review the transcript as and when it comes available and work through your constituency to achieve the outcome you so desire. RA Ron Andruff www.lifedotsport.com -------- Original message -------- From: Avri Doria <avri(a)acm.org> Date: 07/13/2013 17:33 (GMT+02:00) To: Gnso-improvem-impl-sc(a)icann.org Subject: [gnso-improvem-impl-sc] Ron's report to the GNSO Council I want to lodger a strong objection to the report given on the SCI, as the issue of full consensus decision was brought to the council as if it was the position of the SCI. This was totally unacceptable especially since in our last conversations the SCi dropped this proposal from the new charter work. I see this as an abuse of his position. avri

2 2

Ron's report to the GNSO Council
by Avri Doria July 13, 2013

July 13, 2013

I want to lodger a strong objection to the report given on the SCI, as the issue of full consensus decision was brought to the council as if it was the position of the SCI. This was totally unacceptable especially since in our last conversations the SCi dropped this proposal from the new charter work. I see this as an abuse of his position. avri

1 0

RE: [gnso-improvem-impl-sc] Draft WG Self-Assessment Questionnaire Now Online
by Ron Andruff July 11, 2013

July 11, 2013

Thanks for this update, Ken. Indeed, en route to Durbin now, but did want to thank you for the work and encourage Committee Members to follow your recommemdation to test drive the survey at everyone's soonest convenience. Kind regards, RA Ron Andruff www.lifedotsport.com -------- Original message -------- From: Ken Bour <ken.bour(a)verizon.net> Date: 07/11/2013 16:05 (GMT-05:00) To: gnso-improvem-impl-sc(a)icann.org Subject: [gnso-improvem-impl-sc] Draft WG Self-Assessment Questionnaire Now Online SCI Team Members: As I indicated in my last email message to the SCI list, I have completed programming the Draft v3 WG Self-Assessment questionnaire within QuestionPro (QP) for which ICANN maintains an active membership account. I created an illustrative Working Group called “SCI Test,” which can be accessed at: http://scitestwg.questionpro.com. Unless we elect to make any subsequent changes, this is exactly how the online questionnaire would appear to a prospective WG member providing a self-assessment. I understand that many, if not most of you, are shortly en route to Durban, South Africa for the ICANN meeting; however, if you have an opportunity to take a test drive between now and our next SCI teleconference (6 Aug), please feel free to do so. If you would like to invite any other Durban attendees to test the online questionnaire, such additional feedback would also be welcome. Please be assured that any data entered is considered “test” only and will be discarded once we complete this final design phase. If you have any suggestions or comments about the instrument, language, methodology, online presentation, etc., you can use the questionnaire’s free-form text fields to document them or, if you prefer, send them to the SCI email list. I will browse through each response submitted and collect all feedback until we deactivate this informal test. Please note that you will need to click the “Record My Answers!” button on the last page in order to commit a complete questionnaire to the QP database. Once we are satisfied with the final product, perhaps we can find a recently disbanded Working Group that will agree to be our first customer as a way of putting the entire process, including analysis, through an exhaustive test. Regards, Ken Bour

1 0

SCI Charter considerations
by Ron Andruff July 10, 2013

July 10, 2013

Dear Jonathan, As you know, the Standing Committee on Improvements Implementation (SCI) will provide an update on its work to the GNSO Council in Durban on 13 July. One of issues the SCI is considering is an update of its Charter, as we have reported previously. This began as an effort to update the Charter to include procedures to elect the SCI Chair and Vice Chair, but recently the SCI also has considered whether other updates are necessary. SCI members have realized that they need guidance from the GNSO Council as to whether the scope of the SCI's work should be limited to a review of the procedures developed in the GNSO Implementations process, or whether the SCI should also address other procedural issues not related to the improvements process. The current Charter states: "The GNSO Standing Committee on Improvement Implementation (SCI) will be responsible for reviewing and assessing the effective functioning of recommendations provided by the Operational Steering Committee (OSC), Policy Process Steering Committee (PPSC) and Policy Development Process Work Team (PDP-WT) and approved by the GNSO Council: . On request for those recommendations that have been identified to present immediate problems . On a periodic timescale for all recommendations in order to identify possible issues and/or improvements (subject to a clear definition by the SCI on which recommendations should be reviewed)" The SCI also seeks guidance from the Council with respect to the duration of the SCI work. Should the SCI be considered the last in the series of committees that arose from the Board review and thus cease to exist when it has completed its review of that work? Or should the SCI continue indefinitely, as an ongoing body that considers procedural questions as raised by the GNSO Council or a group Chartered by the Council? The SCI requests that these fundamental questions be addressed before the SCI considers revisions to the Charter. The SCI members look forward to discussing these questions with the Council in Durban. Sincerely, Ron Andruff, Chair, SCI

2 1

WG Self-Assessment Questionnaire (Draft v3)
by Ken Bour July 9, 2013

July 9, 2013

SCI Team Members: I recognize that everyone is busy especially in this period just before the next ICANN meeting. In order to keep moving forward on the WG Self-Assessment project, I propose that I begin the process of programming the current questionnaire into an online tool. In this case, after evaluating the pros/cons, I am inclined to utilize QuestionPro <http://www.questionpro.com/> because of its excellent features including security protection and back-end reporting. Once it is operational, I would then suggest that we open the questionnaire to a limited test. One suggestion would be to invite 6-10 individuals who have recently served on a Working Group and ask them if they would complete the instrument and, then, comment upon its ease-of-use, time (< 30 minutes), clarity, et al. Unless I hear differently, I will begin building an online version in QuestionPro so that the SCI can see how this instrument will actually appear to future Working Group members who participate in the self-assessment. Taking this action does not mean that we cannot continue making further changes and improvements to the questionnaire, but my sense is that it we are ready to proceed to this next phase of the project. Ken Bour From: owner-gnso-improvem-impl-sc(a)icann.org [mailto:owner-gnso-improvem-impl-sc@icann.org] On Behalf Of Mike O'Connor Sent: Friday, July 05, 2013 12:08 PM To: Ken Bour Cc: gnso-improvem-impl-sc(a)icann.org Subject: Re: [gnso-improvem-impl-sc] WG Self-Assessment Questionnaire (Draft v3) hi Ken, i'm on board with all your proposed changes. i think this is getting really close to "ship it!" for me. :-) mikey On Jul 4, 2013, at 11:28 AM, Ken Bour <ken.bour(a)verizon.net> wrote: SCI Team Members: After our last teleconference (2 July), I continued my own evaluation of the questionnaire looking for ways to sharpen and improve it including addressing your feedback received thus far. I developed a new Draft v3 for your review at: <https://community.icann.org/x/eEZ-Ag> https://community.icann.org/x/eEZ-Ag. In this version of the questionnaire, I made the following substantive changes: 1. The "Expertise" question (Section II) was modified in an attempt to address Ron's observation about the expected variability in team members' knowledge/skill. 2. Tangential to Ron's concern, I added a new disclaimer in the note just before Section II to explain how respondents might approach the challenge of assigning individual ratings to complex dimensions. 3. In Section V, I substituted "Engagement" for "Participation" and changed the wording of the first question to address Wolf-Ulrich's feedback entered as a comment to Draft v2. 4. I elected to break out Personal Dimensions and Demographics into two independent sections. Each one represents a logically distinct category; furthermore, the table headings simply did not apply correctly to the Demographics questions. 5. Added a third question to the Personal Dimensions which I labeled "Willingness-to-Serve" for want of a better noun. This question seeks to understand whether the WG experience influences one's propensity to serve again in the future assuming all other conditions (e.g., topic, need/fit, availability) are favorable. In other words, are we systematically building or eroding volunteer capacity? I look forward to your feedback on this third iteration of the WG Self-Assessment instrument. As you may know, I will not be present in Durban; however, if the team wishes to continue working on this project and would like my involvement, I am willing to join in any/all sessions remotely if technical conditions (e.g., room connections) permit. Regards, Ken PHONE: 651-647-6109, FAX: 866-280-2356, WEB: www.haven2.com, HANDLE: OConnorStP (ID for Twitter, Facebook, LinkedIn, etc.)

1 0

FOR REVIEW: Draft Note to GNSO Council Chair re SCI Charter
by Julie Hedlund July 8, 2013

July 8, 2013

Dear SCI members, As discussed in our meeting yesterday, below for your review is a draft message alerting Jonathan that the SCI would like to discuss the issues concerning the SCI Charter with the Council during the working session in Durban. Please send any comments by Friday, 05 July. Best regards, Julie Julie Hedlund, Policy Director ----------------------------- Draft Message to Jonathan ------------------------ Dear Jonathan, As you know, the Standing Committee on Improvements Implementation (SCI) will provide an update on its work to the GNSO Council in Durban on 13 July. One of issues the SCI is considering is an update of its Charter, as we have reported previously. This began as an effort to update the Charter to include procedures to elect the SCI Chair and Vice Chair, but recently the SCI also has considered whether other updates are necessary. After discussing possible updates the SCI members realized that they need guidance from the GNSO Council as to whether the SCI's work should be limited to a review of the procedures developed in the GNSO Implementations process, or whether the GNSO Council intends for the SCI to address other procedural issues not related to the improvements process. One such example might be the re-submission of a motion, which is an issue the Council asked the SCI to address and for which the SCI currently is considering revised procedures. The current Charter states: "The GNSO Standing Committee on Improvement Implementation (SCI) will be responsible for reviewing and assessing the effective functioning of recommendations provided by the Operational Steering Committee (OSC), Policy Process Steering Committee (PPSC) and Policy Development Process Work Team (PDP-WT) and approved by the GNSO Council: * On request for those recommendations that have been identified to present immediate problems * On a periodic timescale for all recommendations in order to identify possible issues and/or improvements (subject to a clear definition by the SCI on which recommendations should be reviewed)" The SCI seeks guidance from the Council on what is its intent with respect to the duration of the SCI work. Should the SCI cease to exist when it has completed the second bullet above from the Charter? Or should the SCI continue indefinitely to consider procedural questions as raised the the GNSO Council or a group Chartered by the Council? It seems that these fundamental questions need to be addressed before the SCI can consider revisions to the Charter. The SCI members look forward to discussing these questions with the Council in Durban. Best regards, Ron Ron Andruff, Chair, SCI

5 10