Draft criteria for comparison of accountability mechanisms
Dear Colleagues, Drawing from the Mathieu's propositions, I propose a matrix for comparative mapping. Version 1 workbook is attached, if agreed then it may be further developed, refined, populated, and weights may be assigned and added to reach conclusion. * Inline text not in matrix form. *Parameters and Questions to Map and Compare Effectiveness of Accountability Options * *Comparison Parameter* *Corresponding Questions* *Option A* *Option B* *Option C....* Legitimacy Is one of the options more legitimate in its nature due to higher scope for transparency, inclusivity and rationality? Legality Is legality of one of the options more apparent and/or easy to establish? Feasibility (Practical) Is implementation of one of the options more practically feasible due to exclusivity of system, simplicity of design and legality of process? Viability (Financial) Is one of the options more viable due to the simplicity of operation, including of level of attention and resource required from the community to make the mechanism work? Acceptability (Recognition) Is one of the options more supported and recognized due to historic reasons or current legal and stability concerns? Rationality Is explaining one of the options, internally and externally more easy due to its rationality and simplicity of design? Utility Does one of the options provide improved review and redress? Inclusivity Does one of the options provide better consultation and extend accountability to more relevant stakeholders? Indispensability Is one of the options indispensable due to some legal and strategic reasons? Tenacity Is one of the options more tenacious due to higher potential of ensuring check and balance and predictability on one hand, and of mitigating capture and immunities on other? Regards, Renu Sirothiya On Mon, Mar 16, 2015 at 10:33 PM, Mathieu Weill <mathieu.weill@afnic.fr> wrote:
Dear Colleagues,
Apologies for first cut off email.
A discussion was raised with WP1 about how we would reach decisions when comparing various options for the accountability mechanisms we are working on.
In anticipation of our CCWG call please find below a first draft list of questions which should enable us to, at least, clarify the merits of the various options before we reach conclusions. This is of particular importance before our meeting in Istanbul.
You will be provided an opportunity to comment during the call tomorrow, but this can also be achieved via mailing list.
Best, Mathieu --------------------------------------- Key criteria to compare options :
1) Comparing enhancements to accountability
a) Aspects of accountability - does one option provide greater transparency ? - does one option provide better consultation ? - does one option provide improved review ? e - does one option provide improved redress ?
b) Qualities of accountability mechanisms - does one option provide better checks and balances ? - does one option provide better independence ?
c) Stakeholders : does one option extend accountability to more relevant stakeholders ?
d) Purpose : does one option enable accountability to more of the relevant accountability purposes ?
2) Effectiveness : Would one of the options be more effective ?
3) Simplicity : is one option simpler / easier / faster to set up ? a) Simplicity of design - what is the level of simplicity to implement and to explain, internally and externally? b) Simplicity of operation - what is the level of attention and resource required from the community to make the mechanism work?
_______________________________________________ Accountability-Cross-Community mailing list Accountability-Cross-Community@icann.org https://mm.icann.org/mailman/listinfo/accountability-cross-community
Dear Renu, Many thanks for this great work. It definitely shows better in a spreadsheet. I have attached a commented version of the document. In general I believe we should try and stay on the (safer) ground of agreed upon definitions for our parameters, that is the reason why I suggest several changes. I also raise some questions about the notions you put up when unsure what the definition would be. This should hopefully lead to a bit of simplification of the matrix. Best, Mathieu Le 16/03/2015 20:54, RENU SIROTHIYA a écrit :
Dear Colleagues,
Drawing from the Mathieu's propositions, I propose a matrix for comparative mapping. Version 1 workbook is attached, if agreed then it may be further developed, refined, populated, and weights may be assigned and added to reach conclusion.
* Inline text not in matrix form.
*Parameters and Questions to Map and Compare Effectiveness of Accountability Options *
*Comparison Parameter*
*Corresponding Questions*
*Option A*
*Option B*
*Option C....*
Legitimacy
Is one of the options more legitimate in its nature due to higher scope for transparency, inclusivity and rationality?
Legality
Is legality of one of the options more apparent and/or easy to establish?
Feasibility (Practical)
Is implementation of one of the options more practically feasible due to exclusivity of system, simplicity of design and legality of process?
Viability (Financial)
Is one of the options more viable due to the simplicity of operation, including of level of attention and resource required from the community to make the mechanism work?
Acceptability (Recognition)
Is one of the options more supported and recognized due to historic reasons or current legal and stability concerns?
Rationality
Is explaining one of the options, internally and externally more easy due to its rationality and simplicity of design?
Utility
Does one of the options provide improved review and redress?
Inclusivity
Does one of the options provide better consultation and extend accountability to more relevant stakeholders?
Indispensability
Is one of the options indispensable due to some legal and strategic reasons?
Tenacity
Is one of the options more tenacious due to higher potential of ensuring check and balance and predictability on one hand, and of mitigating capture and immunities on other?
Regards,
Renu Sirothiya
On Mon, Mar 16, 2015 at 10:33 PM, Mathieu Weill <mathieu.weill@afnic.fr <mailto:mathieu.weill@afnic.fr>> wrote:
Dear Colleagues,
Apologies for first cut off email.
A discussion was raised with WP1 about how we would reach decisions when comparing various options for the accountability mechanisms we are working on.
In anticipation of our CCWG call please find below a first draft list of questions which should enable us to, at least, clarify the merits of the various options before we reach conclusions. This is of particular importance before our meeting in Istanbul.
You will be provided an opportunity to comment during the call tomorrow, but this can also be achieved via mailing list.
Best, Mathieu --------------------------------------- Key criteria to compare options :
1) Comparing enhancements to accountability
a) Aspects of accountability - does one option provide greater transparency ? - does one option provide better consultation ? - does one option provide improved review ? e - does one option provide improved redress ?
b) Qualities of accountability mechanisms - does one option provide better checks and balances ? - does one option provide better independence ?
c) Stakeholders : does one option extend accountability to more relevant stakeholders ?
d) Purpose : does one option enable accountability to more of the relevant accountability purposes ?
2) Effectiveness : Would one of the options be more effective ?
3) Simplicity : is one option simpler / easier / faster to set up ? a) Simplicity of design - what is the level of simplicity to implement and to explain, internally and externally? b) Simplicity of operation - what is the level of attention and resource required from the community to make the mechanism work?
_______________________________________________ Accountability-Cross-Community mailing list Accountability-Cross-Community@icann.org <mailto:Accountability-Cross-Community@icann.org> https://mm.icann.org/mailman/listinfo/accountability-cross-community
-- ***************************** Mathieu WEILL AFNIC - directeur général Tél: +33 1 39 30 83 06 mathieu.weill@afnic.fr Twitter : @mathieuweill *****************************
On 2015-03-17 10:24, Mathieu Weill wrote:
Dear Renu,
Many thanks for this great work. It definitely shows better in a spreadsheet.
I have attached a commented version of the document. In general I believe we should try and stay on the (safer) ground of agreed upon definitions for our parameters, that is the reason why I suggest several changes. I also raise some questions about the notions you put up when unsure what the definition would be. This should hopefully lead to a bit of simplification of the matrix.
I am a bit concerned a chart like this is apt to mislead as much as to inform. Its format carries an implication that all these factors are of equal weight; I do not agree that they are. For example, in my opinion, the effectiveness of an accountability mechanism has primacy: does it actually deliver the remedy that it promises to the problem it is designed to address? Questions of which mechanism is cheapest to implement, or simplest from a legal point of view, are rather secondary - at least having passed a basic minimum threshold (financially and legally possible). If we're not careful we could divert a lot of time and effort into discussing the format of a chart like this, that could be better spent examining the proposals themselves. So rather than try to create the perfect chart, I'd rather say "use this if you like, but I don't think we should frame our discussion around it". -- Malcolm Hutty | tel: +44 20 7645 3523 Head of Public Affairs | Read the LINX Public Affairs blog London Internet Exchange | http://publicaffairs.linx.net/ London Internet Exchange Ltd 21-27 St Thomas Street, London SE1 9RY Company Registered in England No. 3137929 Trinity Court, Trinity Street, Peterborough PE1 1DA
Dear Malcolm, I completely identify and appreciate that time is of essence and prioritization is the key. In fact this is what motivated me to suggest a matrix because such framework may give direction to assessment. But if there is none, I wonder what would be the approach for relative assessment of options? I'm afraid then evaluation would be subjective and not objective/accountable. On your contention that 'weights of different parameters are likely to be not equal', I again agree, and clarify that this why in my previous mail, I didn't state scale and scores, but rather categorically mention that weights may be assigned (please read after agreement). [On this @Roelof (in mail of Tue, Mar 17, 2015 at 10:49 PM) suggested, "we could give different criteria different weights, according to importance." I second that.] Further, I submit that if exercise of having a scorecard to underpin the process is not undertaken, then - different assessors will have different notions of relative importance of a parameter, - this way they will end up deriving different conclusions, and - in effect there will be further deliberations and we will actually loose time. In my considerate view, this is essential. Seems @Roelof agrees. From my end if other colleagues agree, I stand to contribute on this further, and while doing so as suggested by @Mathieu (in mail of Tue, Mar 17, 2015 at 3:54 PM), attempt would be to adhere to agreed upon definitions and to keep it simple. Best, Renu Sirothiya On Tue, Mar 17, 2015 at 4:40 PM, Malcolm Hutty <malcolm@linx.net> wrote:
On 2015-03-17 10:24, Mathieu Weill wrote:
Dear Renu,
Many thanks for this great work. It definitely shows better in a spreadsheet.
I have attached a commented version of the document. In general I believe we should try and stay on the (safer) ground of agreed upon definitions for our parameters, that is the reason why I suggest several changes. I also raise some questions about the notions you put up when unsure what the definition would be. This should hopefully lead to a bit of simplification of the matrix.
I am a bit concerned a chart like this is apt to mislead as much as to inform. Its format carries an implication that all these factors are of equal weight; I do not agree that they are.
For example, in my opinion, the effectiveness of an accountability mechanism has primacy: does it actually deliver the remedy that it promises to the problem it is designed to address?
Questions of which mechanism is cheapest to implement, or simplest from a legal point of view, are rather secondary - at least having passed a basic minimum threshold (financially and legally possible).
If we're not careful we could divert a lot of time and effort into discussing the format of a chart like this, that could be better spent examining the proposals themselves. So rather than try to create the perfect chart, I'd rather say "use this if you like, but I don't think we should frame our discussion around it".
-- Malcolm Hutty | tel: +44 20 7645 3523 Head of Public Affairs | Read the LINX Public Affairs blog London Internet Exchange | http://publicaffairs.linx.net/
London Internet Exchange Ltd 21-27 St Thomas Street, London SE1 9RY
Company Registered in England No. 3137929 Trinity Court, Trinity Street, Peterborough PE1 1DA
Dear Renu, Malcolm, Roelof & colleagues, Based on our discussion during the call yesterday, I think we have touched upon some of the concerns raised as well as useful things to consider going forward. First, we clarified this tool would not be used for systematic rating of proposals but rather as a tool to better understand the impact of various options and frame the discussions in a manner that remains focused on the objective requirements. We have also received interesting inputs about the criteria themselves. Legality (following legal advice on feasability for instance) as well as synergy (ability for a mechanism to be used for several powers, or rely on existing mechanisms) are added to the list. However we need to try and keep this as simple as possible. I have attached an updated version incorporating these inputs. Best Mathieu Le 17/03/2015 20:38, RENU SIROTHIYA a écrit :
Dear Malcolm,
I completely identify and appreciate that time is of essence and prioritization is the key. In fact this is what motivated me to suggest a matrix because such framework may give direction to assessment. But if there is none, I wonder what would be the approach for relative assessment of options? I'm afraid then evaluation would be subjective and not objective/accountable.
On your contention that 'weights of different parameters are likely to be not equal', I again agree, and clarify that this why in my previous mail, I didn't state scale and scores, but rather categorically mention that weights may be assigned (please read after agreement). [On this @Roelof (in mail of Tue, Mar 17, 2015 at 10:49 PM) suggested, "we could give different criteria different weights, according to importance." I second that.]
Further, I submit that if exercise of having a scorecard to underpin the process is not undertaken, then
* different assessors will have different notions of relative importance of a parameter, * this way they will end up deriving different conclusions, and * in effect there will be further deliberations and we will actually loose time.
In my considerate view, this is essential. Seems @Roelof agrees. From my end if other colleagues agree, I stand to contribute on this further, and while doing so as suggested by @Mathieu (in mail of Tue, Mar 17, 2015 at 3:54 PM), attempt would be to adhere to agreed upon definitions and to keep it simple.
Best,
Renu Sirothiya
On Tue, Mar 17, 2015 at 4:40 PM, Malcolm Hutty <malcolm@linx.net <mailto:malcolm@linx.net>> wrote:
On 2015-03-17 10:24, Mathieu Weill wrote:
Dear Renu,
Many thanks for this great work. It definitely shows better in a spreadsheet.
I have attached a commented version of the document. In general I believe we should try and stay on the (safer) ground of agreed upon definitions for our parameters, that is the reason why I suggest several changes. I also raise some questions about the notions you put up when unsure what the definition would be. This should hopefully lead to a bit of simplification of the matrix.
I am a bit concerned a chart like this is apt to mislead as much as to inform. Its format carries an implication that all these factors are of equal weight; I do not agree that they are.
For example, in my opinion, the effectiveness of an accountability mechanism has primacy: does it actually deliver the remedy that it promises to the problem it is designed to address?
Questions of which mechanism is cheapest to implement, or simplest from a legal point of view, are rather secondary - at least having passed a basic minimum threshold (financially and legally possible).
If we're not careful we could divert a lot of time and effort into discussing the format of a chart like this, that could be better spent examining the proposals themselves. So rather than try to create the perfect chart, I'd rather say "use this if you like, but I don't think we should frame our discussion around it".
-- Malcolm Hutty | tel: +44 20 7645 3523 Head of Public Affairs | Read the LINX Public Affairs blog London Internet Exchange | http://publicaffairs.linx.net/
London Internet Exchange Ltd 21-27 St Thomas Street, London SE1 9RY
Company Registered in England No. 3137929 Trinity Court, Trinity Street, Peterborough PE1 1DA
-- ***************************** Mathieu WEILL AFNIC - directeur général Tél: +33 1 39 30 83 06 mathieu.weill@afnic.fr Twitter : @mathieuweill *****************************
Renu, Missed your work when I wrote my email during a flight. Suggest we combine Best, Roelof From: RENU SIROTHIYA <renusirothiya@gmail.com<mailto:renusirothiya@gmail.com>> Date: maandag 16 maart 2015 20:54 To: "accountability-cross-community@icann.org<mailto:accountability-cross-community@icann.org>" <accountability-cross-community@icann.org<mailto:accountability-cross-community@icann.org>>, "wp1@icann.org<mailto:wp1@icann.org>" <wp1@icann.org<mailto:wp1@icann.org>> Subject: [CCWG-ACCT] Draft criteria for comparison of accountability mechanisms Dear Colleagues, Drawing from the Mathieu's propositions, I propose a matrix for comparative mapping. Version 1 workbook is attached, if agreed then it may be further developed, refined, populated, and weights may be assigned and added to reach conclusion. * Inline text not in matrix form. Parameters and Questions to Map and Compare Effectiveness of Accountability Options Comparison Parameter Corresponding Questions Option A Option B Option C.... Legitimacy Is one of the options more legitimate in its nature due to higher scope for transparency, inclusivity and rationality? Legality Is legality of one of the options more apparent and/or easy to establish? Feasibility (Practical) Is implementation of one of the options more practically feasible due to exclusivity of system, simplicity of design and legality of process? Viability (Financial) Is one of the options more viable due to the simplicity of operation, including of level of attention and resource required from the community to make the mechanism work? Acceptability (Recognition) Is one of the options more supported and recognized due to historic reasons or current legal and stability concerns? Rationality Is explaining one of the options, internally and externally more easy due to its rationality and simplicity of design? Utility Does one of the options provide improved review and redress? Inclusivity Does one of the options provide better consultation and extend accountability to more relevant stakeholders? Indispensability Is one of the options indispensable due to some legal and strategic reasons? Tenacity Is one of the options more tenacious due to higher potential of ensuring check and balance and predictability on one hand, and of mitigating capture and immunities on other? Regards, Renu Sirothiya On Mon, Mar 16, 2015 at 10:33 PM, Mathieu Weill <mathieu.weill@afnic.fr<mailto:mathieu.weill@afnic.fr>> wrote: Dear Colleagues, Apologies for first cut off email. A discussion was raised with WP1 about how we would reach decisions when comparing various options for the accountability mechanisms we are working on. In anticipation of our CCWG call please find below a first draft list of questions which should enable us to, at least, clarify the merits of the various options before we reach conclusions. This is of particular importance before our meeting in Istanbul. You will be provided an opportunity to comment during the call tomorrow, but this can also be achieved via mailing list. Best, Mathieu --------------------------------------- Key criteria to compare options : 1) Comparing enhancements to accountability a) Aspects of accountability - does one option provide greater transparency ? - does one option provide better consultation ? - does one option provide improved review ? e - does one option provide improved redress ? b) Qualities of accountability mechanisms - does one option provide better checks and balances ? - does one option provide better independence ? c) Stakeholders : does one option extend accountability to more relevant stakeholders ? d) Purpose : does one option enable accountability to more of the relevant accountability purposes ? 2) Effectiveness : Would one of the options be more effective ? 3) Simplicity : is one option simpler / easier / faster to set up ? a) Simplicity of design - what is the level of simplicity to implement and to explain, internally and externally? b) Simplicity of operation - what is the level of attention and resource required from the community to make the mechanism work? _______________________________________________ Accountability-Cross-Community mailing list Accountability-Cross-Community@icann.org<mailto:Accountability-Cross-Community@icann.org> https://mm.icann.org/mailman/listinfo/accountability-cross-community
participants (4)
-
Malcolm Hutty -
Mathieu Weill -
RENU SIROTHIYA -
Roelof Meijer