[RSS Metrics] Update on the RSS Metrics document
Dear RSS Metrics WP, Following the RSS metrics discussions at ICANN66 and IETF106, the work party co-chair and staff worked on the document to address your comments. We have identified a few outstanding comments to be discussed at the upcoming WP call. But otherwise, the document is stable. Therefore, the staff has put the document into view only mode. If you have any substantial comments please submit them directly to the mailing list with alternative wording. If you have copy-edit comments, please submit them to Steve Sheng (steve.sheng@icann.org<mailto:steve.sheng@icann.org>). Best Steve
On Wed 2019-11-27 20:12:21+0000 Steve wrote:
We have identified a few outstanding comments to be discussed at the upcoming WP call. But otherwise, the document is stable.
When is the upcoming call? -- Robert Story <http://www.isi.edu/~rstory> USC Information Sciences Institute <http://www.isi.edu/>
Hi Robert, The upcoming call will be held on the week of 16 December. I will circulate a calendar invitation shortly with the exact date and time once the Metrics work party co-chairs have finalized them based on the doodle poll results. Best, Ozan Sahin Policy Specialist Internet Corporation for Assigned Names and Numbers (ICANN) Telephone: +90 212 999 6218 Mobile: +90 533 641 0007 Skype: ozan.sahin.icann www.icann.org<applewebdata://021EB1F1-F6B6-443A-908F-419605BF3A61/www.icann.org> From: rssac-caucus <rssac-caucus-bounces@icann.org> on behalf of Robert Story <rstory@isi.edu> Organization: USC Information Sciences Institute Date: Thursday, November 28, 2019 at 12:27 PM To: Steve Sheng <steve.sheng@icann.org> Cc: "rssac-caucus@icann.org" <rssac-caucus@icann.org> Subject: Re: [RSSAC Caucus] [RSS Metrics] Update on the RSS Metrics document On Wed 2019-11-27 20:12:21+0000 Steve wrote: We have identified a few outstanding comments to be discussed at the upcoming WP call. But otherwise, the document is stable. When is the upcoming call? -- Robert Story <https://urldefense.proofpoint.com/v2/url?u=http-3A__www.isi.edu_-7Erstory&d=... > USC Information Sciences Institute <https://urldefense.proofpoint.com/v2/url?u=http-3A__www.isi.edu_&d=DwICAg&c=... > _______________________________________________ rssac-caucus mailing list rssac-caucus@icann.org<mailto:rssac-caucus@icann.org> https://mm.icann.org/mailman/listinfo/rssac-caucus _______________________________________________ By submitting your personal data, you consent to the processing of your personal data for purposes of subscribing to this mailing list accordance with the ICANN Privacy Policy (https://urldefense.proofpoint.com/v2/url?u=https-3A__www.icann.org_privacy_p... ) and the website Terms of Service (https://urldefense.proofpoint.com/v2/url?u=https-3A__www.icann.org_privacy_t... ). You can visit the Mailman link above to change your membership status or configuration, including unsubscribing, setting digest-style delivery or disabling delivery altogether (e.g., for a vacation), and so on.
Dear Metrics WP, Please see the attached document in PDF that shows the remaining areas (with comments) that needs to be addressed. The google doc is in view only mode, so you might not be able to see all these comments. https://docs.google.com/document/d/1vC2OTSOdWKjmUQanYx4ZlUGnu-5npwvJzRRSFg1B... Best Steve From: Steve Sheng <steve.sheng@icann.org> Date: Wednesday, November 27, 2019 at 12:12 PM To: "rssac-caucus@icann.org" <rssac-caucus@icann.org> Subject: [RSS Metrics] Update on the RSS Metrics document Dear RSS Metrics WP, Following the RSS metrics discussions at ICANN66 and IETF106, the work party co-chair and staff worked on the document to address your comments. We have identified a few outstanding comments to be discussed at the upcoming WP call. But otherwise, the document is stable. Therefore, the staff has put the document into view only mode. If you have any substantial comments please submit them directly to the mailing list with alternative wording. If you have copy-edit comments, please submit them to Steve Sheng (steve.sheng@icann.org<mailto:steve.sheng@icann.org>). Best Steve
On Dec 3, 2019, at 2:38 PM, Steve Sheng <steve.sheng@icann.org> wrote:
The google doc is in view only mode, so you might not be able to see all these comments. https://docs.google.com/document/d/1vC2OTSOdWKjmUQanYx4ZlUGnu-5npwvJzRRSFg1B...
You're correct. We can't see the comments, meaning that it is difficult to further review.
Hi, I was not able to see the comments on the google doc - probably to the read-only mode. The PDF version provides these comments: My small inputs. Comments 3/4. I am inclined to say the paragraph is a bit redundant with what is mentioned above. I would probably remove it. Comment 5/6/7: I am inclined that the definition of k is more associated to a model than the way resolvers evaluates the servers. As our purpose is RSI, I would be inclined to stay away from resolver's behavior. On the other hand, it might worth mentioning that our model to derive k may appear as naive given how resolvers work. Comment 9: I have the impression we used median. I do not know if that is better than a mean, but I believe we can stay with median for this version of the document. Yours, Daniel On Tue, Dec 3, 2019 at 5:39 PM Steve Sheng <steve.sheng@icann.org> wrote:
Dear Metrics WP,
Please see the attached document in PDF that shows the remaining areas (with comments) that needs to be addressed.
The google doc is in view only mode, so you might not be able to see all these comments.
https://docs.google.com/document/d/1vC2OTSOdWKjmUQanYx4ZlUGnu-5npwvJzRRSFg1B...
Best
Steve
*From: *Steve Sheng <steve.sheng@icann.org> *Date: *Wednesday, November 27, 2019 at 12:12 PM *To: *"rssac-caucus@icann.org" <rssac-caucus@icann.org> *Subject: *[RSS Metrics] Update on the RSS Metrics document
Dear RSS Metrics WP,
Following the RSS metrics discussions at ICANN66 and IETF106, the work party co-chair and staff worked on the document to address your comments.
We have identified a few outstanding comments to be discussed at the upcoming WP call. But otherwise, the document is stable. Therefore, the staff has put the document into view only mode.
If you have any substantial comments please submit them directly to the mailing list with alternative wording.
If you have copy-edit comments, please submit them to Steve Sheng ( steve.sheng@icann.org).
Best
Steve _______________________________________________ rssac-caucus mailing list rssac-caucus@icann.org https://mm.icann.org/mailman/listinfo/rssac-caucus
_______________________________________________ By submitting your personal data, you consent to the processing of your personal data for purposes of subscribing to this mailing list accordance with the ICANN Privacy Policy (https://www.icann.org/privacy/policy) and the website Terms of Service (https://www.icann.org/privacy/tos). You can visit the Mailman link above to change your membership status or configuration, including unsubscribing, setting digest-style delivery or disabling delivery altogether (e.g., for a vacation), and so on.
-- Daniel Migault Ericsson 8400 boulevard Decarie Montreal, QC H4P 2N2 Canada Phone: +1 514-452-2160
Thanks Daniel, comments noted! Best Steve From: Daniel Migault <mglt.biz@gmail.com> Date: Tuesday, December 3, 2019 at 6:48 PM To: Steve Sheng <steve.sheng@icann.org> Cc: "rssac-caucus@icann.org" <rssac-caucus@icann.org> Subject: [Ext] Re: [RSSAC Caucus] [RSS Metrics] Update on the RSS Metrics document Hi, I was not able to see the comments on the google doc - probably to the read-only mode. The PDF version provides these comments: My small inputs. Comments 3/4. I am inclined to say the paragraph is a bit redundant with what is mentioned above. I would probably remove it. Comment 5/6/7: I am inclined that the definition of k is more associated to a model than the way resolvers evaluates the servers. As our purpose is RSI, I would be inclined to stay away from resolver's behavior. On the other hand, it might worth mentioning that our model to derive k may appear as naive given how resolvers work. Comment 9: I have the impression we used median. I do not know if that is better than a mean, but I believe we can stay with median for this version of the document. Yours, Daniel On Tue, Dec 3, 2019 at 5:39 PM Steve Sheng <steve.sheng@icann.org<mailto:steve.sheng@icann.org>> wrote: Dear Metrics WP, Please see the attached document in PDF that shows the remaining areas (with comments) that needs to be addressed. The google doc is in view only mode, so you might not be able to see all these comments. https://docs.google.com/document/d/1vC2OTSOdWKjmUQanYx4ZlUGnu-5npwvJzRRSFg1B... [docs.google.com]<https://urldefense.proofpoint.com/v2/url?u=https-3A__docs.google.com_documen...> Best Steve From: Steve Sheng <steve.sheng@icann.org<mailto:steve.sheng@icann.org>> Date: Wednesday, November 27, 2019 at 12:12 PM To: "rssac-caucus@icann.org<mailto:rssac-caucus@icann.org>" <rssac-caucus@icann.org<mailto:rssac-caucus@icann.org>> Subject: [RSS Metrics] Update on the RSS Metrics document Dear RSS Metrics WP, Following the RSS metrics discussions at ICANN66 and IETF106, the work party co-chair and staff worked on the document to address your comments. We have identified a few outstanding comments to be discussed at the upcoming WP call. But otherwise, the document is stable. Therefore, the staff has put the document into view only mode. If you have any substantial comments please submit them directly to the mailing list with alternative wording. If you have copy-edit comments, please submit them to Steve Sheng (steve.sheng@icann.org<mailto:steve.sheng@icann.org>). Best Steve _______________________________________________ rssac-caucus mailing list rssac-caucus@icann.org<mailto:rssac-caucus@icann.org> https://mm.icann.org/mailman/listinfo/rssac-caucus _______________________________________________ By submitting your personal data, you consent to the processing of your personal data for purposes of subscribing to this mailing list accordance with the ICANN Privacy Policy (https://www.icann.org/privacy/policy [icann.org]<https://urldefense.proofpoint.com/v2/url?u=https-3A__www.icann.org_privacy_p...>) and the website Terms of Service (https://www.icann.org/privacy/tos [icann.org]<https://urldefense.proofpoint.com/v2/url?u=https-3A__www.icann.org_privacy_t...>). You can visit the Mailman link above to change your membership status or configuration, including unsubscribing, setting digest-style delivery or disabling delivery altogether (e.g., for a vacation), and so on. -- Daniel Migault Ericsson 8400 boulevard Decarie Montreal, QC H4P 2N2 Canada Phone: +1 514-452-2160
I was able to see the comments in the pdf attachment. Here are my thoughts on some of comments: Comment3/4 - I think the paragraph in question expands on the ending of the previous sentence/paragraph: "and diverse connectivity providers". To me, having diverse connectivity providers is critical. Unlike root servers that typically peer with many providers at a facility, vantage points will most likely have a connection to a single provider (ISP) who may have a very different routing policy than the another ISP three racks over. My vote is to leave the additional paragraph in to reinforce the connectivity diversity recommendation. Comment 8 - I may have started the discussion on this point. After reviewing some publication latency data I envisioned a worst case scenario where a root could have horrible publishing latency to slightly less than half the vantage points and still have a great median, so I threw a comment in the doc right before hoping on a plane. After some thought I decided this was an unrealistic contrived scenario, and that publication latency isn't that different from our other metrics. My thought is to leave it 'median' for consistency. -Karl On 12/3/19 5:38 PM, Steve Sheng wrote:
Dear Metrics WP,
Please see the attached document in PDF that shows the remaining areas (with comments) that needs to be addressed.
The google doc is in view only mode, so you might not be able to see all these comments.
https://docs.google.com/document/d/1vC2OTSOdWKjmUQanYx4ZlUGnu-5npwvJzRRSFg1B...
Best
Steve
*From: *Steve Sheng <steve.sheng@icann.org> *Date: *Wednesday, November 27, 2019 at 12:12 PM *To: *"rssac-caucus@icann.org" <rssac-caucus@icann.org> *Subject: *[RSS Metrics] Update on the RSS Metrics document
Dear RSS Metrics WP,
Following the RSS metrics discussions at ICANN66 and IETF106, the work party co-chair and staff worked on the document to address your comments.
We have identified a few outstanding comments to be discussed at the upcoming WP call. But otherwise, the document is stable. Therefore, the staff has put the document into view only mode.
If you have any substantial comments please submit them directly to the mailing list with alternative wording.
If you have copy-edit comments, please submit them to Steve Sheng (steve.sheng@icann.org <mailto:steve.sheng@icann.org>).
Best
Steve
_______________________________________________ rssac-caucus mailing list rssac-caucus@icann.org https://mm.icann.org/mailman/listinfo/rssac-caucus
_______________________________________________ By submitting your personal data, you consent to the processing of your personal data for purposes of subscribing to this mailing list accordance with the ICANN Privacy Policy (https://www.icann.org/privacy/policy) and the website Terms of Service (https://www.icann.org/privacy/tos). You can visit the Mailman link above to change your membership status or configuration, including unsubscribing, setting digest-style delivery or disabling delivery altogether (e.g., for a vacation), and so on.
Thanks Karl, comments noted! Best Steve From: Karl Reuss <reuss@umd.edu> Date: Wednesday, December 4, 2019 at 12:52 PM To: Steve Sheng <steve.sheng@icann.org> Cc: "rssac-caucus@icann.org" <rssac-caucus@icann.org> Subject: [Ext] Re: [RSSAC Caucus] [RSS Metrics] Update on the RSS Metrics document I was able to see the comments in the pdf attachment. Here are my thoughts on some of comments: Comment3/4 - I think the paragraph in question expands on the ending of the previous sentence/paragraph: "and diverse connectivity providers". To me, having diverse connectivity providers is critical. Unlike root servers that typically peer with many providers at a facility, vantage points will most likely have a connection to a single provider (ISP) who may have a very different routing policy than the another ISP three racks over. My vote is to leave the additional paragraph in to reinforce the connectivity diversity recommendation. Comment 8 - I may have started the discussion on this point. After reviewing some publication latency data I envisioned a worst case scenario where a root could have horrible publishing latency to slightly less than half the vantage points and still have a great median, so I threw a comment in the doc right before hoping on a plane. After some thought I decided this was an unrealistic contrived scenario, and that publication latency isn't that different from our other metrics. My thought is to leave it 'median' for consistency. -Karl On 12/3/19 5:38 PM, Steve Sheng wrote: Dear Metrics WP, Please see the attached document in PDF that shows the remaining areas (with comments) that needs to be addressed. The google doc is in view only mode, so you might not be able to see all these comments. https://docs.google.com/document/d/1vC2OTSOdWKjmUQanYx4ZlUGnu-5npwvJzRRSFg1B... [docs.google.com]<https://urldefense.proofpoint.com/v2/url?u=https-3A__docs.google.com_documen...> Best Steve From: Steve Sheng <steve.sheng@icann.org><mailto:steve.sheng@icann.org> Date: Wednesday, November 27, 2019 at 12:12 PM To: "rssac-caucus@icann.org"<mailto:rssac-caucus@icann.org> <rssac-caucus@icann.org><mailto:rssac-caucus@icann.org> Subject: [RSS Metrics] Update on the RSS Metrics document Dear RSS Metrics WP, Following the RSS metrics discussions at ICANN66 and IETF106, the work party co-chair and staff worked on the document to address your comments. We have identified a few outstanding comments to be discussed at the upcoming WP call. But otherwise, the document is stable. Therefore, the staff has put the document into view only mode. If you have any substantial comments please submit them directly to the mailing list with alternative wording. If you have copy-edit comments, please submit them to Steve Sheng (steve.sheng@icann.org<mailto:steve.sheng@icann.org>). Best Steve _______________________________________________ rssac-caucus mailing list rssac-caucus@icann.org<mailto:rssac-caucus@icann.org> https://mm.icann.org/mailman/listinfo/rssac-caucus _______________________________________________ By submitting your personal data, you consent to the processing of your personal data for purposes of subscribing to this mailing list accordance with the ICANN Privacy Policy (https://www.icann.org/privacy/policy [icann.org]<https://urldefense.proofpoint.com/v2/url?u=https-3A__www.icann.org_privacy_p...>) and the website Terms of Service (https://www.icann.org/privacy/tos [icann.org]<https://urldefense.proofpoint.com/v2/url?u=https-3A__www.icann.org_privacy_t...>). You can visit the Mailman link above to change your membership status or configuration, including unsubscribing, setting digest-style delivery or disabling delivery altogether (e.g., for a vacation), and so on.
participants (6)
-
Daniel Migault -
Fred Baker -
Karl Reuss -
Ozan Sahin -
Robert Story -
Steve Sheng