Return-Path: paul.hoffman@icann.org Received: from zmx1.isc.org (LHLO zmx1.isc.org) (149.20.0.20) by zmail1.isc.org with LMTP; Fri, 26 Oct 2018 23:00:40 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by zmx1.isc.org (Postfix) with ESMTP id 6D8A016007B for ; Fri, 26 Oct 2018 23:00:40 +0000 (UTC) Received: from zmx1.isc.org ([127.0.0.1]) by localhost (zmx1.isc.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 2kcCiMeVozYM for ; Fri, 26 Oct 2018 23:00:40 +0000 (UTC) Received: from mx.pao1.isc.org (mx.pao1.isc.org [149.20.64.53]) by zmx1.isc.org (Postfix) with ESMTPS id 5052F16007A for ; Fri, 26 Oct 2018 23:00:40 +0000 (UTC) Received: from out.west.pexch112.icann.org (out.west.pexch112.icann.org [64.78.40.7]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (No client certificate requested) by mx.pao1.isc.org (Postfix) with ESMTPS id 6DE3C3AB062 for ; Fri, 26 Oct 2018 23:00:37 +0000 (UTC) Received: from PMBX112-W1-CA-1.pexch112.icann.org (64.78.40.21) by PMBX112-W1-CA-1.pexch112.icann.org (64.78.40.21) with Microsoft SMTP Server (TLS) id 15.0.1367.3; Fri, 26 Oct 2018 16:00:35 -0700 Received: from PMBX112-W1-CA-1.pexch112.icann.org ([64.78.40.21]) by PMBX112-W1-CA-1.PEXCH112.ICANN.ORG ([64.78.40.21]) with mapi id 15.00.1367.000; Fri, 26 Oct 2018 16:00:35 -0700 From: Paul Hoffman To: Fred Baker CC: RSSAC-Caucus-Resolver-Study-WP , Carlos Reyes , Brad Verd Subject: Re: [RSSAC-Caucus-Resolver-Study-WP] Outcomes from the Work Party meeting at ICANN 63 Thread-Topic: [RSSAC-Caucus-Resolver-Study-WP] Outcomes from the Work Party meeting at ICANN 63 Thread-Index: AQHUbWaymsW9XrNdMkS+ow3IlPuj6KUymfIA Date: Fri, 26 Oct 2018 23:00:34 +0000 Message-ID: References: <07ACE7FF-7FDA-4481-96B9-DFC8EB1CF8FE@isc.org> In-Reply-To: <07ACE7FF-7FDA-4481-96B9-DFC8EB1CF8FE@isc.org> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: yes X-MS-TNEF-Correlator: x-ms-exchange-messagesentrepresentingtype: 1 x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [192.0.32.234] Content-Type: multipart/signed; boundary="Apple-Mail=_FD094C9F-79C1-42A7-86E2-FE62954B1BEB"; protocol="application/pkcs7-signature"; micalg=sha1 MIME-Version: 1.0 X-Spam-Status: No, score=-2.0 required=5.0 tests=GPG_SIGNED,SPF_HELO_PASS, SPF_PASS autolearn=disabled version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on mx.pao1.isc.org --Apple-Mail=_FD094C9F-79C1-42A7-86E2-FE62954B1BEB Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii Thanks for these extensive notes, Fred! Comments in-line. On Oct 26, 2018, at 1:01 PM, Fred Baker via = RSSAC-Caucus-Resolver-Study-WP = wrote: > We met at 13:30-14:25 on Tuesday at ICANN 63, to discuss the work = party with a larger group. Geoff Huston, Jaap Akkerhuis, Wes Hardeker, = and myself were present in the meeting, and Paul Muchene was online. >=20 > This meeting followed two other caucus-related meetings, the first of = which addressed the question of how to improve caucus participation in = work party efforts (a continuous problem), and the second addressed the = currently-active work party on Service Coverage of the Root Server = System. One suggestion regarding the Service Coverage Work Party was = that intra-work-party email should go to rssac-caucus@icann.org with = some appropriate subject line tag rather than to the work party mailer, = to improve the likelihood that caucus members that might have something = to add could do so. The RSSAC folks felt that the approach might be good = for all work parties (e.g., ours). Given that our mailer has had a grand = total of eleven messages in the past month, mostly from Mario (staff), a = few from me, and one from Jaap, this seems like it is unlikely to = materially add to the load of a typical caucus member. That raised the = question - do we want to do the same? I'd appreciate your various = viewpoints. If > having a private mailer is helpful, lets do that; if it isn't = helpful, we may be unintentionally excluding people who haven't gotten = the memo that they can be part of the effort. Agree. Is anyone on this WP-specific sub-list uncomfortable with closing = this list and instead using the full Caucus mailing list for our = discussions? > As to the discussion, it followed the following "agenda": >=20 > 1) we discussed the SOW, for those that had not read it or hadn't read = it recently. It specifies the intended outputs from the Work Party. > 2) we discussed the membership, which now is twelve people. > 3) I recapped our first call, which occurred on October 3 and had five = participants. On that call, we chose Paul Hoffman as the work party = leader, and agreed to use his lab for testing - and document it in = GitHub. There was also discussion of collaborating with Geoff's and = Jaap's labs, but they weren't on the call and as a result weren't = directly represented. > 4) we agreed to have a meeting/call at IETF 103 in Bangkok. FYI, that = will happen in Verisign's room on Tuesday Nov 6 at 12:45-13:45. Mario = has already announced this on the mailer, I believe. >=20 > It would be good to have as many of us as possible at that = meeting/call, if only to have the conversation that happens there = once... >=20 > Following my introduction, I opened the floor.=20 >=20 > Geoff took the opportunity to discuss his lab. He uses engineered = advertisements, along with an application that responds to them, to = drive user and resolver behavior using resolverless queries in ads, and = engineers the names in the ads to poke and prod at specific questions. = His main comment was that he would be happy to share data given that he = can get specific questions to generate data about. An important bit, in = his mind, is to collect questions. It would be very useful for the WP/Caucus to have a catalog of which = questions Geoff has already researched and pointers to his results. > Again following discussions from the previous meetings today, caucus = work parties are very free to modify the SOW from a working perspective, = which "dreaming up new questions" would constitute; it is important, = though, to eventually circle back and ensure that we in fact answered = the original questions (a perennial problem with work parties). >=20 > Jaap similarly very quickly gave an overview of the work being done at = NLNet Labs; once again, having a list of questions would be in order. I'll start two lists of questions (one for resolvers-in-the-lab, one for = resolvers-in-the-wild) that the WP can edit. > My sense at the moment is that=20 > 1) using the general list with the word "RESOLVER:" as the first word = in the subject line probably makes sense.=20 > 2) one thought I have is to add a wiki to the work party page, = enabling people to pose questions that can then be discussed in email. >=20 > Opinions? I take it you haven't used the ICANN-supplied Wiki much. It kinda sucks. = Registration and login are clunky, to say the least. A different idea is to use some other public document editing service = that has better editing capabilities. I have found Google Docs works = pretty well for normal documents. We don't want to require someone to = have a Google account just to participate in WP work; instead, we can = make sure that any WP documents have editing allowed for anyone in the = Caucus even if they don't have a Google account. --Paul Hoffman= --Apple-Mail=_FD094C9F-79C1-42A7-86E2-FE62954B1BEB Content-Disposition: attachment; filename="smime.p7s" Content-Type: application/pkcs7-signature; name="smime.p7s" Content-Transfer-Encoding: base64 MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIIL9DCCBZ4w ggSGoAMCAQICEAbzeOJeWp48+t/BRQQfhmcwDQYJKoZIhvcNAQELBQAwZTELMAkGA1UEBhMCVVMx FTATBgNVBAoTDERpZ2lDZXJ0IEluYzEZMBcGA1UECxMQd3d3LmRpZ2ljZXJ0LmNvbTEkMCIGA1UE AxMbRGlnaUNlcnQgU0hBMiBBc3N1cmVkIElEIENBMB4XDTE4MDYxMzAwMDAwMFoXDTIxMDYxMzEy MDAwMFowgb0xCzAJBgNVBAYTAlVTMRMwEQYDVQQIEwpDYWxpZm9ybmlhMRQwEgYDVQQHEwtMb3Mg QW5nZWxlczE8MDoGA1UEChMzSW50ZXJuZXQgQ29ycG9yYXRpb24gZm9yIEFzc2lnbmVkIE5hbWVz IGFuZCBOdW1iZXJzMR4wHAYDVQQDExVQYXVsIEhvZmZtYW4gMjAxODA2MTMxJTAjBgkqhkiG9w0B CQEWFnBhdWwuaG9mZm1hbkBpY2Fubi5vcmcwggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIB AQCtNvEFt/FuTVXENCw6YSbXhi1rYATlwFwn+S0yQL5pCtMIxJetAl+OIxRSd2d8BPUNZx+ODvTq +8hNrWWQVougX1vpw0gIwqyJsWu4XLxkDZuwg9Fc8/NKxjrOJt1K00Kmu41NCiIv1sjGVCmpFTH8 F+8cCFLuDl0A5xGCSlb1DhKLluXoDapLQiYgzOS01xXGtYCfQewb27xwpxIIEnFq9ECcy39eETu0 IgKPKh6imthnbO2Z1lQvpSAw2sPP8qh40cBbNMAfjmGfUnPUiC4Ysz8zZVvyYXx4/fACHikxUiLa MLA2oLj3tHzHSWw2vKgb67L/bqcrp+EJOpV8XqGBAgMBAAGjggHvMIIB6zAfBgNVHSMEGDAWgBTn AiOAAE/Y17yUC9k/dDlJMjyKeTAdBgNVHQ4EFgQUP5JPmEQdtO4cllP2G6wM3tUtB2AwDAYDVR0T AQH/BAIwADAhBgNVHREEGjAYgRZwYXVsLmhvZmZtYW5AaWNhbm4ub3JnMA4GA1UdDwEB/wQEAwIF oDAdBgNVHSUEFjAUBggrBgEFBQcDAgYIKwYBBQUHAwQwQwYDVR0gBDwwOjA4BgpghkgBhv1sBAEC MCowKAYIKwYBBQUHAgEWHGh0dHBzOi8vd3d3LmRpZ2ljZXJ0LmNvbS9DUFMwgYgGA1UdHwSBgDB+ MD2gO6A5hjdodHRwOi8vY3JsMy5kaWdpY2VydC5jb20vRGlnaUNlcnRTSEEyQXNzdXJlZElEQ0Et ZzIuY3JsMD2gO6A5hjdodHRwOi8vY3JsNC5kaWdpY2VydC5jb20vRGlnaUNlcnRTSEEyQXNzdXJl ZElEQ0EtZzIuY3JsMHkGCCsGAQUFBwEBBG0wazAkBggrBgEFBQcwAYYYaHR0cDovL29jc3AuZGln aWNlcnQuY29tMEMGCCsGAQUFBzAChjdodHRwOi8vY2FjZXJ0cy5kaWdpY2VydC5jb20vRGlnaUNl cnRTSEEyQXNzdXJlZElEQ0EuY3J0MA0GCSqGSIb3DQEBCwUAA4IBAQADu8aIhNUm8QiAU3dRWzMP ifK3ySzx38iTlSPWM+4Pz41fiUGkM4i99iQKfwphKvH6wxCumhLZ6ds4zB6R5/e05uXaFUrZD62/ UaSw+r21D3wBvU52/Ugz1phpTVqVHn8QSFzS6qzVSXPZZRzzH9qd/f8ilsfIQ904IuIv2aJvgYMz zP2aq8AT4y2KypGzb7CUzML/rew0qkDop18E0owsefKoIAoXuW4ZanrXbI+YaiHrdsEuulElCisj 9+y/lITakrdd/ndb8Qt/qzFYyxeb2ISAx6gA60N4keu/6L6+WV3AcckrrOVch1WuPFGSXKAhJeaW x0ez+wOnUwSplM5cMIIGTjCCBTagAwIBAgIQBK55YGZmkBq5xX+mbFvczTANBgkqhkiG9w0BAQsF ADBlMQswCQYDVQQGEwJVUzEVMBMGA1UEChMMRGlnaUNlcnQgSW5jMRkwFwYDVQQLExB3d3cuZGln aWNlcnQuY29tMSQwIgYDVQQDExtEaWdpQ2VydCBBc3N1cmVkIElEIFJvb3QgQ0EwHhcNMTMxMTA1 MTIwMDAwWhcNMjgxMTA1MTIwMDAwWjBlMQswCQYDVQQGEwJVUzEVMBMGA1UEChMMRGlnaUNlcnQg SW5jMRkwFwYDVQQLExB3d3cuZGlnaWNlcnQuY29tMSQwIgYDVQQDExtEaWdpQ2VydCBTSEEyIEFz c3VyZWQgSUQgQ0EwggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQDc+BEjP2q178AneRst BYeiEEMx3w7UFRtPd6Qizj6McPC+B47dJyq8AR22LArK3WlYH0HtagUf2mN4WR4iLCv4un7JNTtW 8R98Qn4lsCMZxkU41z1E+SB8YK4csFoYBL6PO/ep8JSapgxjSbZBF1NAMr1P5lB6UB8lRejxia/N /17/UPPwFxH/vcWJ9b1iudj7jkUEhW2ZzcVITf0mqwI2Reo2119q4hqCQQrc6dn1kReOxiGtODwT 5h5/ZpzVTdlG2vbPUqd9OyTDtMFRNcab69TvfuR7A+FEvXoLN+BPy4KKDXEY5KbgiSwb87JzPMGw kp4Yfb2rfcV9CKEswp9zAgMBAAGjggL4MIIC9DASBgNVHRMBAf8ECDAGAQH/AgEAMA4GA1UdDwEB /wQEAwIBhjA0BggrBgEFBQcBAQQoMCYwJAYIKwYBBQUHMAGGGGh0dHA6Ly9vY3NwLmRpZ2ljZXJ0 LmNvbTCBgQYDVR0fBHoweDA6oDigNoY0aHR0cDovL2NybDQuZGlnaWNlcnQuY29tL0RpZ2lDZXJ0 QXNzdXJlZElEUm9vdENBLmNybDA6oDigNoY0aHR0cDovL2NybDMuZGlnaWNlcnQuY29tL0RpZ2lD ZXJ0QXNzdXJlZElEUm9vdENBLmNybDAdBgNVHSUEFjAUBggrBgEFBQcDAgYIKwYBBQUHAwQwggGz BgNVHSAEggGqMIIBpjCCAaIGCmCGSAGG/WwAAgQwggGSMCgGCCsGAQUFBwIBFhxodHRwczovL3d3 dy5kaWdpY2VydC5jb20vQ1BTMIIBZAYIKwYBBQUHAgIwggFWHoIBUgBBAG4AeQAgAHUAcwBlACAA bwBmACAAdABoAGkAcwAgAEMAZQByAHQAaQBmAGkAYwBhAHQAZQAgAGMAbwBuAHMAdABpAHQAdQB0 AGUAcwAgAGEAYwBjAGUAcAB0AGEAbgBjAGUAIABvAGYAIAB0AGgAZQAgAEQAaQBnAGkAQwBlAHIA dAAgAEMAUAAvAEMAUABTACAAYQBuAGQAIAB0AGgAZQAgAFIAZQBsAHkAaQBuAGcAIABQAGEAcgB0 AHkAIABBAGcAcgBlAGUAbQBlAG4AdAAgAHcAaABpAGMAaAAgAGwAaQBtAGkAdAAgAGwAaQBhAGIA aQBsAGkAdAB5ACAAYQBuAGQAIABhAHIAZQAgAGkAbgBjAG8AcgBwAG8AcgBhAHQAZQBkACAAaABl AHIAZQBpAG4AIABiAHkAIAByAGUAZgBlAHIAZQBuAGMAZQAuMB0GA1UdDgQWBBTnAiOAAE/Y17yU C9k/dDlJMjyKeTAfBgNVHSMEGDAWgBRF66Kv9JLLgjEtUYunpyGd823IDzANBgkqhkiG9w0BAQsF AAOCAQEATtSJJ7n9HYd3fg8oBZDxCi/JOz69k5yQxq/6kVGHMlRr6MrBcVFcmY61+uBiGZmmB5p8 Eyfb5QKihBLZFfYKRFfENI9tcx861qABPd7jguRFa7LrJf2AXh05kL5bQvbOkWDj+aBWDEgQzjNo e82Tq/Bqy09YD7l7XRsEgZ6nIuJXSSfukpMIvmkIUwI6Ll3IGfRQgE4C2bBdkbSTh/mWloFVQI5m 7YLYuyhf7Uxh7QZYKBlTEUS8RyApsgRs2IlUmTt122d4LB6SeMZVPVgSETJuvUMMTTTbe8ZC2+y+ q5thTAaS447fISpQVwTAYKI11SSeZjcJSc/V+GWz4OJuwjGCAxkwggMVAgEBMHkwZTELMAkGA1UE BhMCVVMxFTATBgNVBAoTDERpZ2lDZXJ0IEluYzEZMBcGA1UECxMQd3d3LmRpZ2ljZXJ0LmNvbTEk MCIGA1UEAxMbRGlnaUNlcnQgU0hBMiBBc3N1cmVkIElEIENBAhAG83jiXlqePPrfwUUEH4ZnMAkG BSsOAwIaBQCgggF1MBgGCSqGSIb3DQEJAzELBgkqhkiG9w0BBwEwHAYJKoZIhvcNAQkFMQ8XDTE4 MTAyNjIzMDAzNVowIwYJKoZIhvcNAQkEMRYEFEqBwezigbX3HX3/gWv4OZSHq5olMIGIBgkrBgEE AYI3EAQxezB5MGUxCzAJBgNVBAYTAlVTMRUwEwYDVQQKEwxEaWdpQ2VydCBJbmMxGTAXBgNVBAsT EHd3dy5kaWdpY2VydC5jb20xJDAiBgNVBAMTG0RpZ2lDZXJ0IFNIQTIgQXNzdXJlZCBJRCBDQQIQ BvN44l5anjz638FFBB+GZzCBigYLKoZIhvcNAQkQAgsxe6B5MGUxCzAJBgNVBAYTAlVTMRUwEwYD VQQKEwxEaWdpQ2VydCBJbmMxGTAXBgNVBAsTEHd3dy5kaWdpY2VydC5jb20xJDAiBgNVBAMTG0Rp Z2lDZXJ0IFNIQTIgQXNzdXJlZCBJRCBDQQIQBvN44l5anjz638FFBB+GZzANBgkqhkiG9w0BAQEF AASCAQCPJVFLrZEiyR8TtHWHaRuJX1EcFUnBsLmg72hORMDq0whNXnkRu4RFeJvKJkbcVfjyBntY kVJH6xzMv+6HKp3Eu2hubBsR1cMliaDMpCgSKBp6Yt0NrH/zqKmV/U/a0HHfiDTsnF/xyRAyTlND F68hKqwx5VQcvsSlzmjYYple2w1Pmr/S8VfrKf3EpLaWILx4MhkOpZNtKTAn0e02IJLfkz+Wz+uq C13wti/FhkKFFQ4xU+v7H9v7fsmjtrAB0sQlpWG6o4PoLOW9PzRGDmO2w6XUTATZP4B8afOWZq7z e7Kq/4wISyZT/IgyWZ8Sm8Eg/Ks4PrspRAauAiKH6i2DAAAAAAAA --Apple-Mail=_FD094C9F-79C1-42A7-86E2-FE62954B1BEB--