Re: [UA-EAI] [Ext] EAI tests and testing
Hi, I’ve looked at this, and while the code’s correct and its utility is more than zero, I don’t think it covers a noticeable part of the questions in the self-certification. Arnt From: "Mark Svancarek (CELA)" <marksv@microsoft.com> Date: Wednesday, 16 November 2022 at 17:58 To: Seda Akbulut via UA-EAI <ua-eai@icann.org>, Arnt Gulbrandsen <arnt.gulbrandsen@icann.org> Subject: [Ext] EAI tests and testing As discussed today, here is an EAI testing document from June 2021 and the associated tests. UASG 030A EAI Software Test Results EN - Universal Acceptance Steering Group (UASG) [uasg.tech]<https://urldefense.com/v3/__https:/uasg.tech/download/uasg-030a-eai-software...> GitHub - jrlevine/eaitesttools: Tools for testing EAI compliance of mail software [github.com]<https://urldefense.com/v3/__https:/github.com/jrlevine/eaitesttools__;!!PtGJ...> Mark Svancarek Principal Program Manager, Corporate Standards Group Privacy & Regulatory Affairs Microsoft marksv@microsoft.com<mailto:marksv@microsoft.com> www.linkedin.com/in/marksv [nam06.safelinks.protection.outlook.com]<https://urldefense.com/v3/__https:/nam06.safelinks.protection.outlook.com/?u...> T: [+1] 425-706-2773 [cid:image001.gif@01D8FB52.25803980]
Oh, well. Lots of work remaining. From: Arnt Gulbrandsen <arnt.gulbrandsen@icann.org> Sent: Friday, November 18, 2022 4:32 AM To: Mark Svancarek (CELA) <marksv@microsoft.com>; Seda Akbulut via UA-EAI <ua-eai@icann.org> Subject: [EXTERNAL] Re: [Ext] EAI tests and testing Hi, I've looked at this, and while the code's correct and its utility is more than zero, I don't think it covers a noticeable part of the questions in the self-certification. Arnt From: "Mark Svancarek (CELA)" <marksv@microsoft.com<mailto:marksv@microsoft.com>> Date: Wednesday, 16 November 2022 at 17:58 To: Seda Akbulut via UA-EAI <ua-eai@icann.org<mailto:ua-eai@icann.org>>, Arnt Gulbrandsen <arnt.gulbrandsen@icann.org<mailto:arnt.gulbrandsen@icann.org>> Subject: [Ext] EAI tests and testing As discussed today, here is an EAI testing document from June 2021 and the associated tests. UASG 030A EAI Software Test Results EN - Universal Acceptance Steering Group (UASG) [uasg.tech]<https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Furldefense...> GitHub - jrlevine/eaitesttools: Tools for testing EAI compliance of mail software [github.com]<https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Furldefense...> Mark Svancarek Principal Program Manager, Corporate Standards Group Privacy & Regulatory Affairs Microsoft marksv@microsoft.com<mailto:marksv@microsoft.com> www.linkedin.com/in/marksv [nam06.safelinks.protection.outlook.com]<https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Furldefense...> T: [+1] 425-706-2773 [cid:image001.gif@01D8FB1E.FE857760]
It appears that Arnt Gulbrandsen via UA-EAI <arnt.gulbrandsen@icann.org> said:
I’ve looked at this, and while the code’s correct and its utility is more than zero, I don’t think it covers a noticeable part of the questions in the self-certification.
The code does most of the mail tests in UASG021A other than the MUA tests which I couldn't figure out how to automate. If you want to see if that your MTA, MSA, or MDA is EAI compatible, and your server is reaasoably close to working, they should be able to do the job. A lot of packages that claimed to support EAI don't very well and particularly for IMAP servers there is considierable code to work around server bugs so it can recover from server failures and do more of the tests. R's, John
Thanks for clarifying! FWIW, in our most recent call we had already concluded that much/most of the testing would be manual, at least initially. /marksv -----Original Message----- From: UA-EAI <ua-eai-bounces@icann.org> On Behalf Of John Levine via UA-EAI Sent: Saturday, November 19, 2022 4:53 PM To: ua-eai@icann.org Subject: [EXTERNAL] Re: [UA-EAI] [Ext] EAI tests and testing It appears that Arnt Gulbrandsen via UA-EAI <arnt.gulbrandsen@icann.org> said:
I've looked at this, and while the code's correct and its utility is more than zero, I don't think it covers a noticeable part of the questions in the self-certification.
The code does most of the mail tests in UASG021A other than the MUA tests which I couldn't figure out how to automate. If you want to see if that your MTA, MSA, or MDA is EAI compatible, and your server is reaasoably close to working, they should be able to do the job. A lot of packages that claimed to support EAI don't very well and particularly for IMAP servers there is considierable code to work around server bugs so it can recover from server failures and do more of the tests. R's, John _______________________________________________ UA-EAI mailing list UA-EAI@icann.org https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmm.icann.org%2Fmailman%2Flistinfo%2Fua-eai&data=05%7C01%7Cmarksv%40microsoft.com%7Ce5b2658a8454480f7efd08daca919733%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638045023912816879%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=siSEWoFgrbdSPNvajYHQZo5ZkhQZT%2FW6su9tQVIrmYs%3D&reserved=0 _______________________________________________ By submitting your personal data, you consent to the processing of your personal data for purposes of subscribing to this mailing list accordance with the ICANN Privacy Policy (https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.icann.org%2Fprivacy%2Fpolicy&data=05%7C01%7Cmarksv%40microsoft.com%7Ce5b2658a8454480f7efd08daca919733%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638045023912816879%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=DSpV%2BP2DFVOHmh86wPIZvKETE5uT6oHBqC4f3RPBt44%3D&reserved=0) and the website Terms of Service (https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.icann.org%2Fprivacy%2Ftos&data=05%7C01%7Cmarksv%40microsoft.com%7Ce5b2658a8454480f7efd08daca919733%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638045023912816879%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=8dG99o9KGDogb4aIdVR4LNhngdSwzBfwCuYuKfmXCh0%3D&reserved=0). You can visit the Mailman link above to change your membership status or configuration, including unsubscribing, setting digest-style delivery or disabling delivery altogether (e.g., for a vacation), and so on.
FWIW, in our most recent call we had already concluded that much/most of the testing would be manual, at least initially.
For MUAs and webmail, I don't see any alternative to manual testing, since it's all about bits of the user interface which are not standardized at all. On the other hand, for tests of MTA, MSA, and MDA, those are about how well they implement the SMTP, submission, IMAP, and POP protocols. In my tests those were entirely automated except for a few cases where the system I was testing was so broken that it wasn't worth adding code to the test scripts to work around it.
/marksv
-----Original Message----- From: UA-EAI <ua-eai-bounces@icann.org> On Behalf Of John Levine via UA-EAI Sent: Saturday, November 19, 2022 4:53 PM To: ua-eai@icann.org Subject: [EXTERNAL] Re: [UA-EAI] [Ext] EAI tests and testing
It appears that Arnt Gulbrandsen via UA-EAI <arnt.gulbrandsen@icann.org> said:
I've looked at this, and while the code's correct and its utility is more than zero, I don't think it covers a noticeable part of the questions in the self-certification.
The code does most of the mail tests in UASG021A other than the MUA tests which I couldn't figure out how to automate.
If you want to see if that your MTA, MSA, or MDA is EAI compatible, and your server is reaasoably close to working, they should be able to do the job.
A lot of packages that claimed to support EAI don't very well and particularly for IMAP servers there is considierable code to work around server bugs so it can recover from server failures and do more of the tests.
R's, John _______________________________________________ UA-EAI mailing list UA-EAI@icann.org https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmm.icann.org%2Fmailman%2Flistinfo%2Fua-eai&data=05%7C01%7Cmarksv%40microsoft.com%7Ce5b2658a8454480f7efd08daca919733%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638045023912816879%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=siSEWoFgrbdSPNvajYHQZo5ZkhQZT%2FW6su9tQVIrmYs%3D&reserved=0 _______________________________________________ By submitting your personal data, you consent to the processing of your personal data for purposes of subscribing to this mailing list accordance with the ICANN Privacy Policy (https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.icann.org%2Fprivacy%2Fpolicy&data=05%7C01%7Cmarksv%40microsoft.com%7Ce5b2658a8454480f7efd08daca919733%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638045023912816879%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=DSpV%2BP2DFVOHmh86wPIZvKETE5uT6oHBqC4f3RPBt44%3D&reserved=0) and the website Terms of Service (https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.icann.org%2Fprivacy%2Ftos&data=05%7C01%7Cmarksv%40microsoft.com%7Ce5b2658a8454480f7efd08daca919733%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638045023912816879%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=8dG99o9KG
Dogb4aIdVR4LNhngdSwzBfwCuYuKfmXCh0%3D&reserved=0). You can visit the Mailman link above to change your membership status or configuration, including unsubscribing, setting digest-style delivery or disabling delivery altogether (e.g., for a vacation), and so on.
Regards, John Levine, johnl@taugh.com, Primary Perpetrator of "The Internet for Dummies", Please consider the environment before reading this e-mail. https://jl.ly
I suppose you're right. What I meant to say is that extending your code to cover the rest of the self-certification document would require very substantial effort. Very. Arnt
participants (4)
-
Arnt Gulbrandsen -
John Levine -
John R. Levine -
Mark Svancarek (CELA)