Skip to content
This repository was archived by the owner on Jan 23, 2023. It is now read-only.

Test cleanup for System.Net.Security #15952

Merged
merged 3 commits into from
Feb 9, 2017
Merged

Test cleanup for System.Net.Security #15952

merged 3 commits into from
Feb 9, 2017

Conversation

ianhays
Copy link
Contributor

@ianhays ianhays commented Feb 8, 2017

Enabling and moving a bunch of disabled/outerlooped System.Net.Security tests to innerloop. I did extensive testing on Windows, RHEL, and Ubuntu machines and ensured the tests are stable (at least locally) and hit no errors. The next step is to re-enable them and watch to see if any of the failures resurface and disable them as needed.

resolves #3144 - Removed TODO because Begin/End were added back in #8358 and the issue is closed
resolves #7825 - Original issue from April 2016. Cannot repro today. Re-enabling to watch for future failures.
resolves #11170 - Can't repro failures on multiple OSs. Re-enabling to watch for future failures.
resolves #11345 - Outerloop tests are passing and stable for thousands of iterations. Tentatively moving to innerloop to watch for potential future failures.
resolves #12107 - removed TODO because issue is closed
resolves #9130 - duplicate issues failing because of an intermittent error (remote party closed transport stream) not exclusive to the test which occurs in Outerloop runs for other NetSecurity tests. Re-enabling them and leaving them in innerloop to get more data.
resolves #10909 - duplicate issues failing because of an intermittent error (remote party closed transport stream) not exclusive to the test which occurs in Outerloop runs for other NetSecurity tests. Re-enabling them and leaving them in innerloop to get more data.
resolves #11624 - duplicate issues failing because of an intermittent error (remote party closed transport stream) not exclusive to the test which occurs in Outerloop runs for other NetSecurity tests. Re-enabling them and leaving them in innerloop to get more data.
resolves #14177 - duplicate issues failing because of an intermittent error (remote party closed transport stream) not exclusive to the test which occurs in Outerloop runs for other NetSecurity tests. Re-enabling them and leaving them in innerloop to get more data.
resolves #14505 - duplicate issues failing because of an intermittent error (remote party closed transport stream) not exclusive to the test which occurs in Outerloop runs for other NetSecurity tests. Re-enabling them and leaving them in innerloop to get more data.
resolves #8744 - duplicate issues failing because of an intermittent error (credentials package not recognized) not exclusive to the test which occurs in Outerloop runs for other NetSecurity tests. Re-enabling them and leaving them in innerloop to get more data.
resolves #12683 - duplicate issues failing because of an intermittent error (credentials package not recognized) not exclusive to the test which occurs in Outerloop runs for other NetSecurity tests. Re-enabling them and leaving them in innerloop to get more data.
resolves #12706 - duplicate issues failing because of an intermittent error (credentials package not recognized) not exclusive to the test which occurs in Outerloop runs for other NetSecurity tests. Re-enabling them and leaving them in innerloop to get more data.
resolves #12728 - duplicate issues failing because of an intermittent error (credentials package not recognized) not exclusive to the test which occurs in Outerloop runs for other NetSecurity tests. Re-enabling them and leaving them in innerloop to get more data.

@steveharter @Priya91 @davidsh

#3144 - Removed TODO because Begin/End were added back in #8358 and the issue is closed
#7825 - Original issue from April 2016. Cannot repro today. Re-enabling to watch for future failures.
#11170 - Can't repro failures on multiple OSs. Re-enabling to watch for future failures.
#11345 - Outerloop tests are passing and stable for thousands of iterations. Tentatively moving to innerloop to watch for potential future failures.
#12107 - removed TODO because issue is closed
#9130, #10909, #11624, #14177, #14505 - duplicate issues failing because of an intermittent error (remote party closed transport stream) not exclusive to the test which occurs in Outerloop runs for other NetSecurity tests. Re-enabling them and leaving them in innerloop to get more data.
#8744, #12683, #12706, #12728 - duplicate issues failing because of an intermittent error (credentials package not recognized) not exclusive to the test which occurs in Outerloop runs for other NetSecurity tests. Re-enabling them and leaving them in innerloop to get more data.
@ianhays ianhays added area-System.Net.Security test bug Problem in test source code (most likely) labels Feb 8, 2017
@ianhays ianhays added this to the 2.0.0 milestone Feb 8, 2017
@ianhays ianhays self-assigned this Feb 8, 2017
@ianhays ianhays requested a review from steveharter February 8, 2017 18:34
@@ -6,8 +6,6 @@
/// Task APM helper based on http://blogs.msdn.com/b/pfxteam/archive/2011/06/27/10179452.aspx
/// </summary>

// TODO: #3144 - Remove this class and rewrite tests to work directly with TPL.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should still be able to delete this helper, as we have a production version the tests can also use:
https://github.com/dotnet/corefx/blob/master/src/Common/src/System/Threading/Tasks/TaskToApm.cs

Copy link
Member

@stephentoub stephentoub left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks, @ianhays.

Copy link
Contributor

@steveharter steveharter left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pending other feedback LGTM. Thanks

ianhays pushed a commit that referenced this pull request Feb 9, 2017
* Test cleanup for System.Net.Security

#3144 - Removed TODO because Begin/End were added back in #8358 and the issue is closed
#7825 - Original issue from April 2016. Cannot repro today. Re-enabling to watch for future failures.
#11170 - Can't repro failures on multiple OSs. Re-enabling to watch for future failures.
#11345 - Outerloop tests are passing and stable for thousands of iterations. Tentatively moving to innerloop to watch for potential future failures.
#12107 - removed TODO because issue is closed
#9130, #10909, #11624, #14177, #14505 - duplicate issues failing because of an intermittent error (remote party closed transport stream) not exclusive to the test which occurs in Outerloop runs for other NetSecurity tests. Re-enabling them and leaving them in innerloop to get more data.
#8744, #12683, #12706, #12728 - duplicate issues failing because of an intermittent error (credentials package not recognized) not exclusive to the test which occurs in Outerloop runs for other NetSecurity tests. Re-enabling them and leaving them in innerloop to get more data.

* Remove unused netsecurity tests helper

* Remove unused test helper
@ianhays ianhays merged commit 02b0fdb into dotnet:master Feb 9, 2017
@ianhays ianhays deleted the nettests branch April 25, 2017 18:06
picenka21 pushed a commit to picenka21/runtime that referenced this pull request Feb 18, 2022
* Test cleanup for System.Net.Security

dotnet/corefx#3144 - Removed TODO because Begin/End were added back in dotnet/corefx#8358 and the issue is closed
dotnet/corefx#7825 - Original issue from April 2016. Cannot repro today. Re-enabling to watch for future failures.
dotnet/corefx#11170 - Can't repro failures on multiple OSs. Re-enabling to watch for future failures.
dotnet/corefx#11345 - Outerloop tests are passing and stable for thousands of iterations. Tentatively moving to innerloop to watch for potential future failures.
dotnet/corefx#12107 - removed TODO because issue is closed
dotnet/corefx#9130, dotnet/corefx#10909, dotnet/corefx#11624, dotnet/corefx#14177, dotnet/corefx#14505 - duplicate issues failing because of an intermittent error (remote party closed transport stream) not exclusive to the test which occurs in Outerloop runs for other NetSecurity tests. Re-enabling them and leaving them in innerloop to get more data.
dotnet/corefx#8744, dotnet/corefx#12683, dotnet/corefx#12706, dotnet/corefx#12728 - duplicate issues failing because of an intermittent error (credentials package not recognized) not exclusive to the test which occurs in Outerloop runs for other NetSecurity tests. Re-enabling them and leaving them in innerloop to get more data.

* Remove unused netsecurity tests helper

* Remove unused test helper


Commit migrated from dotnet/corefx@02b0fdb
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.