Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

OKTA-279039: Fix flaky GroupsIT groupUserOperationsTest test #386

Conversation

arvindkrishnakumar-okta
Copy link
Contributor

@arvindkrishnakumar-okta arvindkrishnakumar-okta commented May 29, 2020

Issue

OKTA-279039

Will apply this to master branch as well.

@arvindkrishnakumar-okta arvindkrishnakumar-okta changed the title Fix flaky GroupsIT#groupUserOperationsTest test OKTA-279039: Fix flaky GroupsIT groupUserOperationsTest test May 29, 2020
@codecov-commenter
Copy link

codecov-commenter commented May 29, 2020

Codecov Report

Merging #386 into dev_openapi_v2.0.0_major_rel will not change coverage.
The diff coverage is n/a.

Impacted file tree graph

@@                       Coverage Diff                       @@
##             dev_openapi_v2.0.0_major_rel     #386   +/-   ##
===============================================================
  Coverage                           71.05%   71.05%           
  Complexity                           1129     1129           
===============================================================
  Files                                 120      120           
  Lines                                3624     3624           
  Branches                              566      566           
===============================================================
  Hits                                 2575     2575           
  Misses                                862      862           
  Partials                              187      187           

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 9e627a9...6bd0a62. Read the comment docs.

@@ -153,10 +153,11 @@ class GroupsIT implements CrudTestSupport {

// 2. Add user to the group and validate user present in group
user.addToGroup(group.getId())
assertUserInGroup(user, group)
// try upto 5 times with a delay of 2000ms after each failed attempt
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ran Travis build couple of times and verified it works.

Copy link
Contributor

@ivanezeigbo-okta ivanezeigbo-okta May 30, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@arvindkrishnakumar-okta That's great. I'm running some loops to try local runs. How many times did you happen to run it on Travis?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approx 5 - 7 times and tests passed everytime.

Copy link
Contributor

@ivanezeigbo-okta ivanezeigbo-okta left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This fixed the flaky issue with groupUserOperationsTest.

@ivanezeigbo-okta ivanezeigbo-okta merged commit dae26a8 into dev_openapi_v2.0.0_major_rel May 31, 2020
@ivanezeigbo-okta ivanezeigbo-okta deleted the fix_flaky_groupsIT_groupUserOperationsTest branch May 31, 2020 12:30
@ivanezeigbo-okta ivanezeigbo-okta restored the fix_flaky_groupsIT_groupUserOperationsTest branch May 31, 2020 13:03
@arvindkrishnakumar-okta arvindkrishnakumar-okta deleted the fix_flaky_groupsIT_groupUserOperationsTest branch May 31, 2020 17:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants