Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Timeouts during 'Lin.Internal CList int64 test with Thread' under Cygwin #397

Open
jmid opened this issue Sep 20, 2023 · 3 comments
Open

Timeouts during 'Lin.Internal CList int64 test with Thread' under Cygwin #397

jmid opened this issue Sep 20, 2023 · 3 comments
Labels
ocaml5-issue A potential issue in the OCaml5 compiler/runtime test suite reliability Issue concerns tests that should behave more predictably

Comments

@jmid
Copy link
Collaborator

jmid commented Sep 20, 2023

This is an existing issue which we have been observing and battling repeatedly.
I now saw it again and decided to track it separately from the general #338 and #384.
Overall this is in the gray zone between 'test suite reliability' and an 'ocaml5 issue' .

Whereas #389 took care of disabling shrinking to prevent long shrink runs, we are now just left with ... long runs 😬
The latest occurrence happened Cygwin trunk/5.2 part 1, which was cancelled during a 7712.9s run:
https://github.com/ocaml-multicore/multicoretests/actions/runs/6169402841/job/16752622025

random seed: 489742295
generated error fail pass / total     time test name

[ ]    0    0    0    0 / 1000     0.0s Lin CList int test with Thread
[ ]    0    0    0    0 / 1000     0.0s Lin CList int test with Thread (generating)
[ ]  162    0    0  162 / 1000    70.8s Lin CList int test with Thread
[...]
[ ]  894    0    0  894 / 1000  1094.1s Lin CList int test with Thread
[ ]  989    0    0  989 / 1000  1155.8s Lin CList int test with Thread
[✓] 1000    0    0 1000 / 1000  1157.1s Lin CList int test with Thread

[ ]    0    0    0    0 / 1000     0.0s Lin CList int64 test with Thread
[ ]   11    0    0   11 / 1000   149.3s Lin CList int64 test with Thread
[ ]   15    0    0   15 / 1000   290.7s Lin CList int64 test with Thread
[ ]   18    0    0   18 / 1000   381.1s Lin CList int64 test with Thread
[...]
[ ]  883    0    0  883 / 1000  6348.6s Lin CList int64 test with Thread
[ ]  886    0    0  886 / 1000  6552.9s Lin CList int64 test with Thread
[ ]  888    0    0  888 / 1000  6713.8s Lin CList int64 test with Thread
[ ]  891    0    0  891 / 1000  6812.7s Lin CList int64 test with Thread
[ ]  894    0    0  894 / 1000  7628.3s Lin CList int64 test with Thread
[ ]  896    0    0  896 / 1000  7712.9s Lin CList int64 test with Thread
Error: The operation was canceled.

A previous recent occurrence was in #387.
@jmid jmid added ocaml5-issue A potential issue in the OCaml5 compiler/runtime test suite reliability Issue concerns tests that should behave more predictably labels Sep 20, 2023
@jmid jmid mentioned this issue Sep 21, 2023
Merged
@jmid
Copy link
Collaborator Author

jmid commented Oct 12, 2023

This timed out again on the 0.3 release branch under Cygwin trunk / part2
https://github.com/ocaml-multicore/multicoretests/actions/runs/6481561492/job/17612305533

random seed: 117786625
generated error fail pass / total     time test name

[ ]    0    0    0    0 / 1000     0.0s Lin.Internal CList int test with Thread
[ ]    0    0    0    0 / 1000     0.0s Lin.Internal CList int test with Thread (generating)
[ ]  183    0    0  183 / 1000    60.0s Lin.Internal CList int test with Thread
[ ]  268    0    0  268 / 1000   126.9s Lin.Internal CList int test with Thread
[...]
[ ]  931    0    0  931 / 1000   994.8s Lin.Internal CList int test with Thread (collecting)
[ ]  942    0    0  942 / 1000  1071.8s Lin.Internal CList int test with Thread
[ ]  960    0    0  960 / 1000  1140.9s Lin.Internal CList int test with Thread
[✓] 1000    0    0 1000 / 1000  1146.0s Lin.Internal CList int test with Thread

[ ]    0    0    0    0 / 1000     0.0s Lin.Internal CList int64 test with Thread
[ ]   84    0    0   84 / 1000    65.5s Lin.Internal CList int64 test with Thread
[ ]   99    0    0   99 / 1000   161.8s Lin.Internal CList int64 test with Thread
[ ]  212    0    0  212 / 1000   233.7s Lin.Internal CList int64 test with Thread
[...]
[ ]  812    0    0  812 / 1000  3608.7s Lin.Internal CList int64 test with Thread
[ ]  815    0    0  815 / 1000  3676.4s Lin.Internal CList int64 test with Thread
[ ]  816    0    0  816 / 1000  4053.7s Lin.Internal CList int64 test with Thread
[ ]  820    0    0  820 / 1000  4119.1s Lin.Internal CList int64 test with Thread
[ ]  825    0    0  825 / 1000  4232.8s Lin.Internal CList int64 test with Thread
Error: The operation was canceled.

@jmid
Copy link
Collaborator Author

jmid commented Oct 12, 2023

This also timed out on the 0.3 merge to main under Cygwin 5.1 / part2
https://github.com/ocaml-multicore/multicoretests/actions/runs/6483174720/job/17612768749

random seed: 25553377
generated error fail pass / total     time test name

[ ]    0    0    0    0 / 1000     0.0s Lin.Internal CList int test with Thread
[ ]    0    0    0    0 / 1000     0.0s Lin.Internal CList int test with Thread (generating)
[ ]  172    0    0  172 / 1000    60.1s Lin.Internal CList int test with Thread
[ ]  263    0    0  263 / 1000   121.2s Lin.Internal CList int test with Thread
[ ]  344    0    0  344 / 1000   199.0s Lin.Internal CList int test with Thread
[...]
[ ]  971    0    0  971 / 1000  1659.0s Lin.Internal CList int test with Thread
[ ]  983    0    0  983 / 1000  1734.1s Lin.Internal CList int test with Thread
[ ]  986    0    0  986 / 1000  1837.4s Lin.Internal CList int test with Thread
[ ]  993    0    0  993 / 1000  1899.1s Lin.Internal CList int test with Thread
[✓] 1000    0    0 1000 / 1000  1934.4s Lin.Internal CList int test with Thread

[ ]    0    0    0    0 / 1000     0.0s Lin.Internal CList int64 test with Thread
[ ]   67    0    0   67 / 1000    24.9s Lin.Internal CList int64 test with Thread
[ ]  105    0    0  105 / 1000   173.2s Lin.Internal CList int64 test with Thread
[ ]  110    0    0  110 / 1000   276.8s Lin.Internal CList int64 test with Thread
[ ]  114    0    0  114 / 1000   422.2s Lin.Internal CList int64 test with Thread
[...]
[ ]  769    0    0  769 / 1000  6122.7s Lin.Internal CList int64 test with Thread
[ ]  777    0    0  777 / 1000  6223.8s Lin.Internal CList int64 test with Thread
[ ]  783    0    0  783 / 1000  6335.4s Lin.Internal CList int64 test with Thread
[ ]  788    0    0  788 / 1000  6419.0s Lin.Internal CList int64 test with Thread
[ ]  792    0    0  792 / 1000  6525.9s Lin.Internal CList int64 test with Thread
Error: The operation was canceled.

@jmid jmid mentioned this issue Nov 9, 2023
Merged
@jmid jmid changed the title Timeouts during 'Lin CList int64 test with Thread' under Cygwin Timeouts during 'Lin.Internal CList int64 test with Thread' under Cygwin Nov 14, 2023
@jmid
Copy link
Collaborator Author

jmid commented Nov 14, 2023

I updated the title to reflect the #396 and #408 renaming

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
ocaml5-issue A potential issue in the OCaml5 compiler/runtime test suite reliability Issue concerns tests that should behave more predictably
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@jmid