Skip to content

Conversation

@czgdp1807
Copy link
Contributor

Why are these changes needed?

This set of tests passes without issues on Windows for me, so unskipping them here.

Related issue number

Checks

  • I've run scripts/format.sh to lint the changes in this PR.
  • I've included any doc changes needed for https://docs.ray.io/en/master/.
  • I've made sure the tests are passing. Note that there might be a few flaky tests, see the recent failures at https://flakey-tests.ray.io/
  • Testing Strategy
    • Unit tests
    • Release tests
    • This PR is not tested :(

@czgdp1807 czgdp1807 added flaky-test testing topics about testing windows labels Jan 19, 2022
@pcmoritz
Copy link
Contributor

@czgdp1807 It looks like //python/ray/tests:test_list_actors is consistently timing out on the CI :)

@czgdp1807
Copy link
Contributor Author

It looks like //python/ray/tests:test_list_actors is consistently timing out on the CI :)

I see. The unskipped tests individually pass but together with other tests in that file take more than the allowed time limit.

@czgdp1807
Copy link
Contributor Author

The unskipped tests consume 40 - 50% of the total time of the test file. May be we should simply split test_list_actors.py?

@pcmoritz
Copy link
Contributor

That sounds good, but before you do that, can you compare the timing with linux? Maybe there is something very slow here on Windows that we should optimize :)

@czgdp1807
Copy link
Contributor Author

I can look into this, no worries.

@czgdp1807
Copy link
Contributor Author

@mattip shared some data from Linux.

The two tests above take 17.1s and the whole file takes 43.04s. So, these tests consume 40% on Linux as well.

Data

"1 passed in 6.65s" and "1 passed in 10.45s" respectively. /proc/cpuinfo says "AMD Ryzen 9 3900X 12-Core Processor"

4.00s call     ray/tests/test_list_actors.py::test_list_named_actors_namespace
3.85s teardown ray/tests/test_list_actors.py::test_list_named_actors_basic
3.75s teardown ray/tests/test_list_actors.py::test_list_named_actors_basic_local_mode[ray_start_regular0]
3.50s teardown ray/tests/test_list_actors.py::test_list_named_actors_namespace
3.26s teardown ray/tests/test_list_actors.py::test_list_named_actors_detached
3.22s teardown ray/tests/test_list_actors.py::test_list_named_actors_ray_kill
2.85s teardown ray/tests/test_list_actors.py::test_list_named_actors_restarting_actor
2.67s setup    ray/tests/test_list_actors.py::test_list_named_actors_restarting_actor
2.66s setup    ray/tests/test_list_actors.py::test_list_named_actors_ray_kill
2.64s setup    ray/tests/test_list_actors.py::test_list_named_actors_basic
2.63s setup    ray/tests/test_list_actors.py::test_list_named_actors_detached
2.60s setup    ray/tests/test_list_actors.py::test_list_named_actors_namespace
2.59s setup    ray/tests/test_list_actors.py::test_list_named_actors_basic_local_mode[ray_start_regular0]
1.91s call     ray/tests/test_list_actors.py::test_list_named_actors_detached
0.87s call     ray/tests/test_list_actors.py::test_list_named_actors_restarting_actor
0.01s call     ray/tests/test_list_actors.py::test_list_named_actors_basic
0.01s call     ray/tests/test_list_actors.py::test_list_named_actors_ray_kill
0.01s call     ray/tests/test_list_actors.py::test_list_named_actors_basic_local_mode[ray_start_regular0]
============================================== 6 passed in 43.04s ==
:100:
1

@bveeramani
Copy link
Member

‼️ ACTION REQUIRED ‼️

We've switched our code formatter from YAPF to Black (see #21311).

To prevent issues with merging your code, here's what you'll need to do:

  1. Install Black
pip install -I black==21.12b0
  1. Format changed files with Black
curl -o format-changed.sh https://gist.githubusercontent.com/bveeramani/42ef0e9e387b755a8a735b084af976f2/raw/7631276790765d555c423b8db2b679fd957b984a/format-changed.sh
chmod +x ./format-changed.sh
./format-changed.sh
rm format-changed.sh
  1. Commit your changes.
git add --all
git commit -m "Format Python code with Black"
  1. Merge master into your branch.
git pull upstream master
  1. Resolve merge conflicts (if necessary).

After running these steps, you'll have the updated format.sh.

@pcmoritz
Copy link
Contributor

pcmoritz commented Feb 8, 2022

Can you update this PR to incorporate the latest linting changes?

@czgdp1807
Copy link
Contributor Author

Please let me know if splitting test_list_actors.py is a go ahead. Note the comments - #21702 (comment) and #21702 (comment) of this PR.

@pcmoritz
Copy link
Contributor

Yes, splitting sounds good to me!

Copy link
Contributor

@pcmoritz pcmoritz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Let's wait for CI, one of the tests timed out so I took it out again.

@pcmoritz pcmoritz merged commit 3cb8585 into ray-project:master Feb 20, 2022
simonsays1980 pushed a commit to simonsays1980/ray that referenced this pull request Feb 27, 2022
This set of tests passes without issues on Windows for me, so unskipping them here.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

testing topics about testing windows

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants