Skip to content

Conversation

@bveeramani
Copy link
Member

@bveeramani bveeramani commented Oct 7, 2025

Why are these changes needed?

The image_embedding_from_jsonl_fixed_size_chaos release test runs a large image embedding workload with a preemption every minute. Since this test features long-running tasks and frequent preemptions, it's expected to time out (it's not a regression). So, this PR changes the frequency to manual.

Related issue number

Checks

  • I've signed off every commit(by using the -s flag, i.e., git commit -s) in this PR.
  • I've run pre-commit jobs to lint the changes in this PR. (pre-commit setup)
  • I've included any doc changes needed for https://docs.ray.io/en/master/.
    • I've added any new APIs to the API Reference. For example, if I added a
      method in Tune, I've added it in doc/source/tune/api/ under the
      corresponding .rst file.
  • I've made sure the tests are passing. Note that there might be a few flaky tests, see the recent failures at https://flakey-tests.ray.io/
  • Testing Strategy
    • Unit tests
    • Release tests
    • This PR is not tested :(

Signed-off-by: Balaji Veeramani <bveeramani@berkeley.edu>
Copy link
Contributor

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request aims to change the execution frequency of the image_embedding_from_jsonl_fixed_size_chaos test to manual because it consistently times out. The approach of parameterizing the frequency and setting it per test case in the matrix is correct. However, the implementation has a small issue that will cause test parsing to fail. I've left a comment with details on how to fix it. Once that's addressed, this change should work as intended.

Signed-off-by: Balaji Veeramani <bveeramani@berkeley.edu>
@aslonnie aslonnie added the go add ONLY when ready to merge, run all tests label Oct 7, 2025
@aslonnie aslonnie merged commit ffcefe4 into master Oct 7, 2025
4 of 6 checks passed
@aslonnie aslonnie deleted the mark-manual branch October 7, 2025 20:05
aslonnie added a commit that referenced this pull request Oct 8, 2025
… frequency

cherypick #57273

Signed-off-by: Lonnie Liu <lonnie@anyscale.com>
aslonnie added a commit that referenced this pull request Oct 8, 2025
cherypick #57273

The `image_embedding_from_jsonl_fixed_size_chaos` release test runs a
large image embedding workload with a preemption every minute. Since
this test features long-running tasks and frequent preemptions, it's
expected to time out (it's not a regression). So, this PR changes the
frequency to manual.

Signed-off-by: Lonnie Liu <lonnie@anyscale.com>
liulehui pushed a commit to liulehui/ray that referenced this pull request Oct 9, 2025
…al frequency (ray-project#57273)

The `image_embedding_from_jsonl_fixed_size_chaos` release test runs a
large image embedding workload with a preemption every minute. Since
this test features long-running tasks and frequent preemptions, it's
expected to time out (it's not a regression). So, this PR changes the
frequency to manual.

---------

Signed-off-by: Balaji Veeramani <bveeramani@berkeley.edu>
joshkodi pushed a commit to joshkodi/ray that referenced this pull request Oct 13, 2025
…al frequency (ray-project#57273)

The `image_embedding_from_jsonl_fixed_size_chaos` release test runs a
large image embedding workload with a preemption every minute. Since
this test features long-running tasks and frequent preemptions, it's
expected to time out (it's not a regression). So, this PR changes the
frequency to manual.

---------

Signed-off-by: Balaji Veeramani <bveeramani@berkeley.edu>
Signed-off-by: Josh Kodi <joshkodi@gmail.com>
justinyeh1995 pushed a commit to justinyeh1995/ray that referenced this pull request Oct 20, 2025
…al frequency (ray-project#57273)

The `image_embedding_from_jsonl_fixed_size_chaos` release test runs a
large image embedding workload with a preemption every minute. Since
this test features long-running tasks and frequent preemptions, it's
expected to time out (it's not a regression). So, this PR changes the
frequency to manual.

---------

Signed-off-by: Balaji Veeramani <bveeramani@berkeley.edu>
xinyuangui2 pushed a commit to xinyuangui2/ray that referenced this pull request Oct 22, 2025
…al frequency (ray-project#57273)

The `image_embedding_from_jsonl_fixed_size_chaos` release test runs a
large image embedding workload with a preemption every minute. Since
this test features long-running tasks and frequent preemptions, it's
expected to time out (it's not a regression). So, this PR changes the
frequency to manual.

---------

Signed-off-by: Balaji Veeramani <bveeramani@berkeley.edu>
Signed-off-by: xgui <xgui@anyscale.com>
landscapepainter pushed a commit to landscapepainter/ray that referenced this pull request Nov 17, 2025
…al frequency (ray-project#57273)

The `image_embedding_from_jsonl_fixed_size_chaos` release test runs a
large image embedding workload with a preemption every minute. Since
this test features long-running tasks and frequent preemptions, it's
expected to time out (it's not a regression). So, this PR changes the
frequency to manual.

---------

Signed-off-by: Balaji Veeramani <bveeramani@berkeley.edu>
Aydin-ab pushed a commit to Aydin-ab/ray-aydin that referenced this pull request Nov 19, 2025
…al frequency (ray-project#57273)

The `image_embedding_from_jsonl_fixed_size_chaos` release test runs a
large image embedding workload with a preemption every minute. Since
this test features long-running tasks and frequent preemptions, it's
expected to time out (it's not a regression). So, this PR changes the
frequency to manual.

---------

Signed-off-by: Balaji Veeramani <bveeramani@berkeley.edu>
Signed-off-by: Aydin Abiar <aydin@anyscale.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

go add ONLY when ready to merge, run all tests

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants