Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[core][cgraph] Collapse other params into max_inflight_executions and adjust execution_index counting #49565

Merged
merged 16 commits into from
Jan 13, 2025
Merged
Prev Previous commit
Next Next commit
Merge branch 'master' into dag-max-buffered-queue
Signed-off-by: dayshah <dhyey2019@gmail.com>
  • Loading branch information
dayshah committed Jan 12, 2025
commit 023495ae239d1a310aaa729ba8875598dc718fdd
10 changes: 9 additions & 1 deletion python/ray/dag/compiled_dag_node.py
Original file line number Diff line number Diff line change
Expand Up @@ -2051,7 +2051,15 @@ def _execute_until(

# Fetch results from each output channel up to execution_index and cache
# them separately to enable individual retrieval
result = self._dag_output_fetcher.read(timeout)
try:
result = self._dag_output_fetcher.read(timeout)
except RayChannelTimeoutError as e:
raise RayChannelTimeoutError(
"If the execution is expected to take a long time, increase "
f"RAY_CGRAPH_get_timeout which is currently {timeout} seconds. "
"Otherwise, this may indicate that the execution is hanging."
) from e

self._max_finished_execution_index += 1
self._cache_execution_results(
self._max_finished_execution_index,
Expand Down
Loading
You are viewing a condensed version of this merge commit. You can view the full changes here.