You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I am running vLLM on aws batch on large datasets and would like to see the progress of the jobs, this is currently not possible.
however tqdm-loggable does enable this, but then I would need to swap the tqdm driver in the llm_engine, this is however not exposed.
so my request would be either to move to tqdm-loggable since it automatically switches given a interactive vs non-interactive environment. Or expose tqdm such that the user can swap it themselves.
Alternatives
No response
Additional context
No response
The text was updated successfully, but these errors were encountered:
This issue has been automatically marked as stale because it has not had any activity within 90 days. It will be automatically closed if no further activity occurs within 30 days. Leave a comment if you feel this issue should remain open. Thank you!
🚀 The feature, motivation and pitch
I am running vLLM on aws batch on large datasets and would like to see the progress of the jobs, this is currently not possible.
however tqdm-loggable does enable this, but then I would need to swap the tqdm driver in the llm_engine, this is however not exposed.
so my request would be either to move to tqdm-loggable since it automatically switches given a interactive vs non-interactive environment. Or expose tqdm such that the user can swap it themselves.
Alternatives
No response
Additional context
No response
The text was updated successfully, but these errors were encountered: