Skip to content

[Feature]: expose the tqdm progress bar to enable logging the progress #6154

Closed as not planned
@hugolytics

Description

@hugolytics

🚀 The feature, motivation and pitch

I am running vLLM on aws batch on large datasets and would like to see the progress of the jobs, this is currently not possible.
however tqdm-loggable does enable this, but then I would need to swap the tqdm driver in the llm_engine, this is however not exposed.
so my request would be either to move to tqdm-loggable since it automatically switches given a interactive vs non-interactive environment. Or expose tqdm such that the user can swap it themselves.

Alternatives

No response

Additional context

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    feature requestNew feature or requeststaleOver 90 days of inactivity

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions