Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BugFix] Ensure worker model loop is always stopped at the right time #5987

Merged
merged 2 commits into from
Jul 1, 2024
Merged

[BugFix] Ensure worker model loop is always stopped at the right time #5987

merged 2 commits into from
Jul 1, 2024

Commits on Jun 29, 2024

  1. [BugFix] Ensure worker model loop is always stopped at the right time 

    The model loop in the worker processes is meant to stop when there are no more sequences to process but the condition being checked for this wasn't sufficient, meaning that the workers can incorrectly remain in an indefinite broadcast loop.
    @njhill
    njhill committed Jun 29, 2024
    Configuration menu
    Copy the full SHA
    5c80f79 View commit details
    Browse the repository at this point in the history

Commits on Jul 1, 2024

  1. Revert AsyncLLMEngine change

    @njhill
    njhill committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    87c5226 View commit details
    Browse the repository at this point in the history