Skip to content

Comments

[bugfix] fix incorrect num_tokens_to_get/put#4

Merged
peaceforeverCN merged 1 commit intotaco-project:devfrom
zhuofan1123:zfl/dev
Sep 8, 2025
Merged

[bugfix] fix incorrect num_tokens_to_get/put#4
peaceforeverCN merged 1 commit intotaco-project:devfrom
zhuofan1123:zfl/dev

Conversation

@zhuofan1123
Copy link
Collaborator

No description provided.

Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR fixes a bug in the calculation of num_tokens_to_get and num_tokens_to_put in the VLLM v1 adapter. The fix ensures proper block size alignment by adding 1 to the token count before applying the ceiling division operation.

  • Corrects block size calculation logic in _get_match method
  • Corrects block size calculation logic in _put_match method

Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.

@peaceforeverCN peaceforeverCN merged commit 8194c8c into taco-project:dev Sep 8, 2025
1 of 2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants