Skip to content

Commit

Permalink
Revert "[Bugfix] Fix block size validation (vllm-project#10938)"
Browse files Browse the repository at this point in the history
This reverts commit 69ba344.

Signed-off-by: Konrad Zawora <kzawora@habana.ai>
  • Loading branch information
kzawora-intel committed Dec 17, 2024
1 parent f9ecbb1 commit 17aeab2
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion vllm/engine/arg_utils.py
Original file line number Diff line number Diff line change
Expand Up @@ -423,7 +423,7 @@ def add_cli_args(parser: FlexibleArgumentParser) -> FlexibleArgumentParser:
parser.add_argument('--block-size',
type=int,
default=EngineArgs.block_size,
choices=[8, 16, 32],
choices=[8, 16, 32, 64, 128],
help='Token block size for contiguous chunks of '
'tokens. This is ignored on neuron devices and '
'set to max-model-len')
Expand Down

0 comments on commit 17aeab2

Please sign in to comment.