Skip to content

Commit

Permalink
[Fix] Fissertion on YaRN model len (vllm-project#2984)
Browse files Browse the repository at this point in the history
  • Loading branch information
WoosukKwon authored and jimpang committed Mar 4, 2024
1 parent fe2b6f3 commit dbcc122
Showing 1 changed file with 0 additions and 1 deletion.
1 change: 0 additions & 1 deletion vllm/model_executor/layers/rotary_embedding.py
Original file line number Diff line number Diff line change
Expand Up @@ -354,7 +354,6 @@ def get_rope(
elif scaling_type == "yarn":
original_max_position = rope_scaling[
"original_max_position_embeddings"]
assert max_position == original_max_position * scaling_factor
extra_kwargs = {
k: v
for k, v in rope_scaling.items()
Expand Down

0 comments on commit dbcc122

Please sign in to comment.