Skip to content

Commit 6881107

Browse files
huangyuxiang03huangyuxiang03
and
huangyuxiang03
authored
[BUG FIX] minicpm (#18739)
Signed-off-by: huangyuxiang03 <huangyx0321@gmail.com> Co-authored-by: huangyuxiang03 <huangyx0321@gmail.com>
1 parent e0f0ff8 commit 6881107

File tree

1 file changed

+0
-3
lines changed

1 file changed

+0
-3
lines changed

vllm/model_executor/models/minicpm.py

Lines changed: 0 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -242,9 +242,6 @@ def __init__(
242242
base=rope_theta,
243243
rope_scaling=rope_scaling,
244244
)
245-
# set rope as fp32 instead of bf16
246-
self.rotary_emb.cos_sin_cache = self.rotary_emb._compute_cos_sin_cache(
247-
)
248245
self.attn = Attention(self.num_heads,
249246
self.head_dim,
250247
self.scaling,

0 commit comments

Comments
 (0)