Is the decode.json generated from DeepSeek V3 ? #16
Description
there are only 120 flash kernel calls, and 118 moe kernel calls, similar to the DeepSeek V2 layers. But the hidden size is 7168 which is the same as V3 model
{{ message }}
there are only 120 flash kernel calls, and 118 moe kernel calls, similar to the DeepSeek V2 layers. But the hidden size is 7168 which is the same as V3 model