Skip to content

fix typo #9

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -94,7 +94,7 @@ residual = output + residual

### 5. Llama模型参数加载(20分)

请结合课上所讲的模型结构,根据代码种的定义在`src/params.rs`以及`src/model.rs`中补全大模型参数加载代码。项目已经为你做好了safetensors以及json文件的读取功能,你需要将参数原始数据以代码中的形式存于正确的位置,并赋予模型对象正确的config属性。safetensors里带有各张量的名称,应该足够你判断出张量代表的是哪个参数。
请结合课上所讲的模型结构,根据代码中的定义在`src/params.rs`以及`src/model.rs`中补全大模型参数加载代码。项目已经为你做好了safetensors以及json文件的读取功能,你需要将参数原始数据以代码中的形式存于正确的位置,并赋予模型对象正确的config属性。safetensors里带有各张量的名称,应该足够你判断出张量代表的是哪个参数。

以下是大模型config中一些比较重要的属性的含义:

Expand Down