Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[SLM] Add support for InternLM architecture #1835

Merged
merged 18 commits into from
Feb 28, 2024
Merged

[SLM] Add support for InternLM architecture #1835

Changes from 1 commit
Commits
Show all changes
18 commits
Select commit Hold shift + click to select a range
f0d0b91
Create __init__.py
tlopex Feb 25, 2024
6f9789d
Add files via upload
tlopex Feb 25, 2024
cf34a91
Update model.py
tlopex Feb 25, 2024
14064c7
Update model_preset.py
tlopex Feb 25, 2024
6fe59fa
Update conv_templates.cc
tlopex Feb 25, 2024
a799c25
Update internlm_loader.py
tlopex Feb 25, 2024
60adb91
Update internlm_quantization.py
tlopex Feb 25, 2024
a05e9af
fix name of notes
tlopex Feb 25, 2024
0396db5
Update model.py
tlopex Feb 26, 2024
cead9a6
Migration
tlopex Feb 27, 2024
963eb59
fix pylint issue
tlopex Feb 27, 2024
83a41b9
fix pylint issue
tlopex Feb 27, 2024
eda32be
fix pylint error
tlopex Feb 27, 2024
142c11a
Update internlm_loader.py
tlopex Feb 27, 2024
1741a79
Update __init__.py
tlopex Feb 27, 2024
4999d71
Update __init__.py
tlopex Feb 27, 2024
c6f8a60
Delete python/mlc_chat/model/internlm/__init__.py
tlopex Feb 27, 2024
ff5e5dc
Add files via upload
tlopex Feb 27, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
fix pylint issue
  • Loading branch information
@tlopex
tlopex authored Feb 27, 2024
commit 83a41b9000a282a0f92a3d174f9b9cd76344c329
6 changes: 3 additions & 3 deletions python/mlc_chat/model/model_preset.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -447,12 +447,12 @@
"use_cache": True,
"vocab_size": 125696,
},
"internlm": {
"internlm": {
"architectures": ["InternLMForCausalLM"],
"auto_map": {
"AutoConfig": "configuration_internlm.InternLMConfig",
"AutoModel": "modeling_internlm.InternLMForCausalLM",
"AutoModelForCausalLM": "modeling_internlm.InternLMForCausalLM"
"AutoModelForCausalLM": "modeling_internlm.InternLMForCausalLM",
},
"bias": True,
"bos_token_id": 1,
Expand All @@ -471,7 +471,7 @@
"torch_dtype": "float16",
"transformers_version": "4.33.2",
"use_cache": True,
"vocab_size": 103168
"vocab_size": 103168,
},
# TODO(mlc-team): enable the model presets when stablized.
# "gemma_2b": {
Expand Down