Skip to content
This repository has been archived by the owner on Oct 25, 2024. It is now read-only.

[CPP Graph] Baichuan & Baichuan2 Enabling #376

Merged
merged 21 commits into from
Oct 13, 2023
Merged

[CPP Graph] Baichuan & Baichuan2 Enabling #376

Changes from 1 commit
Commits
Show all changes
21 commits
Select commit Hold shift + click to select a range
dda7252
baichuan initial & compile pass
Zhenzhong1 Sep 19, 2023
e3edee6
convert & quantize pass
Zhenzhong1 Sep 20, 2023
901e4ae
fix quantize issues & finish forward part but inference fail
Zhenzhong1 Sep 20, 2023
82fbda9
fix the mul_mat weight & quantize embedding weight issues
Zhenzhong1 Sep 20, 2023
0a5a65c
add the KERNEL_DEBUG
Zhenzhong1 Sep 22, 2023
fb11ee8
benchmark mode
Zhenzhong1 Sep 25, 2023
8586334
fix print of the benchmark mode
Zhenzhong1 Sep 25, 2023
e496f64
add the baichuan tokenizer
Zhenzhong1 Sep 25, 2023
a2b2cef
update the kernel_debug print
Zhenzhong1 Sep 26, 2023
2adfea5
update the forward function
Zhenzhong1 Sep 26, 2023
f57db01
Merge branch 'main' into zhenzhong/baichuan
Zhenzhong1 Oct 10, 2023
fc11e55
extend the scratch memory size
Zhenzhong1 Oct 11, 2023
02ad887
remove debug info
Zhenzhong1 Oct 11, 2023
3a04e8e
do not display the prompt
Zhenzhong1 Oct 11, 2023
1fb209f
clang-format
Zhenzhong1 Oct 12, 2023
a9e384a
Merge branch 'main' into zhenzhong/baichuan
Zhenzhong1 Oct 12, 2023
3e78b13
clang-format
Zhenzhong1 Oct 12, 2023
898ec5b
remove pdb
Zhenzhong1 Oct 12, 2023
a4cc238
add baichuan to pybind
Zhenzhong1 Oct 12, 2023
f229a21
update readme
Zhenzhong1 Oct 13, 2023
c33314d
clang-format
Zhenzhong1 Oct 13, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Merge branch 'main' into zhenzhong/baichuan
  • Loading branch information
@Zhenzhong1
Zhenzhong1 committed Oct 10, 2023
commit f57db0173a4a7971bf0e120f7bb4dcae3007ddbc

This merge commit was added into this branch cleanly.

There are no new changes to show, but you can still view the diff.