Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

0.2 #126

Merged
merged 101 commits into from
Feb 15, 2023
Merged

0.2 #126

merged 101 commits into from
Feb 15, 2023

Conversation

chengchingwen
Copy link
Owner

No description provided.

@chengchingwen
rewrite wordpiece with DAT
34f247f
@chengchingwen
show func for wordpiece
7c8437f
@chengchingwen
update test
f01f9b9
@chengchingwen
correct way to get unk
341b614
@chengchingwen
Merge branch 'wp_v2'
a096de7
@chengchingwen
refactor hgf config
0787086
@chengchingwen
remove old codes
4f980e7
@chengchingwen
update to pre-0.2.0
9e1ca4d
@chengchingwen
rewrite loss; borrow api from Flux and add rrule
b51d5fd
@chengchingwen
refine loss
bae559c
@chengchingwen
Merge remote-tracking branch 'origin/master' into 0.2
5698c66
@chengchingwen
remove include of removed files
eab1087
@chengchingwen
update t5 impl with new design
1ce4ad9
@chengchingwen
add new layer design
6b52994
@chengchingwen
small refine
71c892b
@chengchingwen
update bert default config
faf7ff4
@chengchingwen
update bert impl with new design
c10eab0
@chengchingwen
fix new t5 impl
1a9875f
@chengchingwen
new load model api
76859bb
@chengchingwen
add bias to embed decoder
04494aa
@chengchingwen
fix embed method
8c097ee
@chengchingwen
update huggingface based model validate code with new api
e64630b
@chengchingwen
load gpt2 with new design
c9656ed
@chengchingwen
load gptj
86b3575
@chengchingwen
update validate code with confing overwrite
db261af
@chengchingwen
fix cfg overwrite
0981564
@chengchingwen
load gpt_neo
c25eb47
@chengchingwen
load model utils; force load as float32
711aaf8
@chengchingwen
move pe to NAlib
dacaba5
@chengchingwen
move atten ops to Layers
a75de7c
@chengchingwen
Copy link
Owner Author

chengchingwen commented Feb 9, 2023 •
edited
Loading

Closes #6, #10, #14, #63, #78, #91, #97, #98, #118, #119, #124, #127

@chengchingwen chengchingwen merged commit cccf323 into master Feb 15, 2023
@chengchingwen chengchingwen mentioned this pull request Sep 8, 2023
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@chengchingwen