Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Inference PP changes for neox #1899

Merged
merged 30 commits into from
Apr 26, 2022
Merged

Inference PP changes for neox #1899

Changes from 1 commit
Commits
Show all changes
30 commits
Select commit Hold shift + click to select a range
64a58c7
Synchronize the GPUs for the text-generation inference test
Mar 3, 2022
d153b09
change pp to run inference
Mar 4, 2022
ec0edd5
support ckpt conversion between pp<->seq
jeffra Mar 15, 2022
a145129
remove conversion code, its now moved to client side
jeffra Mar 15, 2022
1aa5148
add the inference-api changes to support the GPT-Neox inference at de…
Mar 28, 2022
00d3be6
fix the accuracy issue on the GPTNeoX inference
Apr 1, 2022
525e9e7
fixing parameter copy
Apr 1, 2022
7e96581
add inference global
jeffra Apr 2, 2022
69b611e
Merge branch 'master' into inference/pipechanges
jeffra Apr 19, 2022
c271cc7
clean-up
jeffra Apr 20, 2022
586c93f
cleanup
jeffra Apr 20, 2022
676023e
more clean-up
jeffra Apr 20, 2022
da45d1a
Merge branch 'master' into inference/pipechanges
jeffra Apr 20, 2022
73afc65
more clean-up/docs
jeffra Apr 20, 2022
a31a93d
formatting
jeffra Apr 20, 2022
cecde18
fix minor issue with injection
Apr 20, 2022
e3e0a9a
Merge branch 'inference/pipechanges' of github.com:microsoft/DeepSpee…
Apr 20, 2022
9e5e1ce
refine the pipe module to get a map of the fwd_funcs to be able to in…
Apr 20, 2022
afdcac4
fix DSE
jeffra Apr 20, 2022
a16adb9
add final_linear to state dict factory ckpt split
jeffra Apr 20, 2022
7b3a75e
Merge branch 'master' into inference/pipechanges
jeffra Apr 21, 2022
a82ae85
fix for circular import issue
jeffra Apr 21, 2022
9eff79c
Merge branch 'inference/pipechanges' of github.com:microsoft/DeepSpee…
jeffra Apr 21, 2022
3a3109c
comment out sanity check for now
jeffra Apr 22, 2022
346186b
Merge branch 'master' into inference/pipechanges
RezaYazdaniAminabadi Apr 22, 2022
3f490ae
fix layernorm-param issue & compilation on newer version of torch
Apr 22, 2022
1891e30
change the default trainig_mp_size to 1
Apr 22, 2022
8bd754f
Merge branch 'master' into inference/pipechanges
jeffra Apr 26, 2022
5afbee9
fix for curand on amd
jeffra Apr 26, 2022
8627db7
fix syntax error
jeffra Apr 26, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Merge branch 'master' into inference/pipechanges
  • Loading branch information
@jeffra
jeffra authored Apr 26, 2022
commit 8bd754f4ba018cc8babae2eb39437f6e89c3833b

This merge commit was added into this branch cleanly.

There are no new changes to show, but you can still view the diff.