Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Capture error message during sweep tests #2351

Merged
merged 11 commits into from
Sep 27, 2022
Merged

Capture error message during sweep tests #2351

Changes from 1 commit
Commits
Show all changes
11 commits
Select commit Hold shift + click to select a range
c9bfeb0
Collect error messages in results.csv
molly-smith Sep 19, 2022
dca97c2
Keep running tests even if errors
molly-smith Sep 23, 2022
ad3f690
Continue running tests even if errorswq
molly-smith Sep 23, 2022
f392e90
Merge branch 'microsoft:master' into sweep_tests
molly-smith Sep 23, 2022
c5f3b8b
Revert "Keep running tests even if errors"
molly-smith Sep 23, 2022
91585a2
Merge branch 'sweep_tests' of https://github.com/molly-smith/DeepSpee…
molly-smith Sep 23, 2022
85dc22e
Continue running tests even if errors
molly-smith Sep 23, 2022
91151e1
Pre commit checks
molly-smith Sep 23, 2022
838f420
Merge branch 'master' into sweep_tests
mrwyattii Sep 26, 2022
5c4ab90
Merge branch 'master' into sweep_tests
tjruwase Sep 26, 2022
43306d1
Merge branch 'master' into sweep_tests
mrwyattii Sep 27, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Revert "Keep running tests even if errors" 
This reverts commit dca97c2.
  • Loading branch information
@molly-smith
molly-smith committed Sep 23, 2022
commit c5f3b8b4307d21e65afd1f893ce247d07d1b9fec
8 changes: 4 additions & 4 deletions benchmarks/inference/sweep.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
set -x
set -ex

export TRANSFORMERS_CACHE=/tmp/hf-cache

Expand All @@ -8,10 +8,10 @@ branch2=$2
gptneo_models="EleutherAI/gpt-neo-2.7B EleutherAI/gpt-neo-1.3B EleutherAI/gpt-neo-125M"
gpt2_models="gpt2 gpt2-large gpt2-xl"
gptj_models="EleutherAI/gpt-j-6B"
opt_models=""
bloom_models=""
opt_models="facebook/opt-125m facebook/opt-1.3b facebook/opt-2.7b facebook/opt-6.7b facebook/opt-13b"
bloom_models="bigscience/bloom-560m bigscience/bloom-1b7 bigscience/bloom-3b bigscience/bloom-7b1"

for gpus in `echo "1"`; do
for gpus in `echo "1 2 4 8"`; do
for dtype in `echo "fp16 fp32"`; do
for graphs in `echo "true false"`; do
for kernel in `echo "true false"`; do
Expand Down