Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Tune] Transformer blog example #9789

Merged
merged 44 commits into from
Aug 5, 2020
Merged

[Tune] Transformer blog example #9789

Changes from 1 commit
Commits
Show all changes
44 commits
Select commit Hold shift + click to select a range
2215479
Add PBT transformer example
Jul 21, 2020
882084b
mkdir if not exists
Jul 21, 2020
c047395
added reporter
Jul 22, 2020
bc68c8a
Added comments
Jul 23, 2020
2499032
(cont).
Jul 23, 2020
a563a28
evaluate much more often
Jul 23, 2020
5d044f4
(cont.) evaluate much more often
Jul 23, 2020
7ce40d9
Smaller batch sizes to avoid cuda memory out of error on V100 GPUs.
Jul 23, 2020
85ccad2
Start with random parameters
Jul 23, 2020
997c028
Added checkpointing to pbt example
Jul 24, 2020
ea04313
Updates
amogkam Jul 25, 2020
e67463c
more updates
amogkam Jul 29, 2020
97e64e4
fix wandb and set keep_checkpoint_num
amogkam Jul 29, 2020
c196480
add init
amogkam Jul 29, 2020
a2e8319
formatting
amogkam Jul 29, 2020
c687f11
cleanup and example link
amogkam Jul 29, 2020
1829d5e
adding smoke test
amogkam Jul 29, 2020
26d6292
add example doc
amogkam Jul 29, 2020
627f293
make smoke test shorter
amogkam Jul 29, 2020
cad0c0c
remove emoji
amogkam Jul 29, 2020
f4643b8
docs
amogkam Jul 29, 2020
bb1f520
updates
amogkam Jul 31, 2020
6762024
merging master
amogkam Jul 31, 2020
083d5b9
add test to build
amogkam Jul 31, 2020
f523553
wip
amogkam Jul 31, 2020
e3c86d6
revert back tutorials overview
amogkam Jul 31, 2020
4708a72
Merge branch 'master' of https://github.com/ray-project/ray into tune…
amogkam Jul 31, 2020
3fe2892
formatting
amogkam Jul 31, 2020
ea5306e
fixes
amogkam Jul 31, 2020
8c0703e
Merge branch 'master' of https://github.com/ray-project/ray into tune…
amogkam Aug 3, 2020
70d43d2
more updates
amogkam Aug 3, 2020
65ddd3d
Merge branch 'master' of https://github.com/ray-project/ray into tune…
amogkam Aug 3, 2020
f2f13ce
adding transformers dep for tests
amogkam Aug 3, 2020
6581ece
lint
amogkam Aug 4, 2020
3c31b87
Merge branch 'master' of https://github.com/ray-project/ray into tune…
amogkam Aug 4, 2020
5b5edb6
update test
amogkam Aug 4, 2020
ee0b7ad
Merge branch 'master' of https://github.com/ray-project/ray into tune…
amogkam Aug 4, 2020
9b8785f
doc fix
amogkam Aug 4, 2020
f715895
fix data downloading error
amogkam Aug 4, 2020
f5f7eea
make test large
amogkam Aug 4, 2020
28b19f2
Merge branch 'master' of https://github.com/ray-project/ray into tune…
amogkam Aug 4, 2020
68978dd
adding mock test data and using smaller model
amogkam Aug 5, 2020
e8af5e9
lint
amogkam Aug 5, 2020
3fe4b04
make test even shorter
amogkam Aug 5, 2020
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
adding smoke test
  • Loading branch information
@amogkam
amogkam committed Jul 29, 2020
commit 1829d5eb2b75725939a51c1250adeb5ee284dc55
4 changes: 4 additions & 0 deletions ci/jenkins_tests/run_tune_tests.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -162,6 +162,10 @@ $SUPPRESS_OUTPUT docker run --rm --shm-size=${SHM_SIZE} --memory=${MEMORY_SIZE}
python /ray/python/ray/tune/examples/pbt_dcgan_mnist/pbt_dcgan_mnist.py \
--smoke-test

$SUPPRESS_OUTPUT docker run --rm --shm-size${SHM_SIZE} --memory=${MEMORY_SIZE} --memory-swap=-1 $DOCKER_SHA \
python /ray/python/ray/tune/examples/pbt_transformers/pbt_transformers.py \
--smoke-test

amogkam marked this conversation as resolved.
Show resolved Hide resolved
$SUPPRESS_OUTPUT docker run --rm --shm-size=${SHM_SIZE} --memory=${MEMORY_SIZE} --memory-swap=-1 $DOCKER_SHA \
python /ray/ci/long_running_distributed_tests/workloads/pytorch_pbt_failure.py \
--smoke-test
Expand Down