Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[RLlib] Attention nets PyTorch support and cleanup (using traj. view API). #12029

Merged
merged 185 commits into from
Dec 22, 2020
Merged
Changes from 1 commit
Commits
Show all changes
185 commits
Select commit Hold shift + click to select a range
e7f7e09
WIP.
sven1977 Oct 23, 2020
b03d49c
WIP.
sven1977 Oct 24, 2020
2467064
WIP.
sven1977 Oct 24, 2020
20e1dc6
WIP.
sven1977 Oct 25, 2020
dfd299c
WIP.
sven1977 Oct 26, 2020
88b17de
WIP.
sven1977 Oct 26, 2020
684360d
WIP.
sven1977 Oct 26, 2020
7121ded
WIP.
sven1977 Oct 26, 2020
a8f46b3
WIP.
sven1977 Oct 26, 2020
8940667
WIP.
sven1977 Oct 26, 2020
4747f27
Merge branch 'master' of https://github.com/ray-project/ray into traj…
sven1977 Oct 26, 2020
2d0287e
WIP.
sven1977 Oct 26, 2020
b0be1f8
Merge branch 'trajectory_view_api_enable_by_default_for_all_simple' i…
sven1977 Oct 26, 2020
84bd8d5
WIP.
sven1977 Oct 26, 2020
940e8d8
WIP.
sven1977 Oct 26, 2020
97fb268
WIP.
sven1977 Oct 27, 2020
9d75a84
WIP.
sven1977 Oct 27, 2020
eec4bc5
Merge branch 'master' of https://github.com/ray-project/ray into traj…
sven1977 Oct 27, 2020
a3aebdf
WIP.
sven1977 Oct 27, 2020
c824acc
WIP.
sven1977 Oct 27, 2020
5149aba
WIP.
sven1977 Oct 27, 2020
22af6bd
Merge branch 'master' of https://github.com/ray-project/ray into traj…
sven1977 Oct 27, 2020
8a30aa9
WIP.
sven1977 Oct 27, 2020
ca50712
WIP.
sven1977 Oct 27, 2020
8380ccf
WIP.
sven1977 Oct 28, 2020
d4ce5c4
WIP.
sven1977 Oct 28, 2020
c0e979f
Merge branch 'master' of https://github.com/ray-project/ray into traj…
sven1977 Oct 28, 2020
85cfe0a
WIP.
sven1977 Oct 28, 2020
ddd9847
WIP.
sven1977 Oct 29, 2020
5ff50c7
WIP.
sven1977 Oct 29, 2020
5a0e682
WIP.
sven1977 Oct 29, 2020
7bea113
WIP.
sven1977 Oct 29, 2020
d707cc6
WIP.
sven1977 Oct 29, 2020
73a07b5
WIP.
sven1977 Oct 29, 2020
e71814c
WIP.
sven1977 Oct 30, 2020
a8530cc
Merge branch 'master' of https://github.com/ray-project/ray into traj…
sven1977 Oct 30, 2020
1ffa52c
WIP.
sven1977 Oct 30, 2020
ef75111
Merge branch 'master' of https://github.com/ray-project/ray into traj…
sven1977 Oct 30, 2020
fbd3563
Merge branch 'trajectory_view_api_enable_by_default_for_all_simple' i…
sven1977 Oct 30, 2020
dd64a49
WIP.
sven1977 Oct 30, 2020
5b26223
WIP.
sven1977 Oct 30, 2020
3d5c567
Fix.
sven1977 Oct 30, 2020
a991869
Fix.
sven1977 Oct 30, 2020
14cc799
LINT.
sven1977 Oct 30, 2020
8bd7075
Fixes and LINT.
sven1977 Oct 30, 2020
0405552
WIP.
sven1977 Oct 31, 2020
4ddb792
WIP.
sven1977 Oct 31, 2020
0a0d646
Merge branch 'master' of https://github.com/ray-project/ray into traj…
sven1977 Oct 31, 2020
77ebbd0
Merge branch 'fix_torch_tf_eager_compute_grads_for_rnns' into traject…
sven1977 Oct 31, 2020
a4ed42f
Merge branch 'master' of https://github.com/ray-project/ray into traj…
sven1977 Oct 31, 2020
593426d
Fix.
sven1977 Oct 31, 2020
e60ae06
Merge branch 'master' of https://github.com/ray-project/ray into traj…
sven1977 Nov 2, 2020
b7a737d
WIP.
sven1977 Nov 2, 2020
be63f0e
WIP.
sven1977 Nov 2, 2020
67b80f0
Merge branch 'master' of https://github.com/ray-project/ray into traj…
sven1977 Nov 2, 2020
5a7020c
Fixes.
sven1977 Nov 2, 2020
3ca31cd
Fixes.
sven1977 Nov 2, 2020
f9cd241
LINT and fixes.
sven1977 Nov 2, 2020
dad163c
Fix.
sven1977 Nov 2, 2020
0cb32a9
Merge branch 'master' of https://github.com/ray-project/ray into traj…
sven1977 Nov 3, 2020
8ad714f
WIP.
sven1977 Nov 3, 2020
a00f663
Fix and remove ARS/ES again (follow-up PR).
sven1977 Nov 3, 2020
6355a2a
Fix and remove ARS/ES again (follow-up PR).
sven1977 Nov 3, 2020
eb05419
Fix APPO and DDPPO w/ traj. view API.
sven1977 Nov 3, 2020
f9ab364
WIP.
sven1977 Nov 3, 2020
2826753
LINT.
sven1977 Nov 3, 2020
14f0e22
Merge branch 'master' of https://github.com/ray-project/ray into traj…
sven1977 Nov 4, 2020
27d2d2f
Fixes.
sven1977 Nov 4, 2020
f2d0be6
Fixes.
sven1977 Nov 4, 2020
5895d80
WIP.
sven1977 Nov 4, 2020
7a4a1ee
WIP.
sven1977 Nov 4, 2020
27eeec1
WIP.
sven1977 Nov 4, 2020
4ee34f7
LINT.
sven1977 Nov 4, 2020
658999b
WIP.
sven1977 Nov 5, 2020
cd94f6f
Fix.
sven1977 Nov 5, 2020
e3e5072
Fix.
sven1977 Nov 5, 2020
59aeac4
Fix.
sven1977 Nov 5, 2020
03b558c
Fix.
sven1977 Nov 5, 2020
1ed4fc1
WIP.
sven1977 Nov 5, 2020
cbc5e11
Merge branch 'master' of https://github.com/ray-project/ray into traj…
sven1977 Nov 5, 2020
645149b
WIP.
sven1977 Nov 9, 2020
f7bd6e9
WIP.
sven1977 Nov 9, 2020
2786d7c
Merge branch 'master' of https://github.com/ray-project/ray into traj…
sven1977 Nov 9, 2020
e1f9380
Fixes.
sven1977 Nov 9, 2020
6f44e44
WIP.
sven1977 Nov 10, 2020
59bac46
WIP.
sven1977 Nov 10, 2020
8515748
Fixes.
sven1977 Nov 10, 2020
47ce4bd
LINT and Fixes.
sven1977 Nov 10, 2020
1dd256f
Merge branch 'master' of https://github.com/ray-project/ray into traj…
sven1977 Nov 10, 2020
fb135bc
WIP.
sven1977 Nov 11, 2020
5b6b73f
LINT and Fixes.
sven1977 Nov 11, 2020
7321701
Fixes.
sven1977 Nov 12, 2020
952ec40
Fixes.
sven1977 Nov 12, 2020
05b9aa9
Fixes.
sven1977 Nov 12, 2020
177296d
LINT.
sven1977 Nov 12, 2020
0f3908a
Merge branch 'master' of https://github.com/ray-project/ray into traj…
sven1977 Nov 12, 2020
1e4def9
Merge branch 'trajectory_view_api_enable_by_default_for_some_tf' into…
sven1977 Nov 12, 2020
d35b2a0
Merge branch 'master' of https://github.com/ray-project/ray into traj…
sven1977 Nov 12, 2020
7df6121
Merge branch 'master' of https://github.com/ray-project/ray into traj…
sven1977 Nov 12, 2020
acd2076
LINT fixes.
sven1977 Nov 12, 2020
8f46ae3
LINT.
sven1977 Nov 12, 2020
dd3d0d4
Merge branch 'master' of https://github.com/ray-project/ray into traj…
sven1977 Nov 12, 2020
f98de41
Fix 2 tests.
sven1977 Nov 13, 2020
07aad1c
LINT.
sven1977 Nov 13, 2020
f383319
WIP.
sven1977 Nov 13, 2020
2b34624
Merge branch 'master' of https://github.com/ray-project/ray into traj…
sven1977 Nov 13, 2020
e6a142c
Clarifications and some undos.
sven1977 Nov 13, 2020
d3121bc
revert alpha-zero
sven1977 Nov 13, 2020
7591d9c
WIP.
sven1977 Nov 15, 2020
a1d448b
WIP.
sven1977 Nov 15, 2020
15d5016
Merge branch 'master' of https://github.com/ray-project/ray into traj…
sven1977 Nov 16, 2020
ce181b4
WIP.
sven1977 Nov 16, 2020
f5396c1
WIP.
sven1977 Nov 16, 2020
b0642da
Merge branch 'master' of https://github.com/ray-project/ray into traj…
sven1977 Nov 16, 2020
f95470e
Merge branch 'master' of https://github.com/ray-project/ray into traj…
sven1977 Nov 16, 2020
8c94553
WIP.
sven1977 Nov 16, 2020
492763d
Merge branch 'trajectory_view_api_enable_by_default_for_sac_dqn_ddpg'…
sven1977 Nov 16, 2020
d2c7e5d
WIP.
sven1977 Nov 16, 2020
a6b9384
WIP.
sven1977 Nov 16, 2020
720f84b
WIP.
sven1977 Nov 16, 2020
313a585
WIP.
sven1977 Nov 16, 2020
b205910
WIP.
sven1977 Nov 17, 2020
b3977a0
Merge branch 'master' of https://github.com/ray-project/ray into traj…
sven1977 Nov 17, 2020
896ac26
Merge branch 'sample_collector_fix_batch_size' into trajectory_view_a…
sven1977 Nov 17, 2020
066904a
WIP.
sven1977 Nov 17, 2020
7b24391
WIP.
sven1977 Nov 17, 2020
80d0495
WIP.
sven1977 Nov 17, 2020
9066adc
Merge branch 'sample_collector_fix_batch_size' into trajectory_view_a…
sven1977 Nov 17, 2020
a904b1c
WIP.
sven1977 Nov 17, 2020
c9641a2
WIP.
sven1977 Nov 17, 2020
b996fe1
WIP.
sven1977 Nov 17, 2020
4a87169
WIP.
sven1977 Nov 18, 2020
403fc01
Merge branch 'master' of https://github.com/ray-project/ray into curi…
sven1977 Nov 20, 2020
375ebbc
WIP.
sven1977 Nov 20, 2020
be21f32
Merge branch 'master' of https://github.com/ray-project/ray into traj…
sven1977 Nov 23, 2020
f49cb94
Add PyBullet HalfCheetah test for SAC (tf and torch).
sven1977 Nov 23, 2020
216fd77
WIP.
sven1977 Nov 23, 2020
301f710
WIP.
sven1977 Nov 23, 2020
f4aa64c
WIP.
sven1977 Nov 24, 2020
48317fe
LEARNING, FAST VERSION!
sven1977 Nov 24, 2020
c0e1475
LINT, WIP.
sven1977 Nov 24, 2020
4d892cf
Merge branch 'master' of https://github.com/ray-project/ray into traj…
sven1977 Nov 24, 2020
859ac16
LINT, fix.
sven1977 Nov 24, 2020
06435c1
Merge branch 'master' of https://github.com/ray-project/ray into atte…
sven1977 Nov 24, 2020
c0a9a29
Merge branch 'trajectory_view_api_attention_nets' into attention_nets…
sven1977 Nov 24, 2020
698cc45
LEARNS REPEAT AFTER ME ENV.
sven1977 Nov 24, 2020
63916c4
switch between model.eval and model.train modes in TorchPolicy.
sven1977 Nov 24, 2020
a3eaad5
Merge branch 'master' of https://github.com/ray-project/ray into atte…
sven1977 Dec 1, 2020
351f4ad
WIP.
sven1977 Dec 10, 2020
2ffc39f
WIP.
sven1977 Dec 10, 2020
d45c3a8
Merge branch 'attention_nets_tf' into attention_nets_pytorch_cleanup
sven1977 Dec 10, 2020
44cf474
WIP.
sven1977 Dec 10, 2020
c858140
WIP.
sven1977 Dec 10, 2020
fa07255
Fix.
sven1977 Dec 10, 2020
3c8a73e
Merge branch 'master' of https://github.com/ray-project/ray into atte…
sven1977 Dec 13, 2020
a2c350a
Test, remove `Model.preprocess_train_batch` again (trying to avoid ad…
sven1977 Dec 13, 2020
f7d4924
Fixes and LINT.
sven1977 Dec 13, 2020
5a97310
Merge branch 'attention_nets_tf' into attention_nets_pytorch_cleanup
sven1977 Dec 13, 2020
a504442
LINT.
sven1977 Dec 13, 2020
ee40b8f
Merge branch 'master' of https://github.com/ray-project/ray into atte…
sven1977 Dec 15, 2020
a850a93
WIP.
sven1977 Dec 15, 2020
ad711b7
Merge branch 'master' of https://github.com/ray-project/ray into atte…
sven1977 Dec 16, 2020
bc5193d
WIP.
sven1977 Dec 16, 2020
db88f64
WIP.
sven1977 Dec 17, 2020
c3eaec4
Merge branch 'master' of https://github.com/ray-project/ray into atte…
sven1977 Dec 17, 2020
33c8e70
Merge branch 'master' of https://github.com/ray-project/ray into atte…
sven1977 Dec 17, 2020
8d5d7c1
Merge branch 'attention_nets_tf' into attention_nets_pytorch_cleanup
sven1977 Dec 17, 2020
15b0dc6
Fixes.
sven1977 Dec 17, 2020
7c4d79c
Fix and LINT.
sven1977 Dec 17, 2020
68d799b
Merge branch 'master' of https://github.com/ray-project/ray into atte…
sven1977 Dec 20, 2020
e13fe76
WIP.
sven1977 Dec 20, 2020
9992949
LINT.
sven1977 Dec 20, 2020
2731628
Merge branch 'attention_nets_tf' into attention_nets_pytorch_cleanup
sven1977 Dec 20, 2020
8ea1352
LINT.
sven1977 Dec 20, 2020
f6a6ecc
Merge branch 'attention_nets_tf' into attention_nets_pytorch_cleanup
sven1977 Dec 20, 2020
cec28bd
Merge branch 'master' of https://github.com/ray-project/ray into atte…
sven1977 Dec 21, 2020
49746df
LINT.
sven1977 Dec 21, 2020
b39b6a2
LINT and fix.
sven1977 Dec 21, 2020
bdc0c35
LINT.
sven1977 Dec 21, 2020
1389d14
Fix.
sven1977 Dec 21, 2020
56f3bd9
Fix.
sven1977 Dec 21, 2020
75e64dc
LINT.
sven1977 Dec 21, 2020
0c0b2e2
Fix.
sven1977 Dec 21, 2020
fe13a99
Fix and LINT.
sven1977 Dec 21, 2020
9d869f5
Merge branch 'master' of https://github.com/ray-project/ray into atte…
sven1977 Dec 21, 2020
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Merge branch 'master' of https://github.com/ray-project/ray into traj…
…ectory_view_api_enable_by_default_for_some_tf
  • Loading branch information
sven1977 committed Nov 9, 2020
commit 2786d7c9ca0296e2f27ce21124373080626a4d18

This merge commit was added into this branch cleanly.

There are no new changes to show, but you can still view the diff.