Rainbow #374

prabhatnagarajan · 2018-12-26T12:40:55Z

This PR Builds off of #344, to implement Rainbow with testing, examples, etc. into ChainerRL.

… into rainbow

…unctionality

chainerrl/agents/categorical_dqn.py

chainerrl/functions/__init__.py

chainerrl/links/noisy_linear.py

chainerrl/q_functions/dueling_dqn.py

Co-Authored-By: prabhatnagarajan <prabhat.nagarajan@gmail.com>

toslunar

LGTM

seann999 and others added 19 commits November 4, 2018 02:24

init rainbow

a642136

Merge branch 'master' of https://github.com/chainer/chainerrl

8d9d0c8

init impl for all except n-step-return

93d87b9

fix conflict

254bce4

compat w n-step

41fbd2a

test fix

d026939

gpu fix

60e53c4

gpu fix

14d0144

gpu fix

8e31fec

gpu fix

e9661b7

softmax

5821a0c

applied autopep

3a64094

removed redundant example

be1aff9

undo breaking changes

e500ee4

fix flake8 errors

9e3b909

fix docs

9d47391

flake8 fix

a3e6923

flake8 fix

e9f0b4f

resolves merge conflicts

fc899ec

prabhatnagarajan closed this Mar 6, 2019

prabhatnagarajan deleted the rainbow branch March 6, 2019 12:07

prabhatnagarajan restored the rainbow branch March 6, 2019 12:33

prabhatnagarajan reopened this Mar 6, 2019

prabhatnagarajan and others added 2 commits March 6, 2019 06:34

Merge commit 'fc899ec0b939c492eb606e0ccbe2ca296f65df33' into rainbow

c94733e

Merge branch 'master' into rainbow

c3f5746

toslunar force-pushed the rainbow branch from c94733e to c3f5746 Compare March 7, 2019 05:32

prabhatnagarajan added 4 commits March 7, 2019 00:19

Merge branch 'rainbow' of https://github.com/prabhatnagarajan/chainerrl…

e152292

… into rainbow

adds readme for rainbow

7dd69e3

fixes minor error in readme

148950f

keeps old train_categorical_ and moves existing file to train_rainbow

9f0838f

prabhatnagarajan added 6 commits April 9, 2019 23:27

minor modifications

b43632c

amends prioritized categorical

ed0189a

adds basic skeleton code from test_dqn to test new categorical loss f…

0e2dc70

…unctionality

modifies setup arrays

9ea8b91

Merge branch 'master' into rainbow

2909d5c

modifications to tests

09e5ebe

prabhatnagarajan requested a review from toslunar April 11, 2019 09:22

prabhatnagarajan added 2 commits April 11, 2019 04:27

adds tests and cleans up categorical functions somewhat

e567278

addresses flakes, minor refactoring

7b46ed2

toslunar self-assigned this Apr 11, 2019

sets exploration epsilon to 0 as per the rainbow paper, applies autopep

920c329

prabhatnagarajan changed the title ~~[WIP] Rainbow~~ Rainbow Apr 12, 2019

toslunar requested changes Apr 19, 2019

View reviewed changes

address comments from PR

f205e9a

toslunar reviewed Apr 22, 2019

View reviewed changes

chainerrl/q_functions/dueling_dqn.py Outdated Show resolved Hide resolved

toslunar and others added 7 commits April 23, 2019 04:40

Update chainerrl/q_functions/dueling_dqn.py

1ab816c

Co-Authored-By: prabhatnagarajan <prabhat.nagarajan@gmail.com>

adds scores to Rainbow PR

1fe2c46

Merge branch 'master' into rainbow

454a790

Merge remote-tracking branch 'origin/rainbow' into rainbow

0ff03ba

adds results summary and fixes time table

ad2f767

changes reference to DQN to be rainbow

77acffe

doesn't export MulAdd

b2d52be

toslunar approved these changes Apr 26, 2019

View reviewed changes

toslunar added this to the v0.6 milestone Apr 26, 2019

prabhatnagarajan merged commit 0003e6e into chainer:master Apr 26, 2019

prabhatnagarajan deleted the rainbow branch May 28, 2019 14:48

muupan modified the milestones: v0.6, v0.7 Jun 28, 2019

muupan added enhancement example labels Jun 28, 2019

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Rainbow #374

Rainbow #374

prabhatnagarajan commented Dec 26, 2018

toslunar left a comment

Rainbow #374

Rainbow #374

Conversation

prabhatnagarajan commented Dec 26, 2018

toslunar left a comment

Choose a reason for hiding this comment