Skip to content

Commit ccdd788

Browse files
authored
Code cleanup (#1)
* cleaning up IMPALA and commenting DQN and DDPG scripts * collector_device amend * _make_collector helper with num_env_per_collector=1 * _make_collector helper with num_env_per_collector=1, bugfix * annealing in terms of frames only * update pbar * passing device to collector (passing and policy) * default pin_memory to False * num_workers -> env_per_collector in ddpg make_parallel_env * inplace bug in ddpg loss * detach in ddpg loss * _forward_hook_safe_action set_ bugfix * contiguous sampling * removing timing strings from ddpg * PPO flags helpers * PPO flags helpers, bugfix * PPO flags helpers, bugfix * PPO flags helpers, bugfix * PPO flags helpers, bugfix
1 parent e18749e commit ccdd788

File tree

15 files changed

+447
-461
lines changed

15 files changed

+447
-461
lines changed

examples/ddpg/ddpg.py

Lines changed: 156 additions & 82 deletions
Large diffs are not rendered by default.

examples/dqn/dqn.py

Lines changed: 145 additions & 85 deletions
Large diffs are not rendered by default.

examples/impala/__init__.py

Whitespace-only changes.

examples/impala/atari_env.py

Lines changed: 0 additions & 42 deletions
This file was deleted.

examples/impala/configs/atari.yaml

Lines changed: 0 additions & 61 deletions
This file was deleted.

examples/impala/configs/workers.yaml

Whitespace-only changes.

examples/impala/main.py

Lines changed: 0 additions & 64 deletions
This file was deleted.

examples/impala/worker.py

Lines changed: 0 additions & 66 deletions
This file was deleted.

0 commit comments

Comments
 (0)