Skip to content

Commit

Permalink
[rllib] Support 1-dimensional action spaces (PPO) (ray-project#1347)
Browse files Browse the repository at this point in the history
* Small fix for supporting custom preprocessors

* PEP8

* Remove squeeze from actions
  • Loading branch information
cathywu authored and pcmoritz committed Dec 19, 2017
1 parent 6724f57 commit 772527c
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion python/ray/rllib/ppo/runner.py
Original file line number Diff line number Diff line change
Expand Up @@ -155,7 +155,7 @@ def load_data(self, trajectories, full_trace):
[trajectories["observations"],
trajectories["value_targets"] if use_gae else dummy,
trajectories["advantages"],
trajectories["actions"].squeeze(),
trajectories["actions"],
trajectories["logprobs"],
trajectories["vf_preds"] if use_gae else dummy],
full_trace=full_trace)
Expand Down

0 comments on commit 772527c

Please sign in to comment.