Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a callback to log raw stats #217

Closed
vwxyzjn opened this issue Mar 7, 2022 · 1 comment
Closed

Add a callback to log raw stats #217

vwxyzjn opened this issue Mar 7, 2022 · 1 comment

Comments

@vwxyzjn
Copy link
Contributor

vwxyzjn commented Mar 7, 2022

Describe

SB3 only logs the mean episodic return (i.e., rollout/ep_rew_mean), which is good enough in most cases. However, sometimes we may want the raw episodic return that is unaveraged. In my case, I was trying to compare my raw episodic return with rollout/ep_rew_mean, and it would look like something below, where SB3's orange curve would be much smoother because of the average operation.

image

Maybe it's worth also logging the raw stats, or at least give an option to.

#216 tracks the progress.

@araffin
Copy link
Member

araffin commented Mar 25, 2022

closed in #216

@araffin araffin closed this as completed Mar 25, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants