Skip to content

Hydra integration #202

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 9 commits into from
Jun 24, 2022
Merged

Hydra integration #202

merged 9 commits into from
Jun 24, 2022

Conversation

vmoens
Copy link
Collaborator

@vmoens vmoens commented Jun 16, 2022

No description provided.

@vmoens vmoens self-assigned this Jun 16, 2022
@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Jun 16, 2022
vmoens added 2 commits June 16, 2022 10:43
# Conflicts:
#	.circleci/unittest/linux/scripts/environment.yml
#	.circleci/unittest/linux_stable/scripts/environment.yml
@vmoens vmoens added enhancement New feature or request bc breaking backward compatibility breaking change labels Jun 16, 2022
BoboBananas and others added 5 commits June 16, 2022 16:48
* Added TrainConfig dataclass to replace args

* Added dataclass RecorderConfig for recorder.py

* Added ReplayArgsConfig

* Added comments for ReplayArgsConfig, TrainerConfig, and RecorderConfig

* Added OffPolicyCollectorConfig and OnPolicyCollectorConfig dataclasses

* Added EnvConfig

* Added LossConfig and LossPPOConfig

* Added ContinuousModelConfig and DiscreteModelConfig

* Integrated hydra w/ ppo example

* Able to override parameters w/ yaml file provided through command line

* PPO example working w/ hydra

* Fixed styling issues

* Added hydra dependencies to setup.py

* Refactored args from argparser to cfg

* Fixed style issues

* Fixing more style issues

* Refactor input config file to overriding_cfg

* Removed import of DictConfig, now using str type hinting for DictConfig

* Integrated hydra into SAC

* Make hydra optional dependency in trainers.py

* change cfg comment

* Removed hydra in trainers.py

* Changing hydra-core version to >=1.1 version

* Modified tests affected by hydra change

* Fixing style issues in trainers.py

* Added hydra dependency to environment.yml

* Added generate_seeds import

Co-authored-by: Bhuvan Basireddy <bbreddy@devfair0832.h2.fair>
* Added TrainConfig dataclass to replace args

* Added dataclass RecorderConfig for recorder.py

* Added ReplayArgsConfig

* Added comments for ReplayArgsConfig, TrainerConfig, and RecorderConfig

* Added OffPolicyCollectorConfig and OnPolicyCollectorConfig dataclasses

* Added EnvConfig

* Added LossConfig and LossPPOConfig

* Added ContinuousModelConfig and DiscreteModelConfig

* Integrated hydra w/ ppo example

* Able to override parameters w/ yaml file provided through command line

* PPO example working w/ hydra

* Fixed styling issues

* Added hydra dependencies to setup.py

* Refactored args from argparser to cfg

* Fixed style issues

* Fixing more style issues

* Refactor input config file to overriding_cfg

* Removed import of DictConfig, now using str type hinting for DictConfig

* Integrated hydra into SAC

* Integrated hydra into DDPG

* Make hydra optional dependency in trainers.py

* change cfg comment

* Removed hydra in trainers.py

* Changing hydra-core version to >=1.1 version

* Modified tests affected by hydra change

* Fixing style issues in trainers.py

* Added hydra dependency to environment.yml

* Added generate_seeds import

Co-authored-by: Bhuvan Basireddy <bbreddy@devfair0832.h2.fair>
* Added TrainConfig dataclass to replace args

* Added dataclass RecorderConfig for recorder.py

* Added ReplayArgsConfig

* Added comments for ReplayArgsConfig, TrainerConfig, and RecorderConfig

* Added OffPolicyCollectorConfig and OnPolicyCollectorConfig dataclasses

* Added EnvConfig

* Added LossConfig and LossPPOConfig

* Added ContinuousModelConfig and DiscreteModelConfig

* Integrated hydra w/ ppo example

* Able to override parameters w/ yaml file provided through command line

* PPO example working w/ hydra

* Fixed styling issues

* Added hydra dependencies to setup.py

* Refactored args from argparser to cfg

* Fixed style issues

* Fixing more style issues

* Refactor input config file to overriding_cfg

* Removed import of DictConfig, now using str type hinting for DictConfig

* Integrated hydra into SAC

* Integrated hydra into DDPG

* Integrated hydra into REDQ

* Make hydra optional dependency in trainers.py

* change cfg comment

* Removed hydra in trainers.py

* Changing hydra-core version to >=1.1 version

* Modified tests affected by hydra change

* Fixing style issues in trainers.py

* Added hydra dependency to environment.yml

* Added generate_seeds import

* Changes working

Co-authored-by: Bhuvan Basireddy <bbreddy@devfair0832.h2.fair>
# Conflicts:
#	examples/ddpg/ddpg.py
#	examples/dqn/dqn.py
#	examples/ppo/ppo.py
#	examples/redq/redq.py
#	examples/sac/sac.py
#	torchrl/trainers/helpers/envs.py
#	torchrl/trainers/helpers/recorder.py
#	torchrl/trainers/helpers/replay_buffer.py
#	torchrl/trainers/helpers/trainers.py
@vmoens vmoens merged commit 336b981 into main Jun 24, 2022
@vmoens vmoens deleted the hydra_integration branch June 24, 2022 07:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bc breaking backward compatibility breaking change CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants