Version 0.2.0 of QDax #126
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
overload issue in replay buffer, add buffer test + move baselines test to separate folder
…ronments, Hypervolume functions and QD Suite (#73) * adding sphere, rastrigin, arm, and noisy_arm scoring functions * adding possibility to create default scoring_function for brax environments. * changing type of EnvState to brax.envs.State * fix some quick typing inconsistencies throughout the code. * update README to include the default functions and make it a usable * create an examples directory to include scripts and notebooks
Policy delay update to PGA emitter update. Present in TD3 but was missing from the PG Emitter.
Missing re-initialization of the optimizer state (adam optimizer) for PG variations in PG emitter
* add wrapper for to make the reset function return a fixed initial state * set fixed_init_state to False by default
* update brax version for notebook examples
* add MAP-Elites-ES * add tests for mees * add mees example notebook * update colab link in mees example * clean up mees notebook * Speed up novelty for mees * Set paper parameters for emitter and notebook * Add utils to resample individuals repetitively * [fix] fix key handling in sampling * Test for sampling utils * Fix sampling test format * Update files to last develop * Remove old notebook * Uniformise optimizer for Adam and SGD * Add parents-sampling parameters to config * Simplify ME-ES notebook using reset_based_scoring_function_brax_envs * minor updates * style updates * Define a separate class for novelty archive * Refactor code for readability - extract es process from main method * Add option for ME-ES-explore * [fix] Fix NoveltyArchive lax.scan compatibility * add MEES to docs + minor typos Co-authored-by: Felix <f.chalumeau@instadeep.com>
* Improve reset_based scoring usage in brax env default definition functions * fix styling issue with pre-commit Co-authored-by: Felix <f.chalumeau@instadeep.com> Co-authored-by: Bryan Lim <limbryan239@gmail.com>
* Add a base Multi-Emitter implementation of a batch of Emitters. * No choice strategy is used, all sub emitters are called and the proportion are defined in the script when defining the sub emitters. * We will consider adding "strategic" layers later, to manage the choice of emitters or the proportion. This is left for a future PR.
Add emitters introduced in CMA-ME, add tests, notebook, update the documentation, fix CMA-ES and fix CMA-MEGA
refactor pgame, create quality pg emitter, creates diversity pg emitter, rename greedy and controllers, add qdpg, with notebooks and tests, update readme and docs
Co-authored-by: valentin <v.mace@instadeep.com>
distributed map elites with example and docs. No explicit support for TPU.
* feat!: extra-scores for repertoire addition * Fix display * Add extra_scores to mome repertoire as well * add warnings to me and mome repertoires Co-authored-by: Felix <f.chalumeau@instadeep.com>
Lookatator
approved these changes
Nov 30, 2022
Codecov Report
@@ Coverage Diff @@
## main #126 +/- ##
==========================================
+ Coverage 89.58% 92.31% +2.73%
==========================================
Files 67 103 +36
Lines 3907 5816 +1909
==========================================
+ Hits 3500 5369 +1869
- Misses 407 447 +40
📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more |
limbryan
approved these changes
Nov 30, 2022
…n using fixed init state (#128)
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Hi guys,
Time for us to move to version 0.2.0 🎉
This release introduces: