Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

AOS55/issue9 #12

Merged
merged 64 commits into from
Nov 23, 2022
Merged

AOS55/issue9 #12

merged 64 commits into from
Nov 23, 2022

Conversation

AOS55
Copy link
Owner

@AOS55 AOS55 commented Nov 23, 2022

Corrected issue 9 tasks

AOS55 added 30 commits September 30, 2022 16:18
@AOS55
Procedure to collect data from teacher
ee7a9c9
@AOS55
sample over multiple seeds
3d9080e
@AOS55
push sampling to datasets directory when done and option selected in …
7686169 
…config
@AOS55
changed obs from state input
87c4345
@AOS55
corrected for state observation
77a94f3
@AOS55
load snapshot correctly
cae00b7
@AOS55
check observation is initiated correctly
39194a5
@AOS55
add procedure to sample from constraints and goal_states
fcf11ac
@AOS55
added skill_dim parameter
d759e28
@AOS55
added pixel train param
c8b9db0
@AOS55
added configs for sampling
243fb4a
@AOS55
removed extra line break
8658285
@AOS55
255 divide to scale obs correctly
fd77b64
@AOS55
instantiate safe_set loading correctly
3aaaadd
@AOS55
change to procedure used to upload_data
3dc1a46
@AOS55
Merge branch 'AOS55/issue9' of github.com:AOS55/url-suite into AOS55/…
d96f309 
…issue9
@AOS55
Safe Learning
c90dade 
Fixes #4
@AOS55
added random_start option to safe environments
54d292a
@AOS55
corrected transform dict length for replay buffer
eeb7aa6
@AOS55
added random_start
1f0774d
@AOS55
added seperate model dir if random for now
121365f
@AOS55
added seperate dir for restart for now
527ba94
@AOS55
changed to 150 data_counts
b7e4ab9
@AOS55
refactored to reflect new prioritized sampling
5d0e845
@AOS55
printed pretrained_agent name
c7f000c
@AOS55
added optimistic forgetting rule
198d9af
@AOS55
sampling_batch updated to use smm and prioritized_sampling
5bf7d0b
@AOS55
increased number of samples ot 150
d9d68f1
@AOS55
increased num_updates to 500
88886c9
@AOS55
set random_start to false for pretraining
522f899
AOS55 added 25 commits October 26, 2022 07:52
@AOS55
correct for state representation
c2bfb72
@AOS55
add goal_behaviour
0341ca5
@AOS55
added protocol for saving if ep length not 100
573a262
@AOS55
working on ant environment
ef8983f
@AOS55
sampling prioritized replay
c07c727
@AOS55
skill_dim
eba2b4e
@AOS55
remove print
199f422
@AOS55
change to sh script
66b3eeb
@AOS55
added log to gitignore
913b863
@AOS55
pass custom skill dim through smm.yaml
31edba6
@AOS55
added .out to gitignore
81a7021
@AOS55
Merge pull request #11 from AOS55/issue9-detach
f2b9d46 
Added detach commands into issue 9
@AOS55
removed line that shouldnt be there
1160b3a
@AOS55
added reward function
f28e793
@AOS55
pulled out smm coefficients
4ec240a
@AOS55
change p_reward when available
fea7dae
@AOS55
logging losses
78312e1
@AOS55
adding longer training
8e2849d
@AOS55
added plot param and more training
9d2d788
@AOS55
fixed range of log_p_star
44b1ed9
@AOS55
added smm params for pass through and log params
74e7c6f
@AOS55
add pretrain ent_coef sweep
36d8577
@AOS55
reduced reward required, prioritized_sampling
44d77aa
@AOS55
sampling batch over snapshot and skill dim
5df60b0
@AOS55
added procedure to rename files
50e6ab0
@AOS55
Copy link
Owner Author

AOS55 commented Nov 23, 2022

Added p* term for smm and several procedures for better data collection from prioritized sampling

AOS55
AOS55 commented Nov 23, 2022
View reviewed changes
Copy link
Owner Author

@AOS55 AOS55 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

closing issue 9 with merge

@AOS55 AOS55 merged commit 47028c0 into main Nov 23, 2022
@AOS55 AOS55 deleted the AOS55/issue9 branch November 23, 2022 11:09
@AOS55 AOS55 mentioned this pull request Nov 23, 2022
Closed
5 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@AOS55