Code is currently considered pre-release, and not ready for significant external use. Beware.
To get started quickly, download and unpack the following tarball:
wget https://www.robots.ox.ac.uk/\~bdemoss/testdata.tar.gz
which includes 10 episodes from a strong PPO agent playing Breakout, as well as a converged world model for Breakout. The episodes should be put in their own directory, WM can be wherever.
Adjust the directories in src/config/test_config.yaml to match these directories (command line passing coming). Then, run main.py - then let the debugging begin.
Known numpy dependency bug, should be fixed with new gym envs from Farama coming Feb 23:
noops = self.unwrapped.np_random.integers(1, self.noop_max + 1)
is the secret problem