NotImplementedError when executing Pong example

[shakenes]

Hey guys,
first of all thanks a lot for this project. It might become handy during my studies :)

I ran into an error while executing the example. I downloaded the pretrained model, but
python3 -m baselines.deepq.experiments.atari.enjoy --model-dir /tmp/models/model-atari-duel-pong-1 --env Pong --dueling
raised the following error:

[2018-01-31 12:24:50,221] Making new env: PongNoFrameskip-v4
Traceback (most recent call last):
  File "/usr/lib/python3.4/runpy.py", line 170, in _run_module_as_main
    "__main__", mod_spec)
  File "/usr/lib/python3.4/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/home/username/keras-tf-p3/baselines/baselines/deepq/experiments/atari/enjoy.py", line 70, in <module>
    play(env, act, args.stochastic, args.video)
  File "/home/username/keras-tf-p3/baselines/baselines/deepq/experiments/atari/enjoy.py", line 43, in play
    obs = env.reset()
  File "/home/username/keras-tf-p3/baselines/baselines/common/atari_wrappers.py", line 167, in reset
    ob = self.env.reset()
  File "/home/username/keras-tf-p3/lib/python3.4/site-packages/gym/core.py", line 104, in reset
    return self._reset()
  File "/home/username/keras-tf-p3/lib/python3.4/site-packages/gym/core.py", line 283, in _reset
    return self.env.reset()
  File "/home/username/keras-tf-p3/lib/python3.4/site-packages/gym/core.py", line 104, in reset
    return self._reset()
  File "/home/username/keras-tf-p3/lib/python3.4/site-packages/gym/core.py", line 310, in _reset
    observation = self.env.reset()
  File "/home/username/keras-tf-p3/lib/python3.4/site-packages/gym/core.py", line 104, in reset
    return self._reset()
  File "/home/username/keras-tf-p3/lib/python3.4/site-packages/gym/core.py", line 311, in _reset
    return self._observation(observation)
  File "/home/username/keras-tf-p3/lib/python3.4/site-packages/gym/core.py", line 321, in _observation
    raise NotImplementedError
NotImplementedError

The cartpole example however works fine (python -m baselines.deepq.experiments.train_cartpole)

I found this issue in gym (openai/gym#775) with the same error message, but mine seems to occur in reset() and not in render(). Downgrading to pyglet version 1.2.4 as suggested did not change anything.

Does someone know a solution to this?

[shakenes]

I found the solution: The NotImplementedError was due to an old gym version. Updating to latest gym version leads to cannot import name spaces error which can be solved by openai/gym#858

[fi000]

simontudo : how you update gym? Which version of gym you are using?

[shakenes]

Depends on how you installed it. If you just installed it via pip then execute pip install gym --upgrade
If you cloned the git repository first, you need to cd to the repo, execute git pull and then pip install -e .

I installed gym from the github repo, so it's the latest version.

[fi000]

Simontudo Thanks I have installed it from github repo Also I have updated it by command
However, my problem remains the same.
I saw the same error for another code I am using gym!

Your problem is solved by just doing update nothing else?

[shakenes]

So you have the latest versions of baselines and gym and still getting the NotImplementedError?

When I updated gym, I got cannot import name spaces and solved it with openai/gym#858

[fi000]

Yes, I have this problem(NotImplementedError)when I donwloaded from https://github.com/openai/gym
The version of my python is 3.5.6
I saw today the following comments in github for gym it has written: (Did you make these changes? If so, could you explain what we should do clearly? Sorry for misunderstanding)
What's new
2018-01-25: Made some aesthetic improvements and removed unmaintained parts of gym. This may seem like a downgrade in functionality, but it is actually a long-needed cleanup in preparation for some great new things that will be released in the next month.

Now your Env and Wrapper subclasses should define step, reset, render, close, seed rather than underscored method names.
Removed the board_game, debugging, safety, parameter_tuning environments since they're not being maintained by us at OpenAI. We encourage authors and users to create new repositories for these environments.
Changed MultiDiscrete action space to range from [0, ..., n-1] rather than [a, ..., b-1].
No more render(close=True), use env-specific methods to close the rendering.
Removed scoreboard directory, since site doesn't exist anymore.
Moved gym/monitoring to gym/wrappers/monitoring
Add dtype to Space.
Not using python's built-in module anymore, using gym.logger
2018-01-24: All continuous control environments now use mujoco_py >= 1.50. Versions have been updated accordingly to -v2, e.g. HalfCheetah-v2. Performance should be similar (see openai/gym#834) but there are likely some differences due to changes in MuJoCo.

[nevenaBlagoeva]

Hello, I am facing the same issue as described above, do you know if there has been any solution? Upgrading gym did nothing for me!

[MouseHu]

Hello, I am facing the same issue as described above, do you know if there has been any solution? Upgrading gym did nothing for me!

Have you solved your problem? I fix the issue by downgrade the version of gym.

[fahad-30]

I have the same problem as well

[NoobHua]

It may be a version-conflict problem. Upgrading the gym or Downgrading can solve it.

[hudsontek]

It may be a version-conflict problem. Upgrading the gym or Downgrading can solve it.

In my case, downgrading from 0.18 to 0.10 solved the problem.

[Joshwlks]

I am having this issue too. I can't have a version of gym outside of 0.15.4 and 0.16.0 because of baselines