Update README.md

README.md

@@ -1,23 +1,29 @@
 # PPO-Mario-Bros-Tensorflow-2
 A modular implementation for Proximal Policy Optimization in Tensorflow 2 using Eagerly Execution for the Super Mario Bros enviroment.
 
-Requeirements:
+## Requeirements:
 - Tensorflow 2
 - OpenCV
 - OpenIA gym
 - Super Mario Bros NES, developed by Kautenja
 
-How to use:
+## Installing:
 Clone the repository,
 
-For training run:
-!python -c 'from Main import train; test(True)'
+For training, run:
+```
+python -c 'from Main import train; test(True)'
+```
 The argument of test enable the load of the trained model.
 
 For testing the model:
-!python -c 'from Main import test; test(10,0)'
+```
+python -c 'from Main import test; test(10,0)'
+```
+
 Where the first argument of test is the number of episodes to test the model, and the second is the number of the enviroment to test,
 for the code the enviroments of test are the next ones:
+```
 0 : SuperMarioBros-1-1-v0
 The first level of the first world
 1 : SuperMarioBros-1-2-v0 
@@ -26,3 +32,23 @@ The second level of the first world
 The third level of the first world
 3 : SuperMarioBros-2-2-v0
 The second level of the second world
+```
+
+### This code was inspired from:
+* [1] Proximal Policy Optimization Algorithms. 
+
+  https://arxiv.org/pdf/1707.06347.pdf
+
+* [2] Gotta Learn Fast: A New Benchmark for Generalization in RL.
+
+  https://arxiv.org/pdf/1804.03720.pdf
+
+* [3] The implementation in tensorflow 1 of "coreystaten".
+
+  https://github.com/coreystaten/deeprl-ppo
+
+* [4] Some of parameters of the convolutional neural network of "jakegrigsby".
+  https://github.com/jakegrigsby/supersonic/tree/master/supersonic
+
+* [5] The implementation of Super Mario Brothers by "Kautenja".
+  https://github.com/Kautenja/gym-super-mario-bros