Skip to content

Commit 9f89e98

Browse files
authored
Replace spring20 urls with master (yandexdataschool#451)
* s/spring20/master/g * s/spring20/master/g in Markdown files * s/spring20/master/g in setup_colab.sh
1 parent d51a1ee commit 9f89e98

31 files changed

+74
-76
lines changed

setup_colab.sh

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2,4 +2,4 @@
22

33
apt-get -qq update
44
apt-get -qq install -y xvfb
5-
wget -q https://raw.githubusercontent.com/yandexdataschool/Practical_RL/spring20/xvfb -O ../xvfb
5+
wget -q https://raw.githubusercontent.com/yandexdataschool/Practical_RL/master/xvfb -O ../xvfb

week01_intro/crossentropy_method.ipynb

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -17,7 +17,7 @@
1717
"source": [
1818
"import sys, os\n",
1919
"if 'google.colab' in sys.modules and not os.path.exists('.setup_complete'):\n",
20-
" !wget -q https://raw.githubusercontent.com/yandexdataschool/Practical_RL/spring20/setup_colab.sh -O- | bash\n",
20+
" !wget -q https://raw.githubusercontent.com/yandexdataschool/Practical_RL/master/setup_colab.sh -O- | bash\n",
2121
" !touch .setup_complete\n",
2222
"\n",
2323
"# This code creates a virtual display to draw game images on.\n",

week01_intro/deep_crossentropy_method.ipynb

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -20,7 +20,7 @@
2020
"source": [
2121
"import sys, os\n",
2222
"if 'google.colab' in sys.modules and not os.path.exists('.setup_complete'):\n",
23-
" !wget -q https://raw.githubusercontent.com/yandexdataschool/Practical_RL/spring20/setup_colab.sh -O- | bash\n",
23+
" !wget -q https://raw.githubusercontent.com/yandexdataschool/Practical_RL/master/setup_colab.sh -O- | bash\n",
2424
"\n",
2525
" !touch .setup_complete\n",
2626
"\n",

week01_intro/primer_python_for_ml/recap_ml.ipynb

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -121,7 +121,7 @@
121121
"\n",
122122
"import sys\n",
123123
"if 'google.colab' in sys.modules:\n",
124-
" !wget -q https://raw.githubusercontent.com/yandexdataschool/Practical_RL/spring20/week01_intro/primer_python_for_ml/train.csv"
124+
" !wget -q https://raw.githubusercontent.com/yandexdataschool/Practical_RL/master/week01_intro/primer_python_for_ml/train.csv"
125125
]
126126
},
127127
{

week01_intro/seminar_gym_interface.ipynb

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@
88
"source": [
99
"import sys, os\n",
1010
"if 'google.colab' in sys.modules and not os.path.exists('.setup_complete'):\n",
11-
" !wget -q https://raw.githubusercontent.com/yandexdataschool/Practical_RL/spring20/setup_colab.sh -O- | bash\n",
11+
" !wget -q https://raw.githubusercontent.com/yandexdataschool/Practical_RL/master/setup_colab.sh -O- | bash\n",
1212
"\n",
1313
" !touch .setup_complete\n",
1414
"\n",

week02_value_based/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -9,6 +9,6 @@
99

1010
## Homework description:
1111

12-
The main assignment is `seminar_vi.ipynb`[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/yandexdataschool/Practical_RL/blob/spring20/week02_value_based/seminar_vi.ipynb) notebook in this week's folder. It has no requirements besides the most basic data science libraries (e.g. numpy) so you should be able to run it locally.
12+
The main assignment is `seminar_vi.ipynb`[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/yandexdataschool/Practical_RL/blob/master/week02_value_based/seminar_vi.ipynb) notebook in this week's folder. It has no requirements besides the most basic data science libraries (e.g. numpy) so you should be able to run it locally.
1313

1414
__Note:__ if you have any difficulty using graphviz, just set `has_graphviz=False`.

week02_value_based/seminar_vi.ipynb

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -30,8 +30,8 @@
3030
"source": [
3131
"import sys, os\n",
3232
"if 'google.colab' in sys.modules and not os.path.exists('.setup_complete'):\n",
33-
" !wget -q https://raw.githubusercontent.com/yandexdataschool/Practical_RL/spring20/setup_colab.sh -O- | bash\n",
34-
" !wget -q https://raw.githubusercontent.com/yandexdataschool/Practical_RL/spring20/week02_value_based/mdp.py\n",
33+
" !wget -q https://raw.githubusercontent.com/yandexdataschool/Practical_RL/master/setup_colab.sh -O- | bash\n",
34+
" !wget -q https://raw.githubusercontent.com/yandexdataschool/Practical_RL/master/week02_value_based/mdp.py\n",
3535
" !touch .setup_complete\n",
3636
"\n",
3737
"# This code creates a virtual display to draw game images on.\n",

week03_model_free/README.md

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -3,8 +3,8 @@
33
* Russian materials:
44
- Lecture - [video](https://yadi.sk/i/jcQ1Bg8n3SrhuQ)
55
- Seminars
6-
- Q-learning seminar - [video](https://yadi.sk/i/dQmolwOy3EtGNK) (older track - [assignment](https://github.com/neer201/Practical_RL/tree/spring20/week03_model_free/crawler_and_pacman/seminar_py2))
7-
- SARSA & stuff - [video](https://yadi.sk/i/XbqNQmjm3ExNsq)
6+
- Q-learning seminar - [video](https://yadi.sk/i/dQmolwOy3EtGNK) (older track - [assignment](https://github.com/neer201/Practical_RL/tree/master/week03_model_free/crawler_and_pacman/seminar_py2))
7+
- SARSA & stuff - [video](https://yadi.sk/i/XbqNQmjm3ExNsq)
88
* English materials:
99
- Lecture by David Silver (english) - [video part I](https://www.youtube.com/watch?v=PnHCvfgC_ZA), [video part II](https://www.youtube.com/watch?v=0g4j2k_Ggc4&t=43s)
1010
- Alternative lecture by Pieter Abbeel (english) - [video](https://www.youtube.com/watch?v=ifma8G7LegE)
@@ -18,9 +18,9 @@
1818

1919
### Assignments
2020

21-
Just as usual, start with
22-
- [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/yandexdataschool/Practical_RL/blob/spring20/week03_model_free/seminar_qlearning.ipynb)
21+
Just as usual, start with
22+
- [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/yandexdataschool/Practical_RL/blob/master/week03_model_free/seminar_qlearning.ipynb)
2323
`seminar_qlearning.ipynb` _Implement q-learning agent and test it on Taxi and CartPole with binarizer_
2424

25-
and then proceed to
26-
- [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/yandexdataschool/Practical_RL/blob/spring20/week03_model_free/homework.ipynb) `homework.ipynb` _Implement EV-SARSA agent, experience replay + bonus tasks_
25+
and then proceed to
26+
- [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/yandexdataschool/Practical_RL/blob/master/week03_model_free/homework.ipynb) `homework.ipynb` _Implement EV-SARSA agent, experience replay + bonus tasks_

week03_model_free/crawler_and_pacman/seminar_py2/README.md

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
# Disclaimer
2-
This assignment is not supported now. You can do it at your own risk.
2+
This assignment is not supported now. You can do it at your own risk.
33

44
_this assignment borrows code from awesome [cs188](http://ai.berkeley.edu/project_overview.html)_
55
This homework assignment works on __python2 only__. If you stick to py3, consider seminar_alternative. Or just install it for this homework alone and remove afterwards.
@@ -17,8 +17,8 @@ python pacman.py -p PacmanQAgent -x 5000 -n 5010 -l smallGrid # example
1717
```
1818
* Make sure you can tune agent to beat ./run_crawler.sh
1919
* on windows, just run `python crawler.py` from cmd in the project directory
20-
* other ./run* files are mostly for your amusement.
21-
* ./run_pacman.sh will need more epochs to converge, see [comments](https://github.com/yandexdataschool/Practical_RL/blob/spring20/week03_model_free/crawler_and_pacman/seminar_py2/run_pacman.sh)
20+
* other ./run* files are mostly for your amusement.
21+
* ./run_pacman.sh will need more epochs to converge, see [comments](https://github.com/yandexdataschool/Practical_RL/blob/master/week03_model_free/crawler_and_pacman/seminar_py2/run_pacman.sh)
2222
* on windows, just copy the type `python pacman.py -p PacmanQAgent -x 2000 -n 2010 -l smallGrid` in cmd from assignemnt dir
2323

2424

@@ -35,14 +35,14 @@ The problem with those environments is that they have a large amount of unique s
3535
* where is nearest food
3636
* 'center of mass' of all food points (and variance, and whatever)
3737
* is there a wall in each direction
38-
* and anything else you see fit
39-
38+
* and anything else you see fit
39+
4040
Here's how to get this information from [state](https://github.com/yandexdataschool/Practical_RL/blob/7a559f8/week03_model_free/seminar_py2/pacman.py#L49),
4141
* Get pacman position: [state.getPacmanPosition()](https://github.com/yandexdataschool/Practical_RL/blob/7a559f8/week03_model_free/seminar_py2/pacman.py#L128)
4242
* Is there a wall at (x,y)?: [state.hasWall(x,y)](https://github.com/yandexdataschool/Practical_RL/blob/7a559f8/week03_model_free/seminar_py2/pacman.py#L189)
4343
* Get ghost positions: [state.getGhostPositions()](https://github.com/yandexdataschool/Practical_RL/blob/7a559f8/week03_model_free/seminar_py2/pacman.py#L144)
4444
* Get all food positions: [state.getCapsules()](https://github.com/yandexdataschool/Practical_RL/blob/7a559f8/week03_model_free/seminar_py2/pacman.py#L153)
45-
45+
4646
You can call those methods anywhere you see state.
4747
* e.g. in [agent.getValue(state)](https://github.com/yandexdataschool/Practical_RL/blob/7a559f8/week03_model_free/seminar_py2/qlearningAgents.py#L52)
4848
* Defining a function that extracts all features and calling it in [getQValue](https://github.com/yandexdataschool/Practical_RL/blob/7a559f8/week03_model_free/seminar_py2/qlearningAgents.py#L38) and [setQValue](https://github.com/yandexdataschool/Practical_RL/blob/7a559f8/week03_model_free/seminar_py2/qlearningAgents.py#L44) is probably enough.

week03_model_free/crawler_and_pacman/seminar_py3/README.md

Lines changed: 7 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -1,13 +1,13 @@
11
Contributors: [Vlad Lyalin](https://github.com/Guitaricet)
22

33
# Disclaimer
4-
This assignment is not supported now. You can do it at your own risk.
4+
This assignment is not supported now. You can do it at your own risk.
55

66
# Requirements
77
__Ubuntu__ - not tested
88

99
__MacOS__ Python 3.7.0 (3.6, 3.8 and other cause on MacOS [problems](https://stackoverflow.com/questions/57400301/how-to-fix-tkinter-every-code-with-gui-crashes-mac-os-with-respring) with _Tkinter_)
10-
10+
1111
Anaconda users just can create new_env:
1212
```bash
1313
conda create -n pacman_env python=3.7.0
@@ -31,8 +31,8 @@ python pacman.py -p PacmanQAgent -x 5000 -n 5010 -l smallGrid # example
3131
```
3232
* Make sure you can tune agent to beat ./run_crawler.sh
3333
* on windows, just run `python crawler.py` from cmd in the project directory
34-
* other ./run* files are mostly for your amusement.
35-
* ./run_pacman.sh will need more epochs to converge, see [comments](https://github.com/yandexdataschool/Practical_RL/blob/spring20/week03_model_free/crawler_and_pacman/seminar_py2/run_pacman.sh)
34+
* other ./run* files are mostly for your amusement.
35+
* ./run_pacman.sh will need more epochs to converge, see [comments](https://github.com/yandexdataschool/Practical_RL/blob/master/week03_model_free/crawler_and_pacman/seminar_py2/run_pacman.sh)
3636
* on windows, just copy the type `python pacman.py -p PacmanQAgent -x 2000 -n 2010 -l smallGrid` in cmd from assignemnt dir
3737

3838

@@ -49,14 +49,14 @@ The problem with those environments is that they have a large amount of unique s
4949
* where is nearest food
5050
* 'center of mass' of all food points (and variance, and whatever)
5151
* is there a wall in each direction
52-
* and anything else you see fit
53-
52+
* and anything else you see fit
53+
5454
Here's how to get this information from [state](https://github.com/yandexdataschool/Practical_RL/blob/7a559f8/week03_model_free/seminar_py2/pacman.py#L49),
5555
* Get pacman position: [state.getPacmanPosition()](https://github.com/yandexdataschool/Practical_RL/blob/7a559f8/week03_model_free/seminar_py2/pacman.py#L128)
5656
* Is there a wall at (x,y)?: [state.hasWall(x,y)](https://github.com/yandexdataschool/Practical_RL/blob/7a559f8/week03_model_free/seminar_py2/pacman.py#L189)
5757
* Get ghost positions: [state.getGhostPositions()](https://github.com/yandexdataschool/Practical_RL/blob/7a559f8/week03_model_free/seminar_py2/pacman.py#L144)
5858
* Get all food positions: [state.getCapsules()](https://github.com/yandexdataschool/Practical_RL/blob/7a559f8/week03_model_free/seminar_py2/pacman.py#L153)
59-
59+
6060
You can call those methods anywhere you see state.
6161
* e.g. in [agent.getValue(state)](https://github.com/yandexdataschool/Practical_RL/blob/7a559f8/week03_model_free/seminar_py2/qlearningAgents.py#L52)
6262
* Defining a function that extracts all features and calling it in [getQValue](https://github.com/yandexdataschool/Practical_RL/blob/7a559f8/week03_model_free/seminar_py2/qlearningAgents.py#L38) and [setQValue](https://github.com/yandexdataschool/Practical_RL/blob/7a559f8/week03_model_free/seminar_py2/qlearningAgents.py#L44) is probably enough.

0 commit comments

Comments
 (0)