|
1 | 1 | # chatbot-rnn |
2 | | -A toy chatbot powered by deep learning and trained on data from Reddit |
| 2 | +A toy chatbot powered by deep learning and trained on data from Reddit. |
| 3 | + |
| 4 | +Here is a sample chat transcript (not cherry-picked). Lines that start with ">" are me; the lines without ">" are the chatbot's responses. |
| 5 | + |
| 6 | +``` |
| 7 | +> Hi, how are you? |
| 8 | + It's all good, I'm going to bed now but I'll see if I can get home tomorrow. I'll get back to you. |
| 9 | +> Don't go to bed just yet |
| 10 | + That's great, what do you think of me? |
| 11 | +> I think you're a pretty interesting conversationalist |
| 12 | + Thank you, I appreciate it. |
| 13 | +> No problem. What do you think of me? |
| 14 | + Well, you know, that's fine. I don't think I could get behind any of them. |
| 15 | +> I see. Is anyone asking you to get behind them? |
| 16 | + Of course not. I don't want to make myself look bad. |
| 17 | +> Yeah, I understand. So what's new? |
| 18 | + Anything that isn't childish and ignorant of yourself. |
| 19 | +> Do you think I'm childish and ignorant? |
| 20 | + Yes. Yes you are. |
| 21 | +> Why would you say that? |
| 22 | + I don't think you know what you are talking about. |
| 23 | +> But we've only just started talking! |
| 24 | + Yeah.. I guess I shouldn't have gotten over it... |
| 25 | +> It's all right. |
| 26 | + That's not what I meant. |
| 27 | + ``` |
| 28 | + |
| 29 | +## Get Started |
| 30 | + |
| 31 | +- Clone this project to your computer. |
| 32 | + |
| 33 | +- **Install [Tensorflow](http://www.tensorflow.org/)**. To run a pretrained model, the CPU-only installation should suffice. If you want to train your own models, you'll need the GPU installation of Tensorflow (and a powerful CUDA-compatible GPU). |
| 34 | + |
| 35 | +### Run my pre-trained model |
| 36 | + |
| 37 | +- **Download [my pre-trained model](https://drive.google.com/uc?export=download&id=0B6noVJLTV1jCT29uMzliMVVRWWM)** (201 MB). The zip file extracts into a folder named "reddit". Place that folder into the "models" directory of this project. |
| 38 | + |
| 39 | +- **Run the chatbot**. Open a terminal session and run `python chatbot.py`. Warning: this pre-trained model was trained on a diverse set of frequently off-color Reddit comments. It can (and eventually will) say things that are offensive, disturbing, bizarre or sexually explicit. It may insult minorities, it may call you names, it may accuse you of being a pedophile, it may try to seduce you. Please don't use the chatbot if these possibilities would distress you! |
| 40 | + |
| 41 | +Try playing around with the arguments to `chatbot.py` to obtain better samples: |
| 42 | + |
| 43 | +- beam_width: By default, `chatbot.py` will use beam search with a beam width of 2 to sample responses. Set this higher for more careful, more conservative (and slower) responses, or set it to 1 to disable beam search. |
| 44 | + |
| 45 | +- temperature: At each step, the model ascribes a certain probability to each character. Temperature can adjust the probability distribution. 1.0 is neutral (and the default), lower values increase high probability values and decrease lower probability values to make the choices more conservative, and higher values will do the reverse. Values outside of the range of 0.5-1.5 are unlikely to give coherent results. |
| 46 | + |
| 47 | +- relevance: Relevance is disabled by default. When enabled, two models are run in parallel: the primary model and the mask model. The mask model is scaled by the relevance value, and then the probabilities of the primary model are multiplied by the complement of the mask model before sampling. The state of the mask model is reset upon each newline character. The net effect is that the model is encourage to choose lines of dialogue that are most relevant to the prior line of dialogue, even if a more generic response (e.g. "I don't know anything about that") may be more absolutely probable. Lower relevance values put more pressure on the model to produce relevant responses, at the cost of the coherence of the responses. Going much below 1.5 compromises the quality of the responses; 2-3 is the recommended range. However, relevance is disabled by default as it halves the speed of sampling and I wasn't confident that it improved the outputs. |
| 48 | + |
| 49 | +### Get training data |
| 50 | + |
| 51 | +If you'd like to train your own model, you'll need training data. There are a few options here. |
| 52 | + |
| 53 | +- **Provide your own training data.** Training data should be one or more newline-delimited text files. Each line of dialogue should begin with "> " and end with a newline. You'll need a lot of it. Several megabytes of uncompressed text is probably the minimum, and even that may not suffice if you want to train a large model. Text can be provided as raw .txt files or as bzip2-compressed (.bz2) files. |
| 54 | + |
| 55 | +- **Simulate the United States Supreme Court.** I've included a corpus of United States Supreme Court oral argument transcripts (2.7 MB compressed) in the project under the `data/scotus` directory. |
| 56 | + |
| 57 | +- **Use Reddit data.** This is what the pre-trained model was trained on. |
| 58 | + |
| 59 | +First, download a torrent of Reddit comments from a torrent link [listed here](https://www.reddit.com/r/datasets/comments/3bxlg7/i_have_every_publicly_available_reddit_comment/). You can use the single month of comments (~5 GB compressed), or you can download the entire archive (~160 GB compressed). Do not extract the individual bzip2 (.bz2) files contained in these archives. |
| 60 | + |
| 61 | +Once you have your raw reddit data, place it in the `reddit-parse/reddit_data` subdirectory and use the `reddit-parse.py` script included in the project file to convert them into text files of appropriately formatted conversations. This script chooses qualifying comments (must be under 200 characters, can't contain certain substrings such as 'http://', can't have been posted on certain subreddits) and assembles them into dialogues of at least four lines. Coming up with good rules to curate good dialogues from raw reddit data is more art than science. I encourage you to play around with the parameters in the included `parser_config_standard.json` file, or to mess around with the parsing script itself, to come up with an interesting data set. |
| 62 | + |
| 63 | +Please be aware that there is a *lot* of Reddit data included in the torrents. It is very easy to run out of memory or hard drive space. I used the entire archive (~160 GB compressed), and ran the `reddit-parse.py` script with the configuration I included as the default, which holds a million comments (several GB) in memory at a time, takes about 12 hours to run on the entire archive, and produces 2.2 GB of bzip2-compressed output. When training the model, this raw data will be converted into numpy tensors, compressed, and saved back to disk, which consumes another ~5 GB of hard drive space. I acknowledge that this may be overkill relative to the size of the model. |
| 64 | + |
| 65 | +Once you have training data in hand (and located in a subdirectory of the `data` directory): |
| 66 | + |
| 67 | +### Train your own model |
| 68 | + |
| 69 | +- **Train.** Use `train.py` to train the model. The default hyperparameters (four layers of 1500 GRUs per layer) are the best that I've found, and are what I used to train the pre-trained model for about 37 days. These hyperparameters will just about fill the memory of a Titan X GPU, so if you have a smaller GPU, you will need to adjust them accordingly -- most straightforwardly, by reducing the batch size. |
| 70 | + |
| 71 | +Training can be interrupted with crtl-c at any time, and will immediately save the model when interrupted. Training can be resumed on a saved model and will automatically carry on from where it was interrupted. |
| 72 | + |
| 73 | +## Thanks |
| 74 | + |
| 75 | +Thanks to Andrej Karpathy for his excellent [char-rnn](https://github.com/karpathy/char-rnn) repo, and to Sherjil Ozair for his [tensorflow port](https://github.com/sherjilozair/char-rnn-tensorflow) of char-rnn, which this repo is based on. |
0 commit comments