Run

Of course once you set everything up, you'll want to actually run the training. That's what the Run section is for and it is shown below highlighted:

There are three buttons here that you can click on:

• Run: This starts the neural network training. As you run the training stage, the number of iterations that Stochastic Gradient Descent has made will be shown in an Iterations counter to the right of the three buttons. At any time, you can pause the training by clicking on the Run button again, where the button's text changes to Pause. You may also use this opportunity to change the configuration of the neural network and run the training using this new configuration as a starting point so you can interactively see how changing the neural network structure affects the output.

• Step: Choosing Run allows the training to run continuously. You can also choose to step through each iteration by clicking on this button so that one iteration passes per click. Clicking on this while the Run option is enabled will automatically pause the training and allows you to step through each iteration interactively.

• Reset: This resets the neural network so you are starting with a fresh new one that requires to be trained. The number of iterations is reset as well as all of the weights in the neural network itself.