-
Ordinary Linear Regression
- The Loss-Minimization Perspective
- The Likelihood-Maximization Perspective
-
Linear Regression Extensions
- Regularized Regression (Ridge and Lasso)
- Bayesian Regression
- Generalized Linear Models (GLMs)
-
Discriminative Classification
- Logistic Regression
- The Perceptron Algorithm
- Fisher's Linear Discriminant
-
Generative Classification
(Linear and Quadratic Discriminant Analysis, Naive Bayes)
-
Decision Trees
- Regression Trees
- Classification Trees
-
Tree Ensemble Methods
- Bagging
- Random Forests
- Boosting
-
Neural Networks