- This repository is for my clustering exercises and notes.
-
Be able to discuss and discover use cases for clustering across multiple industries.
-
Be able to recognize of common clustering algorithms.
-
General understanding of how the k-means clustering algorithm works.
-
Ability to implement k-means clustering in python.
-
Handle outliers using IQR.
-
More practice scaling data.
-
Strategies for missing values.
-
Plotting clusters.
-
Ability to make use of clusters discovered later down the data science pipeline.
-
Acquire a sample of data from SQL.
-
Identify null values, which nulls are 'deal-breakers', i.e. rows removed, which nulls should be represented by 0, and which
-
should be replaced by a value from other methods, such as mean.
-
Identify outliers and decide what to do with them, if anything (remove, keep as-is, replace).
-
Data Structure: Aggregate as needed so that every row is an observation and each column is a variable (1 variable and not a measure).
"Exploratory Data Analysis refers to the critical process of performing initial investigations on data so as to discover patterns,to spot anomalies,to test hypothesis and to check assumptions with the help of summary statistics and graphical representations." - Prasad Patil, Novice Data Science Storyteller, Mar 23
-
Can we see patterns, find signals in the data?
-
What features are driving the outcome?
-
Are there other features we can construct that have stronger relationships?
-
Use Visualization and statistical testing to help answer these questions.
-
We want to walk away from exploration with with modeling strategies (feature selection, algorithm selection, evaluation methods, for example).
- Unsupervised machine learning algorithm
- Groups a dataset into a user-specified number (k) of clusters
- k must be specified ahead of time
- clusters won't have the same number of points