Notes about Spark Streaming in Apache Spark

Repository of notebooks and related collateral used in the Databricks Demo Hub, showing how to use Databricks, Delta Lake, MLflow, and more.

This project walks through how you can create recommendations using Apache Spark machine learning. There are a number of jupyter notebooks that you can run on IBM Data Science Experience, and there a live demo of a movie recommendation web application you can interact with. The demo also uses IBM Message Hub (kafka) to push application events to…

This repo contains my learnings and practice notebooks on Spark using PySpark (Python Language API on Spark). All the notebooks in the repo can be used as template code for most of the ML algorithms and can be built upon it for more complex problems.

A repository for ipython notebook backup

Big Data Management related Zeppelin notebooks

Spark Course notebooks.

Jupyter notebooks for filtering Kafka data with Spark Streaming.

This repository contains the steps to install Apache Spark, and run an application that consumes the twitter's real-time stream, performs transformations on the data and displays them on a real-time dashboard in Jupyter Notebook.