Earth Similarity Index computation on Spark. Trying to find the most similar-to-earth exoplanets from a NASA dataset.

Spark Multi char delimiter using RDD approach

This project contains snippets of Scala code for illustrating various Apache Spark concepts. I write all these code when i'm learning spark.

sparkSql spark kafka hbase

Streaming Twitter data in near real-time using Apache Spark Streaming API

Problem statement, get the revenue and number of orders from order_items on daily basis.

1. 从hive中读取数据到spark中，对数据进行离线统计，将统计 结果写入到mysql中进行保存。2. 模拟实时生产数据，写入文件，使用flume实时监控文件将数据传输到kafka中保存，再对接kafka-streaming进行实时的数据统计

Stranger Things lights driven by SparkCore

Particle IDE Library for a keypad connected over I2C

Smart(kinda) Bathroom

Spark 2.x 案例操作：Scala版本与 Java1.8lambda版代码示例。涵盖Spark核心技术操作SparkCore、SparkSql、SparkStreaming。同时提供了Spark高级性能优化、序列化、广播变量、数据倾斜、算子优化、JVM优化、troubleshooting、数据倾斜解决方案。是多年来根据工作积累整理出来！

Spark源码分析,主要包含SparkContext源码、Executor进程启动、Stage划分、Task执行和Spark2.0的新特性

Scala examples for learning to use Spark

Learning Apache spark,including code and data .Most part can run local.

酷玩 Spark: Spark 源代码解析、Spark 类库等