Skip to content

Commit e914e87

Browse files
Create 02 - architecture.md
1 parent dccfd01 commit e914e87

File tree

1 file changed

+9
-0
lines changed

1 file changed

+9
-0
lines changed

PySpark/02 - architecture.md

Lines changed: 9 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,9 @@
1+
# PySpark Architecture
2+
3+
- Apache Spark works on a master-slave architecture.
4+
- Operations are executed on workers, and the Cluster Manages resources.
5+
6+
![image](https://github.com/ShubhamJagtap2000/Python-Spark/assets/63872951/d5823743-26f4-4706-a092-b37443ab76c1)
7+
8+
- So when a spark application runs, Spark Driver creates a context that is an entry point for the application and all associated operations are executed on the workers nodes.
9+
- Finally, the cluster manager administrates those resources.

0 commit comments

Comments
 (0)