📄️ Why spark ?
- In-memory
📄️ concepts
- Solve the problem of iterative algorithm
📄️ Memory
Executor memory
📄️ presentation-notes
Why Spark ?
📄️ Shuffle and Join
Shuffle
📄️ structured-streaming
Input:* Kafka, HDFS, S3, Socket,
📄️ Tuning
In Driver
Version: Next
Apache Spark
Spark basics, memory, shuffles, structured streaming, and tuning.