Pretty good PySpark GroupBy examples
0 notes
Interesting challenge of using an array of strings to filter a Spark Stream
0 notes
Spark WAL
Spark Streaming includes the option of using Write Ahead Logs or WAL to protect against failures.聽 A Write Ahead Logs (WAL) is like a journal log. A WAL structure enforces fault-tolerance by saving all data received by the receivers to logs file located in checkpoint directory.聽
WAL is enabled through spark.streaming.receiver.writeAheadLog.enable property.
0 notes
Tutorial post with history and options when building spark streaming with Kafka.聽 Includes sample code and screencasts
0 notes
Not a Spark related聽article聽but I had to post this article on monads in Scala
2 notes
路
View notes
An overview of Spark Streaming
4 notes
路
View notes
A coupon link for significant discount to Apache Spark course on Udemy
1 note
路
View note