Tuning Spark Streaming

Jeroen van Wilgenburg has an excellent blog post on Understanding Spark parameters – A step by step guide to tune your Spark job which provides best practices around dealing with an optimal Spark Streaming setup (receiver, batch size).…

Read more
Proudly published with Ghost