Tuning Spark Streaming

Jeroen van Wilgenburg has an excellent blog post on Understanding Spark parameters – A step by step guide to tune your Spark job which provides best practices around dealing with an optimal Spark Streaming setup (receiver, batch size).

comments powered by Disqus
Proudly published with Ghost

Latest posts