Friday, September 29, 2017

Apache Spark Resource Allocation Guide

This site does a great job at explaining how to divide available resources of every node in a cluster to Spark application in order to harness the full capacity of the cluster.

http://site.clairvoyantsoft.com/understanding-resource-allocation-configurations-spark-application/


Another one!

A 2 part guide by Cloudera Engineering team explaning how to tune Spark-application parameters to achieve optimal performance!
http://blog.cloudera.com/blog/2015/03/how-to-tune-your-apache-spark-jobs-part-1/
https://blog.cloudera.com/blog/2015/03/how-to-tune-your-apache-spark-jobs-part-2/

No comments:

Post a Comment