Apache Big Data Seville 2016 – Performance Tuning Tips for Apache Spark Machine Learning Workloads – Shreeharsha GN & Amir Sanjar

Performance Tuning Tips for Apache Spark Machine Learning Workloads – Shreeharsha GN & Amir Sanjar

Performance Tuning tips for Apache Spark Machine Learning workloads – OpenPOWER 8 architecture is the latest offering of IBM SoftLayer, is the perfect platform for evaluating and optimizing Apache Spark solutions. In under 60 minutes from receiving a Sotlayer welcome package to your new bare-metal Power8 server, you can have Hadoop and Spark, along with many other software applications, installed, configured, optimized, and ready to run Spark ML workload. In this talk we will cover: 1) Apache Spark overview 2) Apache Spark software deployment 3) Spark optimization on highly threaded server 4) Demo