Spark in Action

SummarySpark in Action teaches you the theory and skills you need to effectively handle batch and streaming data using Spark. Fully updated for Spark 2.0.Purchase of the print book includes a free eBook in PDF, Kindle, and ePub formats from Manning Publications.About the TechnologyBig data systems distribute datasets across clusters of machines, making it a challenge to efficiently query, stream, and interpret them. Spark can help. It is a processing system designed specifically for distributed data. It provides easy-to-use interfaces, along with the performance you need for production-quality analytics and machine learning. Spark 2 also adds improved programming APIs, better performance, and countless other upgrades.About the BookSpark in Action teaches you the theory and skills you need to effectively handle batch and streaming data using Spark. You'll get comfortable with the Spark CLI as you work through a few introductory examples. Then, you'll start programming Spark using its core APIs. Along the way, you'll work with structured data using Spark SQL, process near-real-time streaming data, apply machine learning algorithms, and munge graph data using Spark GraphX. For a zero-effort startup, you can download the preconfigured virtual machine ready for you to try the book's code. What's InsideUpdated for Spark 2.0Real-life case studiesSpark DevOps with DockerExamples in Scala, and online in Java and PythonAbout the ReaderWritten for experienced programmers with some background in big data or machine learning. About the AuthorsPetar Zečević and Marko Bonaći are seasoned developers heavily involved in the Spark community.Table of ContentsPART 1 - FIRST STEPSIntroduction to Apache Spark Spark fundamentals Writing Spark applicationsThe Spark API in depth PART 2 - MEET THE SPARK FAMILY Sparkling queries with Spark SQL Ingesting data with Spark Streaming Getting smart with MLlib ML: classification and clustering Connecting the dots with GraphX PART 3 - SPARK OPSRunning Spark Running on a Spark standalone cluster Running on YARN and MesosPART 4 - BRINGING IT TOGETHERCase study: real-time dashboard Deep learning on Spark with H2O