
As an Amazon Associate and affiliate partner, Menrva Books earns from qualifying purchases. Learn more
The hottest buzzwords in the Big Data analytics industry are Python and Apache Spark. PySpark supports the collaboration of Python and Apache Spark. In this course, you’ll start right from the basics and proceed to the advanced levels of data analysis. From cleaning data to building features and implementing machine learning (ML) models, you’ll learn how to execute end-to-end workflows using PySpark. Right through the course, you’ll be using PySpark to perform data analysis. You’ll explore Spark RDDs, Dataframes, and a bit of Spark SQL queries. Also, you’ll explore the transformations and actions that can be performed on the data using Spark RDDs and Dataframes. You’ll also explore the ecosystem of Spark and Hadoop and their underlying architecture. You’ll use the Databricks environment to run the Spark scripts and explore it as well. Finally, you’ll have a taste of Spark with AWS cloud. You’ll see how we can leverage AWS storages, databases, computations, and how Spark can communicate with different AWS services and get its required data. By the end of this course, you’ll be able to understand and implement the concepts of PySpark and AWS to solve real-world problems. The code bundles are available here: https://github.com/PacktPublishing/PySpark-and-AWS-Master-Big-Data-with-PySpark-and-AWS
This book investigates how to leverage PySpark and AWS to master big data analytics. The author, AI Sciences, guides readers from foundational concepts to advanced data analysis techniques, covering data cleaning, feature engineering, and machine learning model implementation. The text explores Spark RDDs, DataFrames, Spark SQL queries, and the transformations and actions applicable to data. It also delves into the architecture of Spark and Hadoop ecosystems, utilizing the Databricks environment for script execution and exploring the integration of Spark with AWS services for data retrieval.
The book is structured as a practical guide for individuals looking to master big data analytics using PySpark and AWS. Its approach moves from basic principles to advanced applications, suggesting a comprehensive learning experience for users. The inclusion of hands-on elements like code bundles and the use of environments like Databricks indicates a focus on practical skill development. The content appears designed to equip readers with the ability to apply PySpark and AWS concepts to solve real-world big data challenges.
Page Count:
336
Publication Date:
2021-09-23
Publisher:
Packt Publishing
ISBN-10:
1803236698
ISBN-13:
9781803236698
No comments yet. Be the first to share your thoughts!