
As an Amazon Associate and affiliate partner, Menrva Books earns from qualifying purchases. Learn more
Data Processing is one of the core functionalities of distributed and cloud computing. There is a high demand on low latency and high performance computing as well as the support of abstract processing methods such as SQL querying, analytic frameworks or graph processing by data processing engines. The Definitive Guide to Apache Flink by Papp starts with the history of Big Data processing with Hadoop and explains the shortcomings of Map Reduce. It shows how YARN and Hadoop 2.x changed the game and how new technologies started to compete to become the successor of Map Reduce. After some detailed information on Tez and Spark and how they try to solve shortcomings of Map Reduce, this book deals with some architectural patterns for creating a solid data processing engine, such as advanced pipelining methods or in-memory caching. It shows how Flink is using these concepts. Flink programming will be introduced in a hands-on approach. It starts with how to create a ten minutes build and how to run the first "Word Count" with Flink. Then it continues with more advanced topics such as programming more complex programs. All samples are programmed with Java or Scala. It shows that Apache Flink has the potential to become one of the key technologies for distributed computing. It aims to replace many small technologies with a more powerful one that covers many aspects of Hadoop programming.
This book investigates the evolution and capabilities of Apache Flink as a next-generation data processing engine. It begins by tracing the history of Big Data processing, highlighting the limitations of Hadoop's Map Reduce and the emergence of competing technologies like Tez and Spark. The text then delves into architectural patterns crucial for robust data processing, such as advanced pipelining and in-memory caching, explaining how Flink implements these concepts. A hands-on approach to Flink programming is presented, starting with a quick setup and a basic 'Word Count' example, progressing to more complex applications using Java or Scala.
The book is presented as a comprehensive guide to Apache Flink, aiming to establish it as a key technology in distributed computing. It appears to offer a practical, hands-on introduction for developers looking to leverage Flink's capabilities for low-latency, high-performance data processing. The text is structured to guide readers from foundational concepts of Big Data and its historical context to advanced programming techniques within the Flink framework. By covering architectural patterns and providing code samples, the book positions Flink as a powerful, unified solution capable of replacing multiple smaller technologies in the Hadoop ecosystem.
Page Count:
400
Publication Date:
2016-06-08
Publisher:
Apress
ISBN-10:
1484214080
ISBN-13:
9781484214084
No comments yet. Be the first to share your thoughts!