Book description
A comprehensive, hands-on guide to install, administer, and configure settings in YARN
In Detail
YARN is the next generation generic resource platform used to manage resources in a typical cluster and is designed to support multitenancy in its core architecture. As optimal resource utilization is central to the design of YARN, learning how to fully utilize the available fine-grained resources (RAM, CPU cycles, and so on) in the cluster becomes vital.
This book is an easy-to-follow, self-learning guide to help you start working with YARN. Beginning with an overview of YARN and Hadoop, you will dive into the pitfalls of Hadoop 1.x and how YARN takes us to the next level. You will learn the concepts, terminology, architecture, core components, and key interactions, and cover the installation and administration of a YARN cluster as well as learning about YARN application development with new and emerging data processing frameworks.
What You Will Learn
- Understand how existing MapReduce applications can run on top of YARN and how they are backward compatible
- Explore the YARN concepts, terminologies, architecture, key components, and interaction between the components
- Set up a standalone and multi-node clustered YARN environment
- Design, develop, and run different frameworks such as MapReduce, Apache Storm, Apache Tez, and Giraffe on top of YARN
- Get to grips with the built-in support for multitenancy in YARN
- Discover the motivation behind YARN's architecture design, implementations, and why YARN was needed
- Learn how failures at each level are gracefully handled by the new framework to achieve fault tolerance and scalability
Table of contents
-
YARN Essentials
- Table of Contents
- YARN Essentials
- Credits
- About the Authors
- About the Reviewers
- www.PacktPub.com
- Preface
- 1. Need for YARN
- 2. YARN Architecture
- 3. YARN Installation
- 4. YARN and Hadoop Ecosystems
- 5. YARN Administration
- 6. Developing and Running a Simple YARN Application
- 7. YARN Frameworks
- 8. Failures in YARN
- 9. YARN – Alternative Solutions
- 10. YARN – Future and Support
- Index
Product information
- Title: YARN Essentials
- Author(s):
- Release date: February 2015
- Publisher(s): Packt Publishing
- ISBN: 9781784391737
You might also like
book
Learning YARN
Moving beyond MapReduce - learn resource management and big data processing using YARN About This Book …
video
Introduction To Hadoop YARN
In this Introduction to Hadoop YARN training course, expert author David Yahalom will teach you everything …
audiobook
What's New in AI: Open Source Large Language Models with Eric Xing (Audio)
Join host George Anadiotis and guest Eric Xing, for a discussion about the current and expanding …
book
Microservices and Containers, First edition
The Complete Guide to Succeeding with Microservices and Docker in Large Software Projects Together, microservices and …