Chapter 3. YARN and HDFS

Those people who develop the ability to continuously acquire new and better forms of knowledge that they can apply to their work and to their lives will be the movers and shakers in our society for the indefinite future.

—Brian Tracy

We’ve seen that a Hadoop distribution is made up of multiple frameworks. Hadoop is constantly evolving, and new frameworks are constantly being added to Hadoop distributions. Succeeding with Hadoop requires big data teams to stay up to speed and use the better forms of the evolving frameworks to apply to their Hadoop ecosystems. We introduced the core frameworks of YARN and HDFS in the previous chapter. In this chapter, we look at YARN and HDFS in more detail. Because these are the two core ...

Get Virtualizing Hadoop: How to Install, Deploy, and Optimize Hadoop in a Virtualized Architecture now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.