Operating Hadoop and YARN clusters

This is the final stage of Hadoop and YARN cluster setup and configuration. Here are the commands that need to be used to start and stop the Hadoop and YARN clusters.

Starting Hadoop and YARN clusters

To start Hadoop and the YARN cluster, use with the following procedure:

  1. Format a Hadoop distributed filesystem:
    $HADOOP_HOME/bin/hdfs namenode -format <cluster_name>
  2. The following command is used to start HDFS. Run it on the NameNode:
    $HADOOP_HOME/sbin/hadoop-daemon.sh --config $HADOOP_CONF_DIR --script hdfs start namenode
  3. Run this command to start DataNodes on all slaves nodes:
    $HADOOP_HOME/sbin/hadoop-daemon.sh --config $HADOOP_CONF_DIR --script hdfs start datanode
  4. Start YARN with the following command on the ResourceManager: ...

Get YARN Essentials now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.

Start your free trial