Hadoop Beginner's Guide

Time for action – changing the base HDFS directory

Let's first set the base directory that specifies the location on the local filesystem under which Hadoop will keep all its data. Carry out the following steps:

1. Create a directory into which Hadoop will store its data:

   $ mkdir /var/lib/hadoop
   

2. Ensure the directory is writeable by any user:

   $ chmod 777 /var/lib/hadoop
   

3. Modify core-site.xml once again to add the following property:

   <property>
   <name>hadoop.tmp.dir</name>
   <value>/var/lib/hadoop</value>
   </property>

What just happened?

As we will be storing data in Hadoop and all the various components are running on our local host, this data will need to be stored on our local filesystem somewhere. Regardless of the mode, Hadoop by default uses the hadoop.tmp.dir ...