Configuration of HA NameNodes with QJM

Add the following properties to hdfs-site.xml:

Property Value
dfs.nameservices cluster_name
dfs.ha.namenodes.cluster_name NN1, NN2
dfs.namenode.rpc-address.cluster_name.NN1 machine1:8020
dfs.namenode.rpc-address.cluster_name.NN2 machine2:8020
dfs.namenode.http-address.cluster_name.NN1 machine1:50070
dfs.namenode.http-address.cluster_name.NN2 machine2:50070
dfs.namenode.shared.edits.dir qjournal://node1:8485;node2:8485;node3:8485/cluster_name
dfs.client.failover.proxy.provider.cluster_name org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider
dfs.ha.fencing.methods sshfence
dfs.ha.fencing.ssh.private-key-files /home/myuser/.ssh/id_rsa
dfs.ha.fencing.methods ...

Get Modern Big Data Processing with Hadoop now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.