Getting Started with Storm

Appendix B. Installing Storm Cluster

If you want to create a Storm cluster, there are two ways to do so:

• Use storm-deploy to create a cluster on Amazon EC2, as you saw in Chapter 6.

• Install Storm manually (more on this in this Appendix).

To install Storm manually, install:

• Zookeeper cluster (see how in the Administration Guide)

• Java 6.0

• Python 2.6.6

• Unzip command

Caution

All of the following steps, the Java, Python and unzip commands will be required in Nimbus and the supervisor process.

When you’ve met the requirements, install the native libraries.

To install ZeroMQ, run:

    wget http://download.zeromq.org/historic/zeromq-2.1.7.tar.gz
    tar -xzf zeromq-2.1.7.tar.gz
    cd zeromq-2.1.7
    ./configure
    make
    sudo make install

To install JZMQ, run:

    git clone https://github.com/nathanmarz/jzmq.git
    cd jzmq
    ./autogen.sh
    ./configure
    make
    sudo make install

Once you have installed the native libraries, download the latest Storm stable version (Storm 0.7.1 at the time of this writing), and unzip it.

Modify the configuration file to add your Storm cluster configuration (you can see all default configurations on defaults.yaml in the Storm repository).

To modify the storm cluster configuration, you’ll need to edit the conf/storm.yaml file located in the Storm folder and set (at least) the following parameters:

storm.zookeeper.servers: - "zookeeper addres 1" - "zookeeper addres 2" - "zookeeper addres N" storm.local.dir: "a local directory" nimbus.host: "Numbus host addres" supervisor.slots.ports: - supervisor slot ...