Pages

Adding New supervisor(worker node) on existing storm cluster


 Follow the given steps to add supervisor(worker node) 

a) Install Java ( same version as your existing cluster)

Note: To install java on linux/ubuntu folllow the given link
http://www.techie-knowledge.co.in/2013/08/installing-java-on-linuxubuntu.html
b) Install storm(storm-0.8.2 , same version as your existing cluster)

 

 Install the following native library-


a) To install ZeroMQ type the following command
 
  • make sure that libtool, autoconf, automake, g++ is installed on your machine
  •  wget http://download.zeromq.org/zeromq-2.1.7.tar.gz
  • tar -xvzf zeromq-2.1.7.tar.gz
  •  cd zeromq-2.1.7
  • ./configure 
   NOTE: If you see this error mesage on your terminal
   configure: error: cannot link with -luuid, install uuid-dev, then install theuuid-dev
   by using the command
    sudo apt -get install uuid-dev  
  • make
  • sudo make install

b) To install JZMQ,

  • git clone https://github.com/nathanmarz/jzmq.git
  • cd jzmq
  • ./autogen.sh
  • ./configure
  • make
  • sudo make install

c) set the storm.yaml file.

#storm.yaml
 // name of the machine where you install zookeeper in my case this is nimbus

storm.zookeeper.servers:
       - "nimbus"
#     - "server2" // name of the machine which you make your nimbus or master
#          machine in my case this is also "nimbus"

nimbus.host: "nimbus"

supervisor.slots.ports:
# - 6700
#- 6701 java.library.path: "/usr/local/lib:/opt/local/lib:/usr/lib"

 d) Add /etc/hosts file.

1 comment: