Follow the given steps to add supervisor(worker node)
a) Install Java ( same version as your existing cluster)
Note: To install java on linux/ubuntu folllow the given link
http://www.techie-knowledge.co.in/2013/08/installing-java-on-linuxubuntu.html
b) Install storm(storm-0.8.2 , same version as your existing cluster)http://www.techie-knowledge.co.in/2013/08/installing-java-on-linuxubuntu.html
Note: To install storm on ubuntu follow the given link
http://www.techie-knowledge.co.in/2013/09/submitting-topology-on-production-mode.html
http://www.techie-knowledge.co.in/2013/09/submitting-topology-on-production-mode.html
Install the following native library-
a) To install ZeroMQ type the following command
- make sure that libtool, autoconf, automake, g++ is installed on your machine
- wget http://download.zeromq.org/zeromq-2.1.7.tar.gz
- tar -xvzf zeromq-2.1.7.tar.gz
- cd zeromq-2.1.7
- ./configure
NOTE: If you see this error mesage on your terminal
configure: error: cannot link with -luuid, install uuid-dev, then install theuuid-dev
by using the command
sudo apt -get install uuid-dev
configure: error: cannot link with -luuid, install uuid-dev, then install theuuid-dev
by using the command
sudo apt -get install uuid-dev
- make
- sudo make install
b) To install JZMQ,
- git clone https://github.com/nathanmarz/jzmq.git
- cd jzmq
- ./autogen.sh
- ./configure
- make
- sudo make install
c) set the storm.yaml file.
#storm.yaml
// name of the machine where you install zookeeper in my case this is nimbus
storm.zookeeper.servers:
- "nimbus"
# - "server2" // name of the machine which you make your nimbus or master
# machine in my case this is also "nimbus"
nimbus.host: "nimbus"
supervisor.slots.ports:
# - 6700
#- 6701 java.library.path: "/usr/local/lib:/opt/local/lib:/usr/lib"
storm.zookeeper.servers:
- "nimbus"
# - "server2" // name of the machine which you make your nimbus or master
# machine in my case this is also "nimbus"
nimbus.host: "nimbus"
supervisor.slots.ports:
# - 6700
#- 6701 java.library.path: "/usr/local/lib:/opt/local/lib:/usr/lib"
d) Add /etc/hosts file.
nice tutorial
ReplyDelete