hadoop2.2.0集群环境如何部署

这篇文章主要介绍了hadoop2.2.0集群环境如何部署，具有一定借鉴价值，感兴趣的朋友可以参考下，希望大家阅读完这篇文章之后大有收获，下面让小编带着大家一起了解一下。

1.windows下安装vmware workstation 92.vm虚拟网络编辑器选择添加网络 VMnet0 NAT，子网IP 192.168.2.03.install debian6，最简化安装，不从镜像下载安装4.安装完成，以root身份登录debian系统5.apt-cache search openssh6.apt-get install openssh-server7.切换putty以root身份进入debian8.apt-get install gcc9.apt-get install g++10.apt-get install sudo11.groupadd hadoop12.useradd -g hadoop hadoop13.passwd hadoop14.vi /etc/sudoers 添加 hadoop ALL=(ALL:ALL) ALL15.mkdir /home/hadoop16.chown hadoop:hadoop /home/hadoop15.su - hadoop16.ssh-keygen -t rsa -P ""17.cat /home/hadoop/.ssh/id_rsa.pub >> /home/hadoop/.ssh/authorized_keys18.chown hadoop:hadoop /home/hadoop/.ssh/authorized_keys19.chmod 600 /home/hadoop/.ssh/authorized_keys20.ssh localhost21.上传jdk-7u45-linux-i586.tar.gz到root目录22.上传hadoop-2.2.0.tar.gz到root目录23.tar -zxvf /root/jdk-7u45-linux-i586.tar.gz -C /usr/java/24.tar -zxvf /root/hadoop-2.2.0.tar.gz -C /opt/25.mv /opt/hadoop-2.2.0/ /opt/hadoop26.vi .bashrc 去掉export LS_OPTIONS...-1A' 前面的# 然后重新 su - root使设置生效27.vi /etc/profile 添加 export JAVA_HOME=/usr/java/jdk1.7.0_45 export JRE_HOME=${JAVA_HOME}/jre export HADOOP_HOME=/opt/hadoop export CLASSPATH=.:${JAVA_HOME}/lib:${JRE_HOME}/lib export PATH=${JAVA_HOME}/bin:$HADOOP_HOME/bin:$PATH export HADOOP_COMMON_HOME=$HADOOP_HOME export HADOOP_HDFS_HOME=$HADOOP_HOME export HADOOP_CONF_DIR=$HADOOP_HOME/conf export YARN_CONF_DIR=$HADOOP_HOME/conf 然后重新 su - root使设置生效 $java查看是否生效28.chown hadoop:hadoop /opt/hadoop29.mkdir /opt/hadoop/conf30.cp /opt/hadoop/etc/hadoop/* /opt/hadoop/conf31.vi /opt/hadoop/conf/mapred-env.sh 增加export JAVA_HOME=/usr/java/jdk1.7.0_4532.vi /opt/hadoop/conf/yarn-env.sh 增加export JAVA_HOME=/usr/java/jdk1.7.0_4533.vi /opt/hadoop/conf/hadoop-env.sh 增加export JAVA_HOME=/usr/java/jdk1.7.0_4534.vi /opt/hadoop/conf/slave 增加slave1 slave2 slave3 注意要换行35.修改conf下的配置文件core-site、hdfs-site、mapred-site、yarn-env四个xml文件36.vi /etc/hosts 增加 192.168.2.128     master 192.168.2.129     slave1 192.168.2.130     slave2 192.168.2.131     slave337./opt/hadoop/bin/hdfs namenode -format38.到vmware中将master克隆成多个slave，这个例子里面是三个39.启动master/slave1-3四个虚拟机40./opt/hadoop/sbin/start-dfs.sh (hadoop用户操作)41./opt/hadoop/sbin/start-yarn.sh (hadoop用户操作)42.http://192.168.2.128:50070 查看Live Nodes如果是3 启动成功

感谢你能够认真阅读完这篇文章，希望小编分享的"hadoop2.2.0集群环境如何部署"这篇文章对大家有帮助，同时也希望大家多多支持，关注行业资讯频道，更多相关知识等着你来学习!