CDH hadoop 部署

1. 所有免密钥登陆（all节点）（centos6 操作系统）

node01 2C  6Gnode02 2C  2Gnode03 2C  2G2.node01 安装数据库 mysql5.5（node01节点）https://blog.csdn.net/u012402177/article/details/82870433root/1234563.下载基础的软件（all 节点）yum  -y  install  chkconfig python bind-utils psmisc libxslt  zlib sqlite cyrus-sasl-plain  cyrus-sasl-gssapi fuse  fuse-libs  redhat-lsb/etc/init.d/ntpd  start  解决agent启动会有问题：/opt/cloudera-manager/cm-5.4.3/lib64/cmf/agent/build/env/bin/python: error while loading shared libraries: libpython2.6.so.1.0: cannot open shared object file: No such file or directorywget  http://www.python.org/ftp/python/2.6.6/Python-2.6.6.tgztar -xzvf Python-2.6.6.tgzcd  Python-2.6.6./configure --prefix=/foo/python26 --enable-sharedmakemake altinstallsudo ln -s /foo/python26/lib/libpython2.6.so.1.0  /usr/lib/libpython2.6.so.1.04.clouderamanager安装(server 和 agent节点都需要  all) mkdir /opt/cloudera-manager tar xvzf cloudera-manager*.tar.gz  -C /opt/cloudera-manager5.添加用户所有节点useradd --system --no-create-home --shell=/bin/false --comment "Cloudera SCM User" cloudera-scm6.修该所有agent节点的server的地址/opt/cloudera-manager/cm-5.4.3/etc/cloudera-scm-agent/config.ini中server_host7.创建目录Server节点mkdir -p /opt/cloudera/parcel-repochown cloudera-scm:cloudera-scm /opt/cloudera/parcel-repoAgent节点mkdir -p /opt/cloudera/parcelschown cloudera-scm:cloudera-scm /opt/cloudera/parcels8.server节点制作源(文件放在如下路径)cd  /opt/cloudera/parcel-repo[root@node01 parcel-repo]# 11-rw-r--r-- 1 root root 1272629458 Oct 30 13:33 CDH-5.4.0-1.cdh6.4.0.p0.27-el6.parcel-rw-r--r-- 1 root root         41 Oct 30 13:33 CDH-5.4.0-1.cdh6.4.0.p0.27-el6.parcel.sha-rw-r--r-- 1 root root      42625 Oct 30 13:32 manifest.json9.配置CM数据库  以及数据库连接驱动mkdir -p   /usr/share/java/cd /usr/share/java/cp -a  /root/install/mysql-connector-java-5.1.26-bin.jar   ./mv  mysql-connector-java-5.1.26-bin.jar  mysql-connector-java.jar创建库（server端执行）删除mysql.user 里面所有多余的用户 只剩一个管理员grant all on *.* to 'temp'@'%' identified by 'temp' with grant option;flush  privileges；cd /opt/cloudera-manager/cm-5.4.3/share/cmf/schema/./scm_prepare_database.sh mysql temp -h node01 -utemp -ptemp --scm-host node01 scm scm scm10.启动服务server端 node01cd /opt/cloudera-manager/cm-5.4.3/etc/init.d/./cloudera-scm-server startagent  node01  node02  node03 /opt/cloudera-manager/cm-5.4.3/etc/init.d/cloudera-scm-agent  restart

2.

3.

4.

5.

6.

7.

8.

9.

10.

11.

12.

13.

14.

15.

16.

17.

18.

19.

20.

21.

22.

23.

24.