cdh6.2.1搭建安装

Posted 2020-12-16 binjia

 

1、为CM安装mysql驱动

4台服务器

将mysql-connector-java-5.1.27-bin.jar拷贝到/usr/share/java路径下，并重命名

mv mysql-connector-java-5.1.27-bin.jar mysql-connector-java.jar

 

2、CM安装

yct40安装：cloudera-scm-server,cloudera-scm-agent

yct41 安装：cloudera-scm-agent

yct42 安装：cloudera-scm-agent

yct43 安装：cloudera-scm-agent

 

搭建本地yum源

将压缩包cloudera-repos.tar.gz拷贝到yct40中的一台节点，/home/download

解压到/var/www/html路径下

tar -zxvf cloudera-repos.tar.gz -C /var/www/html

cd /var/www/html/

python -m SimpleHTTPServer 8900

浏览器访问http://192.168.10.40:8900

vim /etc/yum.repos.d/cloudera-manager.repo

输入：
[cloudera-manager]

name=cloudera-manager

baseurl=http://yct40:8900/cloudera-repos/cm6/6.2.1/redhat7/yum/

enabled=1

gpgcheck=0

 

分发

xsync /etc/yum.repos.d/cloudera-manager.repo

 

yct40:

yum -y install cloudera-manager-daemons cloudera-manager-agent cloudera-manager-server

yct41:

yum -y install cloudera-manager-agent cloudera-manager-daemons

yct42:

yum -y install cloudera-manager-agent cloudera-manager-daemons

yct43:
yum -y install cloudera-manager-agent cloudera-manager-daemons

 

 

修改yct40上CM的配置文件（不用xsync同步）

vim /etc/cloudera-scm-agent/config.ini

server_host=yct40

server_port=7182

 

3、在mysql中建库

CREATE DATABASE scm DEFAULT CHARACTER SET utf8 DEFAULT COLLATE utf8_general_ci;

CREATE DATABASE amon DEFAULT CHARACTER SET utf8 DEFAULT COLLATE utf8_general_ci;

CREATE DATABASE hue DEFAULT CHARACTER SET utf8 DEFAULT COLLATE utf8_general_ci;

CREATE DATABASE hive DEFAULT CHARACTER SET utf8 DEFAULT COLLATE utf8_general_ci;

CREATE DATABASE sentry DEFAULT CHARACTER SET utf8 DEFAULT COLLATE utf8_general_ci;

CREATE DATABASE oozie DEFAULT CHARACTER SET utf8 DEFAULT COLLATE utf8_general_ci;

 

为CM配置数据库（cm自带脚本）

/opt/cloudera/cm/schema/scm_prepare_database.sh mysql scm root ycT_big@!123!com

 

4、启动CM服务

yct40:

systemctl start cloudera-scm-server

systemctl start cloudera-scm-agent

yct41:

systemctl start cloudera-scm-agent

yct42:

systemctl start cloudera-scm-agent

yct43:

systemctl start cloudera-scm-agent

 

 

yct40上可通过tail查看日志，出现started jetty server即安装成功

tail -f /var/log/cloudera-scm-server/cloudera-scm-server.log

浏览器访问：http://192.168.10.40:7180

用户名和密码都是admin/admin

 

5、关闭CM服务

关闭工作节点

43：systemctl stop cloudera-scm-agent

42：systemctl stop cloudera-scm-agent

41：systemctl stop cloudera-scm-agent

40：systemctl stop cloudera-scm-agent

40：systemctl stop cloudera-scm-server

关闭服务节点

40：systemctl stop cloudera-scm-server

 

6、登录成功以后

欢迎页面

 

 

 

协议页面，选同意

 

 

 

选择免费

 

 

 

 

到达集群安装页面

 

 

 

给集群命名：yctcluder

 

 

 

选择物理节点：

 

 

 

 

添加本地parcel库

 

 

 

 

 

 

 

 

 

 

 

 

等待parcel的下载、分配、解压和激活

 

 

 

 

检查集群网络环境

 

 

 

 

 

选择要安装的CDH组件，选择自定义安装

 

 

 

 

选择需要安装的组件

 

 

 

 

各组件角色分配

 

 

 

 

 

 

 

 

数据库链接测试

 

 

 

 

各组件基本设置，使用默认

 

 

 

 

等待安装部署和启动