HDP-2.6.5 & ambari-2.6.2 安装配置
Posted
tags:
篇首语：本文由小常识网(cha138.com)小编为大家整理，主要介绍了HDP-2.6.5 & ambari-2.6.2 安装配置相关的知识，希望对你有一定的参考价值。
安装文件列表
* ambari.repo
* ambari-2.6.2.2-centos7.tar.gz
* hdp.repo
* HDP-2.6.5.0-centos7-rpm.tar.gz
* HDP-GPL-2.6.5.0-centos7-gpl.tar.gz
* HDP-UTILS-1.1.0.22-centos7.tar.gz
* apache-tomcat-8.5.27.tar.gz
* mysql-connector-java-5.1.46.tar.gz
自行至 https://hortonworks.com 下载部署环境
System： CentOS 7.x
JDK: JDK-1.8.xxx
Tomcat: Tomcat-8.5.27 (或者使用 nginx、Httpd)
MariaDB: MariaDB-5.5.60集群角色
Ambari-Server: 10.0.2.20
Ambari-Agent01: 10.0.2.21
Ambari-Agent02: 10.0.2.22
cat >>/etc/hosts<<EOF
10.0.2.20 Ambari-Server server.ambari.com
10.0.2.21 Ambari-Agent01 agent01.ambari.com
10.0.2.22 Ambari-Agent02 agent02.ambari.com
EOF解决依赖
/usr/bin/yum install zlib zlib-devel libjpeg libjpeg-devel libpng libpng-devel gd gd-devel curl curl-devel freetype freetype-devel libxslt libxslt-devel libxml2 libxml2-devel ncurses ncurses-devel gcc gcc-c++ flex flex-devel libtiff-devel pam-devel libffi-devel e2fsprogs-devel openssl* ntpdate tree autoconf lrzsz uuid dstat bind-utils vim rsync net-tools wget -y
依赖问题根据自己服务器情况自行安装，上述依赖是我的服务器基础优化安装的依赖包配置JAVA环境
tar xf jdk-8u162-linux-x64.tar.gz -C /data/
cd /data;ln -s jdk1.8.0_162 jdk;cd
cat >>/etc/profile<<EOF
export JAVA_HOME=/data/jdk
export JRE_HOME=${JAVA_HOME}/jre
export CLASS_PATH=.:${JAVA_HOME}/lib:${JRE_HOME}/lib
export PATH=${JAVA_HOME}/bin:${JRE_HOME}/bin:${PATH}
EOF
. /etc/profile配置免密登陆
[[email protected] ~]$ ssh-keygen # 一路回车至结束
[[email protected] .ssh]$ ssh-copy-id 10.0.2.20
[[email protected] .ssh]$ for n in 21 22;do scp authorized_keys id_rsa id_rsa.pub 10.0.2.$n:/root/.ssh/;done
# 为去除‘yes‘输入，执行下面的命令
[[email protected] ~]$ for n in Ambari-Server Ambari-Agent01 Ambari-Agent02 server.ambari.com agent01.ambari.com agent02.ambari.com;do ssh $n "uptime";done同步hosts文件
[[email protected] ~]$ for n in 21 22;do scp /etc/hosts 10.0.2.$n:/etc/;done安装MariaDB
[[email protected] ~]$ yum install mariadb-server mariadb -y
添加配置 skip-name-resolve=on 到 /etc/my.cnf
[[email protected] ~]$ systemctl start mariadb.service
[[email protected] ~]$ mysqladmin -uroot password 123456
[[email protected] yum.repos.d]$ mysql -uroot -p123456 -e "create database ambari;"
[[email protected] yum.repos.d]$ mysql -uroot -p123456 -e "grant all privileges on ambari.* to [email protected]‘localhost‘ identified by ‘123456‘;"
[[email protected] yum.repos.d]$ mysql -uroot -p123456 -e "grant all privileges on ambari.* to [email protected]‘10.0.2.20‘ identified by ‘123456‘;"
[[email protected] yum.repos.d]$ mysql -uroot -p123456 -e "flush privileges;"安装Tomcat
[[email protected] ~]$ tar xf apache-tomcat-8.5.27.tar.gz -C /data/
[[email protected] data]$ cd /data/;ln -s apache-tomcat-8.5.27 tomcat;cd
[[email protected] ~]$ tar xf mysql-connector-java-5.1.46.tar.gz
[[email protected] ~]$ mv mysql-connector-java-5.1.46/mysql-connector-java-5.1.46-bin.jar /data/tomcat/lib/
[[email protected] ~]$ mkdir /usr/share/java
[[email protected] ~]$ mv mysql-connector-java-5.1.46/mysql-connector-java-5.1.46.jar /usr/share/java/配置Ambari、HDP本地yum库
[[email protected] hdp]$ rm -fr /data/tomcat/webapps/*
[[email protected] hdp]$ mkdir /data/tomcat/webapps/hdp/HDP-UTILS -p
[[email protected] conf]$ tar xf ambari-2.6.2.2-centos7.tar.gz -C /data/tomcat/webapps/hdp
[[email protected] conf]$ tar xf ambari-2.6.2.2-centos7.tar.gz -C /data/tomcat/webapps/hdp
[[email protected] conf]$ tar xf HDP-GPL-2.6.5.0-centos7-gpl.tar.gz -C /data/tomcat/webapps/hdp
[[email protected] conf]$ tar xf HDP-UTILS-1.1.0.22-centos7.tar.gz -C /data/tomcat/webapps/hdp
[[email protected] conf]$ tar xf HDP-2.6.5.0-centos7-rpm.tar.gz -C /data/tomcat/webapps/hdp
[[email protected] conf]$ sed -i ‘112c<param-value>true</param-value>‘ web.xml
[[email protected] bin]$ /data/tomcat/bin/startup.sh
# 官方repo文件位置
[[email protected] 2.6.2.2-1]$ ll /data/tomcat/webapps/hdp/ambari/centos7/2.6.2.2-1/ambari.repo
-rw-r--r-- 1 root root 304 6月 12 2018 /data/tomcat/webapps/hdp/ambari/centos7/2.6.2.2-1/ambari.repo
[[email protected] 2.6.5.0-292]$ ll /data/tomcat/webapps/hdp/HDP/centos7/2.6.5.0-292/hdp.repo
-rw-r--r-- 1 root root 575 5月 15 2018 /data/tomcat/webapps/hdp/HDP/centos7/2.6.5.0-292/hdp.repo
[[email protected] 2.6.5.0-292]$ ll /data/tomcat/webapps/hdp/HDP-GPL/centos7/2.6.5.0-292/hdp-gpl.gpl.repo
-rw-r--r-- 1 root root 310 5月 15 2018 /data/tomcat/webapps/hdp/HDP-GPL/centos7/2.6.5.0-292/hdp-gpl.gpl.repo
[[email protected] 1.1.0.22]$ ll /data/tomcat/webapps/hdp/HDP-UTILS/HDP-UTILS/centos7/1.1.0.22/hdp-utils.repo
-rw-r--r-- 1 root root 197 5月 29 2018 /data/tomcat/webapps/hdp/HDP-UTILS/HDP-UTILS/centos7/1.1.0.22/hdp-utils.repo
# 参照官方repo文件，创建本地ambari.repo文件
[[email protected] yum.repos.d]$ cat >/etc/yum.repos.d/ambari.repo<<EOF
#VERSION_NUMBER=2.6.2.2-1
[ambari-2.6.2.2]
name=ambari Version - ambari-2.6.2.2
baseurl=http://Ambari-Server:8080/hdp/ambari/centos7/2.6.2.2-1
gpgcheck=0
gpgkey=http://Ambari-Server:8080/hdp/ambari/centos7/2.6.2.2-1/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins
enabled=1
priority=1
#VERSION_NUMBER=2.6.5.0-292
[HDP-2.6.5.0]
name=HDP Version - HDP-2.6.5.0
baseurl=http://Ambari-Server:8080/hdp/HDP/centos7/2.6.5.0-292
gpgcheck=0
gpgkey=http://Ambari-Server:8080/hdp/HDP/centos7/2.6.5.0-292/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins
enabled=1
priority=1
[HDP-UTILS-1.1.0.22]
name=HDP-UTILS Version - HDP-UTILS-1.1.0.22
baseurl=http://Ambari-Server:8080/hdp/HDP-UTILS/HDP-UTILS/centos7/1.1.0.22
gpgcheck=0
gpgkey=http://Ambari-Server:8080/hdp/HDP-UTILS/HDP-UTILS/centos7/1.1.0.22/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins
enabled=1
priority=1
#VERSION_NUMBER=2.6.5.0-292
[HDP-GPL-2.6.5.0]
name=HDP-GPL Version - HDP-GPL-2.6.5.0
baseurl=http://Ambari-Server:8080/hdp/HDP-GPL/centos7/2.6.5.0-292
gpgcheck=0
gpgkey=http://Ambari-Server:8080/hdp/HDP-GPL/centos7/2.6.5.0-292/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins
enabled=1
priority=1
EOF
# 同步ambari.repo至所有点节
[[email protected] yum.repos.d]$ for n in 21 22;do scp /etc/yum.repos.d/ambari.repo 10.0.2.$n:/etc/yum.repos.d/;done
# 更新yum cache
[[email protected] yum.repos.d]$ for n in 20 21 22;do ssh 10.0.2.$n "yum clean all";done
[[email protected] yum.repos.d]$ for n in 20 21 22;do ssh 10.0.2.$n "yum repolist";done安装配置Ambari-Server
[[email protected] ~]$ yum install ambari-server -y
[[email protected] ambari-server]$ echo "client.api.port=9000" >>/etc/ambari-server/conf/ambari.properties
[[email protected] ~]$ echo "server.jdbc.driver.path=/data/tomcat/lib/mysql-connector-java-5.1.46-bin.jar" >>/etc/ambari-server/conf/ambari.properties
# 设置Ambari
[[email protected] ~]$ ambari-server setup
Using python /usr/bin/python
Setup ambari-server
Checking SELinux...
SELinux status is ‘disabled‘
Customize user account for ambari-server daemon [y/n] (n)? y
Enter user account for ambari-server daemon (root):
Adjusting ambari-server permissions and ownership...
Checking firewall status...
Checking JDK...
Do you want to change Oracle JDK [y/n] (n)? y
[1] Oracle JDK 1.8 + Java Cryptography Extension (JCE) Policy Files 8
[2] Oracle JDK 1.7 + Java Cryptography Extension (JCE) Policy Files 7
[3] Custom JDK
==============================================================================
Enter choice (1): 3
WARNING: JDK must be installed on all hosts and JAVA_HOME must be valid on all hosts.
WARNING: JCE Policy files are required for configuring Kerberos security. If you plan to use Kerberos,please make sure JCE Unlimited Strength Jurisdiction Policy Files are valid on all hosts.
Path to JAVA_HOME: /data/jdk
Validating JDK on Ambari Server...done.
Checking GPL software agreement...
Completing setup...
Configuring database...
Enter advanced database configuration [y/n] (n)? y
Configuring database...
==============================================================================
Choose one of the following options:
[1] - PostgreSQL (Embedded)
[2] - Oracle
[3] - MySQL / MariaDB
[4] - PostgreSQL
[5] - Microsoft SQL Server (Tech Preview)
[6] - SQL Anywhere
[7] - BDB
==============================================================================
Enter choice (3): 3
Hostname (localhost):
Port (3306):
Database name (ambari):
Username (ambari):
Enter Database Password (123456):
Configuring ambari database...
Configuring remote database connection properties...
WARNING: Before starting Ambari Server, you must run the following DDL against the database to create the schema: /var/lib/ambari-server/resources/Ambari-DDL-MySQL-CREATE.sql
Proceed with configuring remote database connection properties [y/n] (y)?
Extracting system views...
ambari-admin-2.6.2.2.1.jar
...........
Adjusting ambari-server permissions and ownership...
Ambari Server ‘setup‘ completed successfully.
# 根据设置过程中的提示执行SQL
[[email protected] ~]$ mysql -uroot -p123456 -e "use ambari;source /var/lib/ambari-server/resources/Ambari-DDL-MySQL-CREATE.sql;"
[[email protected] ~]$ mysql -uroot -p123456 -e "show tables from ambari;"
# 启动Ambari-server，因为systemctl没有启动信息输出，不使用systemctl启动
[[email protected] ambari-server]$ /etc/init.d/ambari-server start
Using python /usr/bin/python
Starting ambari-server
Ambari Server running with administrator privileges.
Organizing resource files at /var/lib/ambari-server/resources...
Ambari database consistency check started...
Server PID at: /var/run/ambari-server/ambari-server.pid
Server out at: /var/log/ambari-server/ambari-server.out
Server log at: /var/log/ambari-server/ambari-server.log
Waiting for server start..............................................
Server started listening on 9000
DB configs consistency check: no errors and warnings were found.
Ambari Server ‘start‘ completed successfully.安装配置Ambari-agent
[[email protected] ~]$ for n in 20 21 22;do ssh 10.0.2.$n "yum install ambari-agent -y";done
[[email protected] conf]$ sed -i "s#hostname=localhost#hostname=Ambari-Server#" /etc/ambari-agent/conf/ambari-agent.ini
# 强制指定安全协议
[[email protected] conf]$ sed -i ‘/[security]/aforce_https_protocol=PROTOCOL_TLSv1_2‘ /etc/ambari-agent/conf/ambari-agent.ini
# 同步配置文件至所有节点
[[email protected] conf]$ for n in 21 22;do scp /etc/ambari-agent/conf/ambari-agent.ini 10.0.2.$n:/etc/ambari-agent/conf/;done
# 启动所有节点Agent
[[email protected] conf]$ for n in 20 21 22;do ssh 10.0.2.$n "/etc/init.d/ambari-agent start";done页面配置Ambari****
默认登陆权限：admin admin以下省略......
以上是关于HDP-2.6.5 & ambari-2.6.2 安装配置的主要内容，如果未能解决你的问题，请参考以下文章