怎么修改ambari中的hadoop配置文件

Posted

tags:

篇首语:本文由小常识网(cha138.com)小编为大家整理,主要介绍了怎么修改ambari中的hadoop配置文件相关的知识,希望对你有一定的参考价值。

参考技术A 1,通过ambari将集群中的所用组件都关闭,如果关闭不了,直接kill -9 XXX
2,关闭ambari-server,ambari-agent
ambari-server stop
ambari-agent stop本回答被提问者采纳
参考技术B advantage of meeting Dr. Mortimer and

Ambari2.7.3和HDP3.1.4在线安装

安装jdk
http://www.cnblogs.com/libin2015/p/8086047.html
 
linux设置
配置hosts
vim /etc/hosts
192.168.1.9 Hadoop01
ssh免密
ssh-keygen -t rsa
ssh-copy-id -i ~/.ssh/id_rsa.pub root@Hadoop01
修改文件描述符限制
vim /etc/security/limits.conf
* soft nofile 65536
* hard nofile 65536
* soft nproc 131072
* hard nproc 131072
关闭SELinux
vi /etc/selinux/config
将SELINUX=enforcing改为SELINUX=disabled 
关闭防火墙
systemctl stop firewalld.service
systemctl disable firewalld.service
修改主机为英文
vi /etc/locale.conf
LANG="en_US.UTF-8"

 

安装mysql
https://www.cnblogs.com/libin2015/p/12685156.html
 
初始化mysql
CREATE DATABASE ambari;  
use ambari;  
CREATE USER ambari@% IDENTIFIED BY ambari123;  
GRANT ALL PRIVILEGES ON *.* TO ambari@%;  
CREATE USER ambari@localhost IDENTIFIED BY ambari123;  
GRANT ALL PRIVILEGES ON *.* TO ambari@localhost;  
CREATE USER ambari@hadoop01 IDENTIFIED BY ambari123;  
GRANT ALL PRIVILEGES ON *.* TO ambari@hadoop01;  
FLUSH PRIVILEGES;  
source /var/lib/ambari-server/resources/Ambari-DDL-MySQL-CREATE.sql 
CREATE DATABASE hive;
use hive;
CREATE USER hive@% IDENTIFIED BY ambari123;
GRANT ALL PRIVILEGES ON *.* TO hive@%;
CREATE USER hive@localhost IDENTIFIED BY ambari123;
GRANT ALL PRIVILEGES ON *.* TO hive@localhost;
CREATE USER hive@hadoop01 IDENTIFIED BY ambari123;
GRANT ALL PRIVILEGES ON *.* TO hive@hadoop01;
FLUSH PRIVILEGES; 

CREATE DATABASE oozie;
use oozie;  CREATE USER oozie@% IDENTIFIED BY ambari123;
GRANT ALL PRIVILEGES ON *.* TO oozie@%;  
CREATE USER oozie@localhost IDENTIFIED BY ambari123;  
GRANT ALL PRIVILEGES ON *.* TO oozie@localhost;  
CREATE USER oozie@hadoop01 IDENTIFIED BY ambari123;  
GRANT ALL PRIVILEGES ON *.* TO oozie@hadoop01;  
FLUSH PRIVILEGES;

 

这里我们需要在数据库中分别创建ambari数据库和ambari用户,注意这里有一个坑:数据库密码只能输入字符数字和 _下划线,还有-减号。不能包含特殊字符,否则会报以下错误信息:
Enter Database Password (bigdata):
Invalid characters in password. Use only alphanumeric or _ or - characters12
而MySQL 5.7默认安全策略是中级的,需要有特殊字符,这个可以通过以下命令进行修改,使用root用户登录mysql数据库服务器:
set global validate_password_policy=0;
flush privileges;

 

在线安装ambari
wget -nv http://public-repo-1.hortonworks.com/ambari/centos7/2.x/updates/2.7.3.0/ambari.repo -O /etc/yum.repos.d/ambari.repo
yum repolist
yum install ambari-server -y

初始化设置setup

ambari-server setup
根据提示配置$JAVA_HOME,mysql数据库等信息
ambari-server setup --jdbc-db=mysql --jdbc-driver=/export/service/hdp/mysql-connector-java-5.1.47-bin.jar

mysql-connector-java-5.1.47-bin.jar下载地址:
https://downloads.mysql.com/archives/c-j/

启动

ambari-server start

访问Ambari web页面

默认端口8080,Username:admin Password:admin
http://192.168.1.9:8080

安装hdp3.1.4

根据提示操作即可,安装过程非常慢。。。
 
参考:
https://blog.csdn.net/z3225167/article/details/92803720
https://www.jianshu.com/p/c319bce45601
https://blog.csdn.net/qq_36160730/article/details/97007542
 

以上是关于怎么修改ambari中的hadoop配置文件的主要内容,如果未能解决你的问题,请参考以下文章

ambari rest api (修改集群配置文件)

ambari 搭建hadoop大数据平台系列2-客户机配置

Ambari2.7.3和HDP3.1.4在线安装

hadoop ambari和cloudera manager哪个好

ambari 2.7 下安装httpfs

Ambari