12-ResourceMangerHA-环境搭建

Posted 2020-09-07 bronk

 

hadoop2.x以后, 计算框架放在在yarn上

 

1, yarn.site

 <property>
   <name>yarn.resourcemanager.ha.enabled</name>
   <value>true</value>
 </property>
 <property>
   <name>yarn.resourcemanager.cluster-id</name>
   <value>yarncluster</value>
 </property>
 <property>
   <name>yarn.resourcemanager.ha.rm-ids</name>
   <value>rm1,rm2</value>
 </property>
 <property>
   <name>yarn.resourcemanager.hostname.rm1</name>
   <value>192.168.208.106</value>
 </property>
 <property>
   <name>yarn.resourcemanager.hostname.rm2</name>
   <value>192.168.208.107</value>
 </property>
 <property>
   <name>yarn.resourcemanager.zk-address</name>
   <value>192.168.208.106:2181,192.168.208.107:2181,192.168.208.108:2181</value>
 </property>

2, mapred-stie.xml, 把mapreduce的环境放在yarn中

    <property>
        <name>mapreduce.framework.name</name>
        <value>yarn</value>
    </property>

3, yarn-site.xml, 制定mapreduce运行在哪个框架上

    <property>
        <name>yarn.nodemanager.aux-services</name>
        <value>mapreduce_shuffle</value>
    </property>

NodeManager 和 Datanode在一块, 不需要配置, 自动分辨并启动

4, 启动, 在NN上启动

start-yarn.sh

5, 手动启动备用ResourceManger

yarn-daemon.sh start resourcemanager

6, 访问

wenbronk.hdfs.com:8088/cluster

打开standby, 会立马重定向到active

全部启动执行

start-all.sh