Oozie与Coordinator调度讲解及系统时区配置与定时触发两种配置方式

Posted 再也伤不起

tags:

篇首语:本文由小常识网(cha138.com)小编为大家整理,主要介绍了Oozie与Coordinator调度讲解及系统时区配置与定时触发两种配置方式相关的知识,希望对你有一定的参考价值。

1:修改本地linux时区

  查看时区

   - 号代表西  + 号 代表东 北京时间是东八区

    设置时区的配置文件所在位置

1 cd /usr/share/zoneinfo/

    选择以亚洲的上海 的时区为基址

    删除本地配置文件

1 rm -r /etc/localtime 

    创建一个硬连接

1  ln -sf /usr/share/zoneinfo/Asia/Shanghai /etc/localtime

   时区变成东八区了

   设置时间

2:设置oozie的时区   在oozie-site.xml修改  oozie默认使用UTC 等同于GMT 服务器上是CST  要设置成GMT+0800

  

1  <!-- Time Zone -->
2  <property>
3      <name>oozie.processing.timezone</name>
4      <value>GMT+0800</value>
5   </property>

  

1  <property>
2      <name>oozie.service.coord.check.maximum.frequency</name>
3      <value>false</value>
4   </property>

 

 

 

 

 

上面设置只是设置oozie调度的时间   oozie的web控制台时间也需要改

修改 oozie-console.js

在179行  getTimeZone

 

 启动之前要先清除缓存

3:拷贝模板

4:修改job.properties

 1 #
 2 # Licensed to the Apache Software Foundation (ASF) under one
 3 # or more contributor license agreements.  See the NOTICE file
 4 # distributed with this work for additional information
 5 # regarding copyright ownership.  The ASF licenses this file
 6 # to you under the Apache License, Version 2.0 (the
 7 # "License"); you may not use this file except in compliance
 8 # with the License.  You may obtain a copy of the License at
 9 #
10 #      http://www.apache.org/licenses/LICENSE-2.0
11 #
12 # Unless required by applicable law or agreed to in writing, software
13 # distributed under the License is distributed on an "AS IS" BASIS,
14 # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
15 # See the License for the specific language governing permissions and
16 # limitations under the License.
17 #
18 
19 nameNode=hdfs://hadoop:8020
20 jobTracker=hadoop:8032
21 queueName=default
22 oozieAppsRoot=user/root/oozie-apps
23 oozieDataRoot=user/root/oozie/datas
24 
25 oozie.coord.application.path=${nameNode}/${oozieAppsRoot}/cron-schedule
26 start=2015-10-11T20:25+0800
27 end=2015-10-11T20:30+0800
28 workflowAppUri=${nameNode}/${oozieAppsRoot}/cron-schedule

 5:修改coordinator.xml

 1 <!--
 2   Licensed to the Apache Software Foundation (ASF) under one
 3   or more contributor license agreements.  See the NOTICE file
 4   distributed with this work for additional information
 5   regarding copyright ownership.  The ASF licenses this file
 6   to you under the Apache License, Version 2.0 (the
 7   "License"); you may not use this file except in compliance
 8   with the License.  You may obtain a copy of the License at
 9 
10        http://www.apache.org/licenses/LICENSE-2.0
11 
12   Unless required by applicable law or agreed to in writing, software
13   distributed under the License is distributed on an "AS IS" BASIS,
14   WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
15   See the License for the specific language governing permissions and
16   limitations under the License.
17 -->
18 <coordinator-app name="cron-coord" frequency="${coord:minutes(1)}" 
19                 start="${start}" end="${end}" timezone="GMT+0800"
20                 xmlns="uri:oozie:coordinator:0.4">
21         <action>
22         <workflow>
23             <app-path>${workflowAppUri}</app-path>
24             <configuration>
25                 <property>
26                     <name>jobTracker</name>
27                     <value>${jobTracker}</value>
28                 </property>
29                 <property>
30                     <name>nameNode</name>
31                     <value>${nameNode}</value>
32                 </property>
33                 <property>
34                     <name>queueName</name>
35                     <value>${queueName}</value>
36                 </property>
37             </configuration>
38         </workflow>
39     </action>
40 </coordinator-app>

 6.把文件上传至hdfs

1 bin/hdfs dfs -put /opt/cdh-5.3.6/oozie-4.0.0-cdh5.3.6/oozie-apps/cron-schedule oozie-apps/

 

 7:启动运行

以上是关于Oozie与Coordinator调度讲解及系统时区配置与定时触发两种配置方式的主要内容,如果未能解决你的问题,请参考以下文章

问题记录CDH版Hue提交Oozie Coordinator调度报500异常

问题记录CDH版Hue提交Oozie Coordinator调度报500异常

Oozie-coordinator调度

工作流引擎Oozie:coordinator

大数据常用调度平台

作业流调度框架 oozie 使用