oozie 常用命令

Posted 2020-09-16 ilinux_one

1.验证wokflow.xml
oozie validate /appcom/apps/hduser0401/mbl_webtrends/workflow.xml　

2.提交作业，作业进入PREP状态 
oozie job -oozie http://localhost:11000/oozie -config job.properties -submit 
job: 14-20090525161321-oozie-joe

3.执行已提交的作业

oozie job -oozie

http://localhost:11000/oozie -start 14-20090525161321-oozie-joe 

 查看oozie服务状态：

oozie  admin -oozie http://localhost:11000/oozie -status

4.直接运行作业 
oozie job -oozie http://localhost:11000/oozie -config job.properties -run 

 #-D job_start=2016-11-10T02:00+0800 -- 起始日期（当天）
#-D job_end=2016-11-11T02:00+0800 -- 结束日期（当天+1）

5.挂起作业，挂起前状态（RUNNING , RUNNIINGWITHERROR or PREP状态） 
workflow job will be in SUSPENDED status. 

 

6.杀死作业 
oozie job -oozie http://localhost:11000/oozie -kill 14-20090525161321-oozie-joe 

 

7.改变作业参数，不能修改killed状态的作业 
oozie job -oozie http://localhost:11000/oozie -change 14-20090525161321-oozie-joe -value endtime=2011-12-01T05:00Z;concurrency=100;2011-10-01T05:00Z 

8.重新运行作业 
oozie job -oozie http://localhost:11000/oozie -config job.properties -rerun 14-20090525161321-oozie-joe 
000000-130817230824019-oozie-ceny-W 
Rerunning a Coordinator Action or Multiple Actions 
$oozie job -rerun <coord_Job_id> [-nocleanup] [-refresh] 
[-action 1, 3-4, 7-40] (-action or -date is required to rerun.) 
[-date 2009-01-01T01:00Z::2009-05-31T23:59Z, 2009-11-10T01:00Z, 2009-12-31T22:00Z] 
Rerunning a Bundle Job 
oozie job -rerun <bundle_Job_id> [-nocleanup] [-refresh] 
[-coordinator c1, c3, c4] (-coordinator or -date is required to rerun.) 
[-date 2009-01-01T01:00Z::2009-05-31T23:59Z, 2009-11-10T01:00Z, 2009-12-31T22:00Z] 
(if neither -coordinator nor -date is given, the exception will be thrown.)

 

9.检查作业状态 
oozie job -oozie http://localhost:11000/oozie -info 14-20090525161321-oozie-joe

oozie job -oozie http://localhost:11000/oozie -info [email protected] -verbose 

 

10.查看日志 
oozie job -oozie http://localhost:11000/oozie -log 14-20090525161321-oozie-joe 
oozie job -log <coord_job_id> [-action 1, 3-4, 7-40] (-action is optional.)

 

11.提交pig作业 
oozie pig -oozie http://localhost:11000/oozie -file pigScriptFile -config job.properties -X -param_file params

 

12.提交MR作业 
oozie mapreduce -oozie http://localhost:11000/oozie -config job.properties

 

 

usage: 
      the env variable ‘OOZIE_URL‘ is used as default value for the ‘-oozie‘ option 
      the env variable ‘OOZIE_TIMEZONE‘ is used as default value for the ‘-timezone‘ option 
      custom headers for Oozie web services can be specified using ‘-Dheader:NAME=VALUE‘      oozie help : display usage 
. 
      oozie version : show client version 
. 
      oozie job <OPTIONS> : job operations 
                -action <arg>         coordinator rerun on action ids (requires -rerun); coordinator log retrieval on action ids (requires -log) 
                -auth <arg>           select authentication type [SIMPLE|KERBEROS] 
                -change <arg>         change a coordinator/bundle job 
                -config <arg>         job configuration file ‘.xml‘ or ‘.properties‘ 
                -D <property=value>   set/override value for given property 
                -date <arg>           coordinator/bundle rerun on action dates (requires -rerun) 
                -definition <arg>     job definition 
                -doas <arg>           doAs user, impersonates as the specified user 
                -dryrun               Dryrun a workflow (since 3.3.2) or coordinator (since 2.0) job without actually executing it 
                -info <arg>           info of a job 
                -kill <arg>           kill a job 
                -len <arg>            number of actions (default TOTAL ACTIONS, requires -info) 
                -localtime            use local time (same as passing your time zone to -timezone). 
                                      Overrides -timezone option 
                -log <arg>            job log 
                -nocleanup            do not clean up output-events of the coordinator rerun actions 
                                      (requires -rerun) 
                -offset <arg>         job info offset of actions (default ‘1‘, requires -info) 
                -oozie <arg>          Oozie URL 
                -refresh              re-materialize the coordinator rerun actions (requires -rerun) 
                -rerun <arg>          rerun a job  (coordinator requires -action or -date; bundle requires -coordinator or -date) 
                -resume <arg>         resume a job 
                -run                  run a job 
                -start <arg>          start a job 
                -submit               submit a job 
                -suspend <arg>        suspend a job 
                -timezone <arg>       use time zone with the specified ID (default GMT). 
                                      See ‘oozie info -timezones‘ for a list 
                -value <arg>          new endtime/concurrency/pausetime value for changing a 
                                      coordinator job; new pausetime value for changing a bundle job 
                -verbose              verbose mode 
. 
      oozie jobs <OPTIONS> : jobs status 
                 -auth <arg>          select authentication type [SIMPLE|KERBEROS] 
                 -doas <arg>          doAs user, impersonates as the specified user.
                 -filter <arg>        user=<U>;name=<N>;group=<G>;status=<S>;... 
                 -jobtype <arg>       job type (‘Supported in Oozie-2.0 or later versions ONLY - coordinator‘ or ‘wf‘ (default)) 
                 -len <arg>           number of jobs (default ‘100‘) 
                 -localtime           use local time (same as passing your time zone to -timezone). Overrides -timezone option 
                 -offset <arg>        jobs offset (default ‘1‘) 
                 -oozie <arg>         Oozie URL 
                 -timezone <arg>      use time zone with the specified ID (default GMT). See ‘oozie info -timezones‘ for a list 
                 -verbose             verbose mode 
. 
      oozie admin <OPTIONS> : admin operations 
                  -auth <arg>         select authentication type [SIMPLE|KERBEROS] 
                  -doas <arg>         doAs user, impersonates as the specified user.
                  -oozie <arg>        Oozie URL 
                  -queuedump          show Oozie server queue elements 
                  -status             show the current system status 
                  -systemmode <arg>   Supported in Oozie-2.0 or later versions ONLY. Change oozie 
                                      system mode [NORMAL|NOWEBSERVICE|SAFEMODE] 
                  -version            show Oozie server build version 
. 
      oozie validate <ARGS> : validate a workflow XML file 
. 
      oozie sla <OPTIONS> : sla operations (Supported in Oozie-2.0 or later) 
                -auth <arg>           select authentication type [SIMPLE|KERBEROS] 
                -len <arg>            number of results (default ‘100‘, max limited by oozie server setting which defaults to ‘1000‘) 
                -offset <arg>         start offset (default ‘0‘) 
                -oozie <arg>          Oozie URL 
                -filter <arg>         jobid=<JobID/ActionID>\;appname=<Application Name> 
. 
      oozie pig <OPTIONS> -X <ARGS> : submit a pig job, everything after ‘-X‘ are pass-through parameters to pig 
                -auth <arg>           select authentication type [SIMPLE|KERBEROS] 
                -doas <arg>           doAs user, impersonates as the specified user.
                -config <arg>         job configuration file ‘.properties‘ 
                -D <property=value>   set/override value for given property 
                -file <arg>           Pig script 
                -oozie <arg>          Oozie URL 
. 
      oozie info <OPTIONS> : get more detailed info about specific topics 
                -timezones   display a list of available time zones