hadoop jar 与yarn jar具体的区别在哪

Posted

tags:

篇首语:本文由小常识网(cha138.com)小编为大家整理,主要介绍了hadoop jar 与yarn jar具体的区别在哪相关的知识,希望对你有一定的参考价值。

lz说的是命令的执行吧。
hadoop jar 按mr1或yarn运行job,决定是否配置yarn。
yarn jar 按yarn方式运行job,必须启动dfs
---
如果配置了yarn,则两种方式运行效果是一样的,即yarn执行,必须先启动dfs,无需启动yarn,因为会自启动后退出
dfs:start-dfs.sh
yarn:start-yarn.sh
参考技术A The /usr/bin/yarn script sets up the execution environment so that all of the yarn commands can be run. The /usr/bin/hadoop script isn't quite as concerned about yarn specific functionality. However, if you have your cluster set up to use yarn as the default implementation of mapreduce (MRv2), then hadoop jar will probably act the same as yarn jar for a mapreduce job.
Either way you're probably fine, but you can always check the resource manager (or job tracker) web interface to see how your job is distributed across the cluster (whether it's a single node cluster or not)
如果你设置yarn为mapreduce的默认资源调度平台,那么两个命令是一样的
参考技术B int year,month,day; while(1) printf("\n请选择你所需要的服务:\n"); printf("\n输入1求某个日期对应的星期"); printf("\n输入2结束程序\n"); scanf("%d",&option); switch(option)

以上是关于hadoop jar 与yarn jar具体的区别在哪的主要内容,如果未能解决你的问题,请参考以下文章

YARN环境中应用程序JAR包冲突问题的分析及解决

YARN环境中应用程序JAR包冲突问题的分析及解决

本地模式下的猪与没有 hadoop.jar 的猪之间的区别

yarn安装MapReduce框架JAR上传的时候报错处理

提交hadoop-streaming作业:yarn还是hadoop?

hadoop提交jar包卡住不会往下