sh coursera.sh

Posted 2021-05-07

tags:

篇首语：本文由小常识网(cha138.com)小编为大家整理，主要介绍了sh coursera.sh相关的知识，希望对你有一定的参考价值。

hadoop jar /usr/lib/hadoop-mapreduce/hadoop-streaming.jar \
   -input /user/cloudera/input \
   -output /user/cloudera/output_new \
   -mapper /home/cloudera/coursera/map-reduce-assigment/wordcount_mapper.py \
   -reducer /home/cloudera/coursera/map-reduce-assigment/wordcount_reducer.py


hadoop jar /usr/lib/hadoop-mapreduce/hadoop-streaming.jar \
   -input /user/cloudera/input \
   -output /user/cloudera/output_new_1 \
   -mapper /home/cloudera/coursera/map-reduce-assigment/wordcount_mapper.py \
   -reducer /home/cloudera/coursera/map-reduce-assigment/wordcount_reducer.py \
   -numReduceTasks 2

hdfs dfs -getmerge /user/cloudera/output_new_0/* wordcount_num0_output.txt

hdfs dfs -getmerge /user/cloudera/output_new_1/* wordcount_num1_output.txt


hadoop jar /usr/lib/hadoop-mapreduce/hadoop-streaming.jar -input /user/cloudera/input -mapper $PWD/join2_mapper.py -reducer $PWD/join2_reducer.py -output /user/cloudera/output_join2_1

以上是关于sh coursera.sh的主要内容，如果未能解决你的问题，请参考以下文章

如何使我的命令行在具有扩展名（.sh）和名称如“weird.sh.sh.sh”的文件上工作

sh sh_template.sh

sh sh.sh

Linux下面如何运行 SH文件

配置告警系统主脚本main.sh mon.sh load.sh 502.sh disk.sh

shell 脚本各种执行方式（source ./*.sh, . ./*.sh, ./*.sh）的区别