Pig latin
Posted
tags:
篇首语:本文由小常识网(cha138.com)小编为大家整理,主要介绍了Pig latin相关的知识,希望对你有一定的参考价值。
?????????mapred ???????????? ??????????????? .exe ror ?????? exp org Plan
pig????????????????????????local?????????mapreduce??????
local????????????pig??????????????????????????????mapreduce????????????pig??????????????????hadoop?????????hdfs???????????????????????????pig??????????????????????????????????????????????????????pig?????????????????????mapreduce??????????????????????????????????????????pig latin????????????????????????????????????????????????pig???????????????????????????????????????
pig???local????????????mapreduce????????????????????????????????????Grunt shell???????????????????????????????????????????????????
mapreduce????????????
1 .grunt shell ??????
[[email protected] pig-0.17.0]# pig -x mapreduce
18/06/15 09:40:34 INFO pig.ExecTypeProvider: Trying ExecType : LOCAL
18/06/15 09:40:34 INFO pig.ExecTypeProvider: Trying ExecType : MAPREDUCE
18/06/15 09:40:34 INFO pig.ExecTypeProvider: Picked MAPREDUCE as the ExecType
2018-06-15 09:40:34,951 [main] INFO org.apache.pig.Main - Apache Pig version 0.17.0 (r1797386) compiled Jun 02 2017, 15:41:58
2018-06-15 09:40:34,951 [main] INFO org.apache.pig.Main - Logging error messages to: /root/pig/pig-0.17.0/pig_1529026834950.log
2018-06-15 09:40:34,971 [main] INFO org.apache.pig.impl.util.Utils - Default bootup file /root/.pigbootup not found
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/root/hadoop/hadoop-2.7.4/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/root/hbase-1.4.4/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/root/hive/apache-hive-2.1.1/lib/log4j-slf4j-impl-2.4.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
2018-06-15 09:40:35,586 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2018-06-15 09:40:35,586 [main] INFO org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to hadoop file system at: hdfs://localhost:9000
2018-06-15 09:40:36,347 [main] INFO org.apache.pig.PigServer - Pig Script ID for the session: PIG-default-cb6cead5-f22f-4960-bce7-5f44cdb722ec
2018-06-15 09:40:36,347 [main] WARN org.apache.pig.PigServer - ATS is disabled since yarn.timeline-service.enabled set to false
grunt>
2 .??????????????????
pig -x mapreduce script.pig
pig latin??????
????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????hadoop????????????????????????????????????????????????????????????????????????????????????????????????????????????????????? ??????WEB????????????
pigLatin??????????????????????????????????????????????????????????????????????????????load ,store????????????????????????load???store?????????????????????????????????????????????????????????
pig latin??????????????????????????????????????????????????????????????????????????????
??????????????????????????????????????????
1.??????load?????????????????????????????????
2.???????????????????????????????????????????????????
3??????store???????????????????????????????????????????????????????????????dump??????????????????????????????????????????
以上是关于Pig latin的主要内容,如果未能解决你的问题,请参考以下文章