Pig latin

Posted

tags:

篇首语:本文由小常识网(cha138.com)小编为大家整理,主要介绍了Pig latin相关的知识,希望对你有一定的参考价值。

?????????mapred   ????????????   ???????????????   .exe   ror   ??????   exp   org   Plan   

pig????????????????????????local?????????mapreduce??????

local????????????pig??????????????????????????????mapreduce????????????pig??????????????????hadoop?????????hdfs???????????????????????????pig??????????????????????????????????????????????????????pig?????????????????????mapreduce??????????????????????????????????????????pig latin????????????????????????????????????????????????pig???????????????????????????????????????

pig???local????????????mapreduce????????????????????????????????????Grunt shell???????????????????????????????????????????????????

mapreduce????????????

1 .grunt shell ??????

[[email protected] pig-0.17.0]# pig -x mapreduce
18/06/15 09:40:34 INFO pig.ExecTypeProvider: Trying ExecType : LOCAL
18/06/15 09:40:34 INFO pig.ExecTypeProvider: Trying ExecType : MAPREDUCE
18/06/15 09:40:34 INFO pig.ExecTypeProvider: Picked MAPREDUCE as the ExecType
2018-06-15 09:40:34,951 [main] INFO  org.apache.pig.Main - Apache Pig version 0.17.0 (r1797386) compiled Jun 02 2017, 15:41:58
2018-06-15 09:40:34,951 [main] INFO  org.apache.pig.Main - Logging error messages to: /root/pig/pig-0.17.0/pig_1529026834950.log
2018-06-15 09:40:34,971 [main] INFO  org.apache.pig.impl.util.Utils - Default bootup file /root/.pigbootup not found
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/root/hadoop/hadoop-2.7.4/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/root/hbase-1.4.4/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/root/hive/apache-hive-2.1.1/lib/log4j-slf4j-impl-2.4.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
2018-06-15 09:40:35,586 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2018-06-15 09:40:35,586 [main] INFO  org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to hadoop file system at: hdfs://localhost:9000
2018-06-15 09:40:36,347 [main] INFO  org.apache.pig.PigServer - Pig Script ID for the session: PIG-default-cb6cead5-f22f-4960-bce7-5f44cdb722ec
2018-06-15 09:40:36,347 [main] WARN  org.apache.pig.PigServer - ATS is disabled since yarn.timeline-service.enabled set to false
grunt>

2 .??????????????????

 pig -x mapreduce script.pig

 

 

pig latin??????

????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????hadoop????????????????????????????????????????????????????????????????????????????????????????????????????????????????????? ??????WEB????????????

pigLatin??????????????????????????????????????????????????????????????????????????????load ,store????????????????????????load???store?????????????????????????????????????????????????????????

pig latin??????????????????????????????????????????????????????????????????????????????

??????????????????????????????????????????

1.??????load?????????????????????????????????

2.???????????????????????????????????????????????????

3??????store???????????????????????????????????????????????????????????????dump??????????????????????????????????????????


















以上是关于Pig latin的主要内容,如果未能解决你的问题,请参考以下文章

ruby pig_latin.rb

Pig latin

Pig UDF 或 Pig Latin 还是两者兼而有之?

PIG latin - DUMP 命令不显示

尝试执行 Pig Latin 脚本时出现异常

聚合的 Pig Latin 逻辑测试