hive问题汇总

Posted duaner92

tags:

篇首语:本文由小常识网(cha138.com)小编为大家整理,主要介绍了hive问题汇总相关的知识,希望对你有一定的参考价值。

1.  进行sql 查询,count(*) 时报错,如下

hive> select count(*) from duan;
Query ID = root_20190104154949_2c2d73dc-3059-455b-b845-1ee824f2fd82
Total jobs = 1
Launching Job 1 out of 1
Number of reduce tasks determined at compile time: 1
In order to change the average load for a reducer (in bytes):
  set hive.exec.reducers.bytes.per.reducer=<number>
In order to limit the maximum number of reducers:
  set hive.exec.reducers.max=<number>
In order to set a constant number of reducers:
  set mapreduce.job.reduces=<number>
Starting Job = job_1546564955240_0001, Tracking URL = http://servers3:8088/proxy/application_1546564955240_0001/
Kill Command = /opt/cloudera/parcels/CDH-5.12.2-1.cdh5.12.2.p0.4/lib/hadoop/bin/hadoop job  -kill job_1546564955240_0001
Hadoop job information for Stage-1: number of mappers: 5; number of reducers: 1
2019-01-04 15:53:03,609 Stage-1 map = 80%,  reduce = 0%
Ended Job = job_1546564955240_0001 with errors
Error during job, obtaining debugging information...
Examining task ID: task_1546564955240_0001_m_000003 (and more) from job job_1546564955240_0001
Examining task ID: task_1546564955240_0001_r_000000 (and more) from job job_1546564955240_0001

Task with the most failures(4): 
-----
Task ID:
  task_1546564955240_0001_m_000001

URL:
  http://servers3:8088/taskdetails.jsp?jobid=job_1546564955240_0001&tipid=task_1546564955240_0001_m_000001
-----
Diagnostic Messages for this Task:


FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
MapReduce Jobs Launched: 
Stage-Stage-1: Map: 5  Reduce: 1   FAIL
Total MapReduce CPU Time Spent: -1 msec

  查看日志:

yarn logs -applicationId application_1546564955240_0001

2019-01-04 15:51:58,453 WARN [main] org.apache.hadoop.mapred.YarnChild: Exception running child : java.net.NoRouteToHostException: No Route to Host from servers3/192.168.86.8 to servers1:44423 failed on socket timeout exception: java.net.NoRouteToHostException: No route to host; For more details see: http://wiki.apache.org/hadoop/NoRouteToHost
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:791)
at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:757)
at org.apache.hadoop.ipc.Client.call(Client.java:1508)
at org.apache.hadoop.ipc.Client.call(Client.java:1441)
at org.apache.hadoop.ipc.WritableRpcEngine$Invoker.invoke(WritableRpcEngine.java:246)
at com.sun.proxy.$Proxy8.getTask(Unknown Source)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:132)
Caused by: java.net.NoRouteToHostException: No route to host













以上是关于hive问题汇总的主要内容,如果未能解决你的问题,请参考以下文章

hive的基本语法汇总(hql)

Hive篇:Hive分区表常用语法汇总

大数据初学者问题汇总之恢复已删除的hive表数据

大数据系列问题汇总

Apache Pig/Apache Hive 中给定日期范围的数据汇总

Hive 常用函数汇总