impala 查询报错Memory limit exceeded

Posted 2020-10-27 南风叶

使用cloudera工具集搭建的impala集群

查询的时候报错，显示节点内存不足，报错如下：

Memory Limit Exceeded by fragment: 134dccbeab01dd00:72a590a00000006
Query(134dccbeab01dd00:72a590a00000000): Total=55.39 MB Peak=55.39 MB
  Fragment 134dccbeab01dd00:72a590a00000006: Total=54.09 MB Peak=54.09 MB
    Runtime Filter Bank: Total=1.00 MB Peak=1.00 MB
    HASH_JOIN_NODE (id=3): Total=33.04 MB Peak=33.04 MB
      Hash Join Builder (join_node_id=3): Total=33.01 MB Peak=33.01 MB
    AGGREGATION_NODE (id=5): Total=2.26 MB Peak=2.26 MB
    EXCHANGE_NODE (id=4): Total=0 Peak=0
    DataStreamRecvr: Total=0 Peak=0
    EXCHANGE_NODE (id=6): Total=0 Peak=0
    DataStreamRecvr: Total=17.76 MB Peak=17.95 MB
    HdfsTableSink: Total=0 Peak=0
    CodeGen: Total=8.28 KB Peak=1.38 MB
  Block Manager: Limit=156.00 MB Total=24.50 MB Peak=24.50 MB
  Fragment 134dccbeab01dd00:72a590a00000000: Total=1.31 MB Peak=1.79 MB
    AGGREGATION_NODE (id=2): Total=1.27 MB Peak=1.27 MB
    HDFS_SCAN_NODE (id=1): Total=4.00 KB Peak=4.00 KB
      Exprs: Total=4.00 KB Peak=4.00 KB
    DataStreamSender (dst_id=4): Total=25.59 KB Peak=25.59 KB
    CodeGen: Total=2.52 KB Peak=513.50 KB

　　在官网查到是impala的配置Impala Daemon Memory Limit 设置过小引起的， 增大内存。

 

      重启之后查询ok