Hadoop配置lzo和lzop
Posted 斐波那切
tags:
篇首语：本文由小常识网(cha138.com)小编为大家整理，主要介绍了Hadoop配置lzo和lzop相关的知识，希望对你有一定的参考价值。
在使用flume采集日志写入到hdfs时，用到了lzo压缩算法，这个算法将让保存的文件缩小为原文件的三分之一。由于此压缩算法不是hadoop默认的，需要另外安装，下面记录下，全文主要参考文末博文完成。
编译安装lzo和lzop
注意，有多少个节点，就安装多个少！注意，有多少个节点，就安装多个少！注意，有多少个节点，就安装多个少！
lzo
先编译安装lzo。
（1）编译需要使用gcc和g++，需要提前安装好，这个在安装ruby也需要用到。
# yum安装 [root@node01 /kkb/soft]# yum -y install gcc-c++ lzo-devel zlib- ...省略 Installed: lzo-devel.x86_64 0:2.06-8.el7 zlib-devel.x86_64 0:1.2.7-18.el7 Dependency Installed: lzo-minilzo.x86_64 0:2.06-8.el7 Complete! You have new mail in /var/spool/mail/root
（2）wget下载lzo，使用了2.10版本，目前这个版本在Hadoop CDH2.6.0上是可以用的。
# 下载 [root@node01 /kkb/install]# wget http://www.oberhumer.com/opensource/lzo/download/lzo-2.10.tar.gz --2020-01-20 06:46:29-- http://www.oberhumer.com/opensource/lzo/download/lzo-2.10.tar.gz Resolving www.oberhumer.com (www.oberhumer.com)... 193.170.194.40 Connecting to www.oberhumer.com (www.oberhumer.com)|193.170.194.40|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 600622 (587K) [application/x-gzip] Saving to: ‘lzo-2.10.tar.gz’ 100%[==========================================================>] 600,622 52.2KB/s in 11s 2020-01-20 06:46:41 (52.0 KB/s) - ‘lzo-2.10.tar.gz’ saved [600622/600622] You have new mail in /var/spool/mail/root
（3）解压、编译和安装，下面省略了部分日志。
# 1 解压压缩包 [root@node01 /kkb/install]# tar -zxvf lzo-2.10.tar.gz lzo-2.10/ lzo-2.10/AUTHORS lzo-2.10/B/ ...略 # 进入解压缩后目录 [root@node01 /kkb/install]# cd lzo-2.10/ # prefix指定安装目录，后面将配置临时环境变量用 [root@node01 /kkb/install/lzo-2.10]# ./configure -prefix=/usr/local/hadoop/lzo/ configure: Configuring LZO 2.10 checking build system type... x86_64-pc-linux-gnu checking host system type... x86_64-pc-linux-gnu checking target system type... x86_64-pc-linux-gnu checking whether to enable maintainer-specific portions of Makefiles... no checking for gcc... gcc ...略 LZO configuration summary ------------------------- LZO version : 2.10 configured for host : x86_64-pc-linux-gnu source code location : . compiler : gcc preprocessor definitions : -DLZO_HAVE_CONFIG_H=1 preprocessor flags : compiler flags : -g -O2 build static library : yes build shared library : no enable i386 assembly code : no LZO 2.10 configured. Copyright (C) 1996-2017 Markus Franz Xaver Johannes Oberhumer All Rights Reserved. The LZO library is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation; either version 2 of the License, or (at your option) any later version. The LZO library is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details. Markus F.X.J. Oberhumer <markus@oberhumer.com> http://www.oberhumer.com/opensource/lzo/ Type \'make\' to build LZO. Type \'make check\' and \'make test\' to test LZO. Type \'make install\' to install LZO. After installing LZO, please have a look at \'examples/simple.c\'. You have new mail in /var/spool/mail/root # 2 编译 [root@node02 /kkb/install/lzo-2.10]# make make all-am make[1]: Entering directory `/kkb/install/lzo-2.10\' CC src/lzo1.lo CC src/lzo1_99.lo CC src/lzo1a.lo CC src/lzo1a_99.lo ...略 make[1]: Leaving directory `/kkb/install/lzo-2.10\' You have new mail in /var/spool/mail/root # 3 安装 [root@node02 /kkb/install/lzo-2.10]# make install make[1]: Entering directory `/kkb/install/lzo-2.10\' /usr/bin/mkdir -p \'/usr/local/hadoop/lzo/lib\' /bin/sh ./libtool --mode=install /usr/bin/install -c src/liblzo2.la \'/usr/local/hadoop/lzo/lib\' libtool: install: /usr/bin/install -c src/.libs/liblzo2.lai /usr/local/hadoop/lzo/lib/liblzo2.la libtool: install: /usr/bin/install -c src/.libs/liblzo2.a /usr/local/hadoop/lzo/lib/liblzo2.a libtool: install: chmod 644 /usr/local/hadoop/lzo/lib/liblzo2.a libtool: install: ranlib /usr/local/hadoop/lzo/lib/liblzo2.a libtool: finish: PATH="/kkb/install/spark/bin:/kkb/install/spark/sbin:/kkb/install/hbase-1.2.0-cdh5.14.2/bin:/kkb/install/zookeeper-3.4.5-cdh5.14.2/bin:/kkb/install/hadoop-2.6.0-cdh5.14.2/bin:/kkb/install/jdk1.8.0_181/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/root/bin:/sbin" ldconfig -n /usr/local/hadoop/lzo/lib ---------------------------------------------------------------------- Libraries have been installed in: /usr/local/hadoop/lzo/lib If you ever happen to want to link against installed libraries in a given directory, LIBDIR, you must either use libtool, and specify the full pathname of the library, or use the \'-LLIBDIR\' flag during linking and do at least one of the following: - add LIBDIR to the \'LD_LIBRARY_PATH\' environment variable during execution - add LIBDIR to the \'LD_RUN_PATH\' environment variable during linking - use the \'-Wl,-rpath -Wl,LIBDIR\' linker flag - have your system administrator add LIBDIR to \'/etc/ld.so.conf\' See any operating system documentation about shared libraries for more information, such as the ld(1) and ld.so(8) manual pages. ---------------------------------------------------------------------- /usr/bin/mkdir -p \'/usr/local/hadoop/lzo/share/doc/lzo\' /usr/bin/install -c -m 644 AUTHORS COPYING NEWS THANKS doc/LZO.FAQ doc/LZO.TXT doc/LZOAPI.TXT \'/usr/local/hadoop/lzo/share/doc/lzo\' /usr/bin/mkdir -p \'/usr/local/hadoop/lzo/lib/pkgconfig\' /usr/bin/install -c -m 644 lzo2.pc \'/usr/local/hadoop/lzo/lib/pkgconfig\' /usr/bin/mkdir -p \'/usr/local/hadoop/lzo/include/lzo\' /usr/bin/install -c -m 644 include/lzo/lzo1.h include/lzo/lzo1a.h include/lzo/lzo1b.h include/lzo/lzo1c.h include/lzo/lzo1f.h include/lzo/lzo1x.h include/lzo/lzo1y.h include/lzo/lzo1z.h include/lzo/lzo2a.h include/lzo/lzo_asm.h include/lzo/lzoconf.h include/lzo/lzodefs.h include/lzo/lzoutil.h \'/usr/local/hadoop/lzo/include/lzo\' make[1]: Leaving directory `/kkb/install/lzo-2.10\'
lzop
上面安装好后，安装lzop。
（1）wget下载lzop，参考博文选择了1.04版本。
# 下载 [root@node01 /kkb/install]# wget http://www.lzop.org/download/lzop-1.04.tar.gz --2020-01-20 07:48:13-- http://www.lzop.org/download/lzop-1.04.tar.gz Resolving www.lzop.org (www.lzop.org)... 193.170.194.40 Connecting to www.lzop.org (www.lzop.org)|193.170.194.40|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 393483 (384K) [application/x-gzip] Saving to: ‘lzop-1.04.tar.gz’ 100%[==========================================================>] 393,483 266KB/s in 1.4s 2020-01-20 07:48:16 (266 KB/s) - ‘lzop-1.04.tar.gz’ saved [393483/393483]
（2) 解压、编译和安装，也省略了部分日志。
# 解压 [root@node01 /kkb/install]# tar -zxvf lzop-1.04.tar.gz lzop-1.04/ lzop-1.04/AUTHORS lzop-1.04/B/ lzop-1.04/B/00README.TXT # 进入解压缩目录 [root@node01 /kkb/install]# cd lzop-1.04/ # 这里不指定安装目录，默认即可 [root@node01 /kkb/install/lzop-1.04]# ./configure configure: Configuring lzop 1.04 checking build system type... x86_64-pc-linux-gnu checking host system type... x86_64-pc-linux-gnu ...略 lzop configuration summary -------------------------- lzop version : 1.04 configured for host : x86_64-pc-linux-gnu source code location : . compiler : gcc preprocessor definitions : -DLZOP_HAVE_CONFIG_H=1 preprocessor flags : compiler flags : -g -O2 linker flags : link libraries : -llzo2 lzop 1.04 configured. Copyright (C) 1996-2017 Markus Franz Xaver Johannes Oberhumer All Rights Reserved. lzop and the LZO library are free software; you can redistribute them and/or modify them under the terms of the GNU General Public License as published by the Free Software Foundation; either version 2 of the License, or (at your option) any later version. This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details. Markus F.X.J. Oberhumer <markus@oberhumer.com> http://www.oberhumer.com/opensource/lzop/ Type `make\' to build lzop. Type `make install\' to install lzop. After installing lzop, please read the accompanied documentation. # 编译，-j可以提高编译速度，10代表允许10个编译命令同时执行 [root@node01 /kkb/install/lzop-1.04]# make -j 10 make all-am make[1]: Entering directory `/kkb/install/lzop-1.04\' CC src/c_ansic.o CC src/c_ansim.o CC src/c_init.o CC src/c_none.o CC src/c_screen.o CC src/compress.o CC src/djgpp2.o CC src/filter.o CC src/frames.o CC src/help.o CC src/lzop.o CC src/mblock.o CC src/p_lzo.o CC src/s_curses.o CC src/s_djgpp2.o CC src/s_object.o CC src/s_vcsa.o CC src/util.o CCLD src/lzop make[1]: Leaving directory `/kkb/install/lzop-1.04\' You have new mail in /var/spool/mail/root # 安装 [root@node01 /kkb/install/lzop-1.04]# make install make[1]: Entering directory `/kkb/install/lzop-1.04\' /usr/bin/mkdir -p \'/usr/local/bin\' /usr/bin/install -c src/lzop \'/usr/local/bin\' /usr/bin/mkdir -p \'/usr/local/share/doc/lzop\' /usr/bin/install -c -m 644 AUTHORS COPYING NEWS README THANKS doc/lzop.html doc/lzop.man doc/lzop.ps doc/lzop.tex doc/lzop.txt doc/lzop.pod \'/usr/local/share/doc/lzop\' /usr/bin/mkdir -p \'/usr/local/share/man/man1\' /usr/bin/install -c -m 644 doc/lzop.1 \'/usr/local/share/man/man1\' make[1]: Leaving directory `/kkb/install/lzop-1.04\'
以上，就完成了lzo和lzop的安装，接下来需要编译hadoop-lzo源码。
hadoop-lzo-master的安装编译
需要安装编译hadoop-lzo源码包，将打包后的文件分发到{HADOOP_HOME}/share/hadoop/commons目录下。
（1）下载源码包。
# 下载 [root@node01 /kkb/install] wget https://github.com/twitter/hadoop-lzo/archive/master.zip
（2）解压到当前目录
# unzip解压，可以-d指定目录 [root@node01 /kkb/install] unzip master.zip
（3）声明两个临时环境变量。
# 这个目录就是上面指定的 [root@node01 /kkb/install] export C_INCLUDE_PATH=/usr/local/hadoop/lzo/include [root@node01 /kkb/install] export LIBRARY_PATH=/usr/local/hadoop/lzo/lib
（4）使用maven编译打包，将hadoop-lzo的jar包进行分发，注意需要在linux下提前安装好maven，这里我选择在其中一台安装，将jar包分发。maven的安装类似windows，参考https://www.cnblogs.com/youngchaolin/p/11825510.html。
[root@node01 /kkb/install/hadoop-lzo-master]# mvn clean package -Dmaven.test.skip=true [INFO] Scanning for projects... [INFO] [INFO] ----------------< com.hadoop.gplcompression:hadoop-lzo >---------------- [INFO] Building hadoop-lzo 0.4.21-SNAPSHOT [INFO] --------------------------------[ jar ]--------------------------------- Downloading from alimaven: https://maven.aliyun.com/repository/central/org/apache/maven/plugins/maven-clean-plugin/2.5/maven-clean-plugin-2.5.pom Downloaded from alimaven: https://maven.aliyun.com/repository/central/org/apache/maven/plugins/maven-clean-plugin/2.5/maven-clean-plugin-2.5.pom (3.9 kB at 4.1 kB/s) Downloading from alimaven: https://maven.aliyun.com/repository/central/org/apache/maven/plugins/maven-clean-plugin/2.5/maven-clean-plugin-2.5.jar Downloaded from alimaven: https://maven.aliyun.com/repository/central/org/apache/maven/plugins/maven-clean-plugin/2.5/maven-clean-plugin-2.5.jar (25 kB at 60 kB/s) [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hadoop-lzo --- [INFO] Deleting /kkb/install/hadoop-lzo-master/target [INFO] [INFO] --- maven-antrun-plugin:1.7:run (check-platform) @ hadoop-lzo --- [INFO] Executing tasks check-platform: [INFO] Executed tasks [INFO] [INFO] --- maven-antrun-plugin:1.7:run (set-props-non-win) @ hadoop-lzo --- [INFO] Executing tasks set-props-non-win: [INFO] Executed tasks [INFO] [INFO] --- maven-antrun-plugin:1.7:run (set-props-win) @ hadoop-lzo --- [INFO] Executing tasks set-props-win: [INFO] Executed tasks [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ hadoop-lzo --- [INFO] Using \'UTF-8\' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /kkb/install/hadoop-lzo-master/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:2.5.1:compile (default-compile) @ hadoop-lzo --- [INFO] Compiling 25 source files to /kkb/install/hadoop-lzo-master/target/classes [WARNING] bootstrap class path not set in conjunction with -source 1.6 /kkb/install/hadoop-lzo-master/src/main/java/com/hadoop/compression/lzo/LzoIndexer.java:[82,18] [deprecation] isDir() in FileStatus has been deprecated [WARNING] /kkb/install/hadoop-lzo-master/src/main/java/com/hadoop/compression/lzo/DistributedLzoIndexer.java:[52,20] [deprecation] isDir() in FileStatus has been deprecated [WARNING] /kkb/install/hadoop-lzo-master/src/main/java/com/hadoop/compression/lzo/DistributedLzoIndexer.java:[112,14] [deprecation] Job(Configuration) in Job has been deprecated [WARNING] /kkb/install/hadoop-lzo-master/src/main/java/com/hadoop/mapreduce/LzoIndexOutputFormat.java:[31,28] [deprecation] cleanupJob(JobContext) in OutputCommitter has been deprecated [INFO] [INFO] --- maven-antrun-plugin:1.7:run (build-info-non-win) @ hadoop-lzo --- [INFO] Executing tasks build-info-non-win: [propertyfile] Creating new property file: /kkb/install/hadoop-lzo-master/target/classes/hadoop-lzo-build.properties [INFO] Executed tasks [INFO] [INFO] --- maven-antrun-plugin:1.7:run (build-info-win) @ hadoop-lzo --- [INFO] Executing tasks build-info-win: [INFO] Executed tasks [INFO] [INFO] --- maven-antrun-plugin:1.7:run (check-native-uptodate-non-win) @ hadoop-lzo --- [INFO] Executing tasks check-native-uptodate-non-win: [INFO] Executed tasks [INFO] [INFO] --- maven-antrun-plugin:1.7:run (check-native-uptodate-win) @ hadoop-lzo --- [INFO] Executing tasks check-native-uptodate-win: [INFO] Executed tasks [INFO] [INFO] --- maven-antrun-plugin:1.7:run (build-native-non-win) @ hadoop-lzo --- [INFO] Executing tasks build-native-non-win: [mkdir] Created dir: /kkb/install/hadoop-lzo-master/target/native/Linux-amd64-64/lib [mkdir] Created dir: /kkb/install/hadoop-lzo-master/target/classes/native/Linux-amd64-64/lib [mkdir] Created dir: /kkb/install/hadoop-lzo-master/target/native/Linux-amd64-64/src/com/hadoop/compression/lzo [javah] [Forcefully writing file RegularFileObject[/kkb/install/hadoop-lzo-master/target/native/Linux-amd64-64/src/com/hadoop/compression/lzo/com_hadoop_compression_lzo_LzoCompressor.h]] [javah] [Forcefully writing file RegularFileObject[/kkb/install/hadoop-lzo-master/target/native/Linux-amd64-64/src/com/hadoop/compression/lzo/com_hadoop_compression_lzo_LzoCompressor_CompressionStrategy.h]] [javah] [Forcefully writing file RegularFileObject[/kkb/install/hadoop-lzo-master/target/native/Linux-amd64-64/src/com/hadoop/compression/lzo/com_hadoop_compression_lzo_LzoDecompressor.h]] [javah] [Forcefully writing file RegularFileObject[/kkb/install/hadoop-lzo-master/target/native/Linux-amd64-64/src/com/hadoop/compression/lzo/com_hadoop_compression_lzo_LzoDecompressor_CompressionStrategy.h]] [exec] checking for a BSD-compatible install... /usr/bin/install -c [exec] checking whether build environment is sane... yes [exec] checking for a thread-safe mkdir -p... /usr/bin/mkdir -p [exec] checking for gawk... gawk [exec] checking whether make sets $(MAKE)... yes [exec] checking whether to enable maintainer-specific portions of Makefiles... no [exec] checking for style of include used by make... GNU [exec] checking for gcc... gcc [exec] checking whether the C compiler works... yes [exec] checking for C compiler default output file name... a.out [exec] checking for suffix of executables... [exec] checking whether we are cross compiling... no [exec] checking for suffix of object files... o [exec] checking whether we are using the GNU C compiler... yes [exec] checking whether gcc accepts -g... yes [exec] checking for gcc option to accept ISO C89... none needed [exec] checking dependency style of gcc... gcc3 [exec] checking how to run the C preprocessor... gcc -E [exec] checking for grep that handles long lines and -e... /usr/bin/grep [exec] checking for egrep... /usr/bin/grep -E [exec] checking for ANSI C header files... yes [exec] checking for sys/types.h... yes [exec] checking for sys/stat.h... yes [exec] checking for stdlib.h... yes [exec] checking for string.h... yes [exec] checking for memory.h... yes [exec] checking for strings.h... yes [exec] checking for inttypes.h... yes [exec] checking for stdint.h... yes [exec] checking for unistd.h... yes [exec] checking minix/config.h usability... no [exec] checking minix/config.h presence... no [exec] checking for minix/config.h... no [exec] checking whether it is safe to define __EXTENSIONS__... yes [exec] checking for gcc... (cached) gcc [exec] checking whether we are using the GNU C compiler... (cached) yes [exec] checking whether gcc accepts -g... (cached) yes [exec] checking for gcc option to accept ISO C89... (cached) none needed [exec] checking dependency style of gcc... (cached) gcc3 [exec] checking build system type... x86_64-unknown-linux-gnu [exec] checking host system type... x86_64-unknown-linux-gnu [exec] checking for a sed that does not truncate output... /usr/bin/sed [exec] checking for fgrep... /usr/bin/grep -F [exec] checking for ld used by gcc... /usr/bin/ld [exec] checking if the linker (/usr/bin/ld) is GNU ld... yes [exec] checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B [exec] checking the name lister (/usr/bin/nm -B) interface... BSD nm [exec] checking whether ln -s works... yes [exec] checking the maximum length of command line arguments... 1572864 [exec] checking whether the shell understands some XSI constructs... yes [exec] checking whether the shell understands "+="... yes [exec] checking for /usr/bin/ld option to reload object files... -r [exec] checking for objdump... objdump [exec] checking how to recognize dependent libraries... pass_all [exec] checking for ar... ar [exec] checking for strip... strip [exec] checking for ranlib... ranlib [exec] checking command to parse /usr/bin/nm -B output from gcc object... ok [exec] checking for dlfcn.h... yes [exec] checking for objdir... .libs [exec] checking if gcc supports -fno-rtti -fno-exceptions... no [exec] checking for gcc option to produce PIC... -fPIC -DPIC [exec] checking if gcc PIC flag -fPIC -DPIC works... yes [exec] checking if gcc static flag -static works... no [exec] checking if gcc supports -c -o file.o... yes [exec] checking if gcc supports -c -o file.o... (cached) yes [exec] checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes [exec] checking whether -lc should be explicitly linked in... no [exec] checking dynamic linker characteristics... GNU/Linux ld.so [exec] checking how to hardcode library paths into programs... immediate [exec] checking whether stripping libraries is possible... yes [exec] checking if libtool supports shared libraries... yes [exec] checking whether to build shared libraries... yes [exec] checking whether to build static libraries... yes [exec] checking for dlopen in -ldl... yes [exec] checking for unistd.h... (cached) yes [exec] checking stdio.h usability... yes [exec] checking stdio.h presence... yes [exec] checking for stdio.h... yes [exec] checking stddef.h usability... yes [exec] checking stddef.h presence... yes [exec] checking for stddef.h... yes [exec] checking lzo/lzo2a.h usability... yes [exec] which: no otool in (/kkb/install/maven-3.6.3/apache-maven-3.6.3/bin:/kkb/install/spark/bin:/kkb/install/spark/sbin:/kkb/install/hbase-1.2.0-cdh5.14.2/bin:/kkb/install/zookeeper-3.4.5-cdh5.14.2/bin:/kkb/install/hadoop-2.6.0-cdh5.14.2/sbin:/kkb/install/hadoop-2.6.0-cdh5.14.2/bin:/kkb/install/jdk1.8.0_181/bin:/kkb/install/spark/bin:/kkb/install/spark/sbin:/kkb/install/hbase-1.2.0-cdh5.14.2/bin:/kkb/install/zookeeper-3.4.5-cdh5.14.2/bin:/kkb/install/hadoop-2.6.0-cdh5.14.2/sbin:/kkb/install/hadoop-2.6.0-cdh5.14.2/bin:/kkb/install/jdk1.8.0_181/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/root/bin) [exec] checking lzo/lzo2a.h presence... yes [exec] checking for lzo/lzo2a.h... yes [exec] checking Checking for the \'actual\' dynamic-library for \'-llzo2\'... "liblzo2.so.2" [exec] checking for special C compiler options needed for large files... no [exec] checking for _FILE_OFFSET_BITS value needed for large files... no [exec] checking for stdbool.h that conforms to C99... yes [exec] checking for _Bool... yes [exec] checking for an ANSI C-conforming const... yes [exec] checking for off_t... yes [exec] checking for size_t... yes [exec] checking whether strerror_r is declared... yes [exec] checking for strerror_r... yes [exec] checking whether strerror_r returns char *... yes [exec] checking for mkdir... yes [exec] checking for uname... yes [exec] checking for memset... yes [exec] checking for JNI_GetCreatedJavaVMs in -ljvm... yes [exec] checking jni.h usability... yes [exec] checking jni.h presence... yes [exec] checking for jni.h... yes [exec] configure: creating ./config.status [exec] config.status: creating Makefile [exec] config.status: creating impl/config.h [exec] config.status: executing depfiles commands [exec] config.status: executing libtool commands [exec] depbase=`echo impl/lzo/LzoCompressor.lo | sed \'s|[^/]*$|.deps/&|;s|\\.lo$||\'`;\\ [exec] /bin/sh ./libtool --tag=CC --mode=compile gcc -DHAVE_CONFIG_H -I. -I/kkb/install/hadoop-lzo-master/src/main/native -I./impl -I/kkb/install/jdk1.8.0_181/include -I/kkb/install/jdk1.8.0_181/include/linux -I/kkb/install/hadoop-lzo-master/src/main/native/impl -Isrc/com/hadoop/compression/lzo -g -Wall -fPIC -O2 -m64 -g -O2 -MT impl/lzo/LzoCompressor.lo -MD -MP -MF $depbase.Tpo -c -o impl/lzo/LzoCompressor.lo /kkb/install/hadoop-lzo-master/src/main/native/impl/lzo/LzoCompressor.c &&lzo压缩格式文件查看Hive 问题解决 No enum constant org.apache.parquet.hadoop.metadata.CompressionCodecName.LZOP
记一次hive查询报错解决 No enum constant org.apache.parquet.hadoop.metadata.CompressionCodecName.LZOP