在centos7上安装flume

Posted 2022-03-23 py8585

一、flume的官方网站

        https://flume.apache.org

二、下载flume

        https://mirrors.tuna.tsinghua.edu.cn/apache/flume/1.9.0/apache-flume-1.9.0-bin.tar.gz

三、通过xftp工具传到linux的/root目录

四、解压

        cd /root

        tar zxvf apache-flume-1.9.0-bin.tar.gz

        mv apache-flume-1.9.0-bin /usr/local/flume

五、配置

        cd /usr/local/flume/conf

        cp flume-conf.properties.template flume-conf.properties

        cp flume-env.sh.template flume-env.sh

        vim  flume-env.sh

                export JAVA_HOME=/usr

六、启动hadoop

        /usr/local/hadoop3/sbin/start-all.sh

七、将nginx_memory_hdfs.properties文件放置在/usr/local目录下

八、将jar包复制到/usr/local/flume/lib目录下

        find /usr/local/hadoop3/share/hadoop/ -name \\*.jar | xargs -i cp  /usr/local/flume/lib/

九、安装nginx

         yum install -y nginx

        启动nginx：  nginx

十、启动flume

        /usr/local/flume/bin/flume-ng agent -n a1 -c /usr/local/flume/conf -f /usr/local/nginx_memory_hdfs.properties -Dflume.root.logger=INFO,console

十一、查看HDFS是否有data/log目录

        http://192.168.30.126:9870