Goaccess自动分割nginx日志

Posted 2020-11-19 新美好时代

GoAccess 是一款开源的网站日志实时分析工具。GoAccess 的工作方式很容易理解，就是读取和解析 Apache/nginx/Lighttpd 的访问日志文件 access log，然后以更友好的方式把统计信息显示出来。统计的内容包括：访问概况、动态页面请求、静态页面请求（如图片、样式表、脚本等）、访客排名，访客使用的操作系统，访客使用的浏览器，来路域名，404 错误，搜索爬虫，搜索关键词等等。

安装组件
yum -y install glib2 glib2-devel ncurses ncurses-devel GeoIP GeoIP-devel
下载源码包安装
wget http://tar.goaccess.io/goaccess-0.8.5.tar.gz
tar zxvf goaccess-0.8.5.tar.gz -C /usr/src/
cd /usr/src/goaccess-0.8.5/
./configure --prefix=/usr/local/goaccess
make && make install

下载文件
cd /usr/local/goaccess/
wget -O goaccessrc https://raw.githubusercontent.com/allinurl/goaccess/master/config/goaccess.conf --no-check-certificate
编辑文件
vim goaccessrc
去除下面22，33行的注释，增加235行的注释

22 date-format %d/%b/%Y
33 log-format %h %^[%d:%t %^] "%r" %s %b "%R" "%u"
235 #ignore-panel KEYPHRASES

创建网页目录
mkdir html
生成网页报告
/usr/local/goaccess/bin/goaccess -f /usr/local/nginx/logs/access.log -d -a -p /usr/local/goaccess/goaccessrc > /usr/local/goaccess/html/access.html

Nginx发布goaccess网页

cd /usr/local/nginx/conf/vhosts/
vi goaccess.conf

server {
listen 80;
server_name goaccess.xx.com;
autoindex on;
location / {
root /usr/local/goaccess/html;
}
}

重新加载
/usr/local/nginx/sbin/nginx -s reload

访问网页
http://goaccess.xx.com/access.html
wKioL1VK-4iB_ZLQAAJI0SkVSms176.jpg

下面介绍nginx日志切割和自动生成网页报告以及汉化。
vi nginx_cut.sh

#!/bin/bash

#############日志切割###########################
time=`date -d today +%Y%m%d%H%M`
/usr/local/nginx/sbin/nginx -s stop
cd /usr/local/nginx/logs
mv access.log access_$time.log
mv error.log error_$time.log
/usr/local/nginx/sbin/nginx
#删除超过7天的日志文件
find /usr/local/nginx/logs -ctime 3 -type f -name "*.log" -exec rm {} ;

#自动生成网页报告
/usr/local/goaccess/bin/goaccess -f access_$time.log -d -a -p /usr/local/goaccess/goaccessrc > /usr/local/goaccess/html/access_$time.html

#自动汉化网页报告文件
echo access_$time.html > /tmp/time.log
/manage/hanhua.sh

#删除超过7天的报告文件
find /usr/local/goaccess/html -ctime 7 -type f -name "*.html" -exec rm {} ;

编辑汉化脚本，英文翻译参考百度翻译,可能不太准确。
vi /manage/hanhua.sh

#/bin/bash

file=`cat /tmp/time.log`

cd /usr/local/goaccess/html
sed -i ‘s/Overall/整体/g‘ $file
sed -i ‘s/Unique visitors/独立访客/g‘ $file
sed -i ‘s/Requested files/请求的文件/g‘ $file
sed -i ‘s/Requested static files/请求的静态文件/g‘ $file
sed -i ‘s/Not found URLs/没有找到网址/g‘ $file
sed -i ‘s/Hosts/主机/g‘ $file
sed -i ‘s/Operating Systems/操作系统/g‘ $file
sed -i ‘s/Browsers/浏览器/g‘ $file
sed -i ‘s/Referrers URLs/反向链接的url/g‘ $file
sed -i ‘s/Referring sites/参考网站/g‘ $file
sed -i ‘s/Keyphrases/关键词/g‘ $file
sed -i ‘s/Status codes/状态码/g‘ $file
sed -i ‘s/Generated by/生成的/g‘ $file
sed -i ‘s/Dashboard/仪表板/g‘ $file
sed -i ‘s/Analyzed Requests/分析请求/g‘ $file
sed -i ‘s/Total Requests/总请求/g‘ $file
sed -i ‘s/Failed Requests/请求失败/g‘ $file
sed -i ‘s/Generation Time/生成时间/g‘ $file
sed -i ‘s/Unique Visitors/独立访客/g‘ $file
sed -i ‘s/Unique Files/独特的文件/g‘ $file
sed -i ‘s/Excl. IP Hits/除外的IP点击/g‘ $file
sed -i ‘s/Referrers/反向链接/g‘ $file
sed -i ‘s/Unique 404/独特的404/g‘ $file
sed -i ‘s/Static Files/静态文件/g‘ $file
sed -i ‘s/Log Size/日志大小/g‘ $file
sed -i ‘s/Bandwidth/带宽/g‘ $file
sed -i ‘s/per day/每一天/g‘ $file
sed -i ‘s/Including spiders/包括蜘蛛/g‘ $file
sed -i ‘s/Hits having the same IP/具有相同的IP点击/g‘ $file
sed -i ‘s/date and agent are a unique visit/日期和代理是一种独特的访问/g‘ $file
sed -i ‘s/Top Requested Files sorted by hits/请求的文件按点击顶部/g‘ $file
sed -i ‘s/time served/时间送达/g‘ $file
sed -i ‘s/protocol/协议/g‘ $file
sed -i ‘s/method/方法/g‘ $file
sed -i ‘s/Hits/点击/g‘ $file
sed -i ‘s/Protocol/协议/g‘ $file
sed -i ‘s/Method/方法/g‘ $file
sed -i ‘s/Top 404 Not Found URLs sorted by hits/前404没有找到网址按点击率排序/g‘ $file
sed -i ‘s/Top/前/g‘ $file
sed -i ‘s/sorted by hits/按点击率/g‘ $file
sed -i ‘s/bandwidth/带宽/g‘ $file
sed -i ‘s/Hostname/主机名/g‘ $file
sed -i ‘s/sorted by unique visitors/通过独特的访客排序/g‘ $file
sed -i ‘s/Requested/要求/g‘ $file
sed -i ‘s/Status Codes/状态码/g‘ $file
sed -i ‘s/Code/代码/g‘ $file
sed -i ‘s/Visitors/游客/g‘ $file
sed -i ‘s/Name/名称/g‘ $file
sed -i ‘s/Not Found URLs/没有找到网址/g‘ $file
sed -i ‘s/or service not known/或服务不知道/g‘ $file
sed -i ‘s/Pages/页面/g‘ $file
sed -i ‘s/Referring Sites/参考网站/g‘ $file

访问网页
http://goaccess.xx.com/
wKiom1VK-lTjIw3QAACuvyMOfEc868.jpg
点击网页文件
汉化之后的页面效果如下：
wKioL1VK--uCJqyaAAHDhwfvtbU010.jpg
本文出自 “陨落星空” 博客，请务必保留此出处http://xiao987334176.blog.51cto.com/2202382/1643811