如果"一切是IO"“一切是file”是成立的，那么上述的想法也一定可以实现吧 awk对apache日志分析 ---

定时执行

自动化处理

直接入库

再去读取这个file入库；

root@VM---ubuntu:/var/log/apache2# awk '{print $1 "\t" $7}' access.log | grep -v '113.' | grep -v '101.226.' | awk '{print "INSERT INTO TAB1 ('\''" $1 "'\'', '\''" $2 "'\'');"}' | head > wawk_select.txt
root@VM---ubuntu:/var/log/apache2# awk '{print $1 "\t" $7}' access.log | grep -v '113.' | grep -v '101.226.' | awk '{print "INSERT INTO TAB1 ('\''" $1 "'\'', '\''" $2 "'\'');"}' | head > wawk_select.sql

w

 如果"一切是IO"“一切是file”是成立的，那么上述的想法也一定可以实现吧 

 

 

root@VM---ubuntu:/var/log/apache2# ls
access.log        access.log..gz  access.log..gz  access.log..gz  error.log        error.log..gz  error.log..gz  error.log..gz
access.log.      access.log..gz  access.log..gz  access.log..gz  error.log.      error.log..gz  error.log..gz  error.log..gz
access.log..gz  access.log..gz  access.log..gz  access.log..gz  error.log..gz  error.log..gz  error.log..gz  error.log..gz
access.log..gz  access.log..gz   access.log..gz  access_log       error.log..gz  error.log..gz   error.log..gz  other_vhosts_access.log
root@VM---ubuntu:/var/log/apache2# vi access.log
root@VM---ubuntu:/var/log/apache2# awk '{print $1 "\t" $7}' access.log | grep -v '113.' | grep -v '101.226.' | awk '{print "INSERT INTO TAB1 ('\''" $1 "'\'', '\''" $2 "'\'');"}' | head
INSERT INTO TAB1 ('180.153.206.16', '/rockmongo');
INSERT INTO TAB1 ('125.39.207.33', '/');
INSERT INTO TAB1 ('183.57.53.196', '/skins/vector/csshover.htc');
INSERT INTO TAB1 ('180.153.214.199', '/skins/vector/csshover.htc');
INSERT INTO TAB1 ('112.90.82.218', '/4e5e5d7364f443e28fbf0d3ae744a59a');
INSERT INTO TAB1 ('112.90.82.218', '/jenkins');
INSERT INTO TAB1 ('180.153.201.66', '/jenkins');
INSERT INTO TAB1 ('107.151.148.193', 'http://www.proxyjudge.info/azenv.php');
INSERT INTO TAB1 ('107.151.148.193', 'www.alipay.com:443');
INSERT INTO TAB1 ('107.151.148.193', '');
root@VM---ubuntu:/var/log/apache2#

问题：
针对上边的case得到awk分析文本的结果：
0-怎样直接写入结构化或非结构化的数据库或保存为非数据库形式的file，便于进一步处理？

1-访问日志同步写入数据库，会加大有损用户体验的服务器负担？措施：同步地、相对写入数据库而言低功耗地写入file，之后再在服务器相对低并发的时间段，异步写入数据库？

Linux下apache日志分析与状态查看方法_Linux_脚本之家
http://www.jb51.net/article/33647.htm

对原始的Apache访问日志

下面那个命令是筛选出访问IP不是 177.126 或 192.168 开头的IP，显示访问者的IP，访问时间和访问路径