Apache实用的日志分析脚本

Apache实用的日志分析脚本 †

1. 查看apache的进程数

ps -aux | grep httpd | wc -l

2. 分析日志查看当天的ip连接数

cat default-access_log | grep "10/Dec/2010″ | awk '{print $2}' | sort | uniq -c | sort -nr

3. 查看指定的ip在当天究竟访问了什么url

cat default-access_log | grep "10/Dec/2010″ | grep "218.19.140.242″ | awk '{print $7}' | sort | uniq -c | sort -nr

4. 查看当天访问排行前10的url

cat default-access_log | grep "10/Dec/2010″ | awk '{print $7}' | sort | uniq -c | sort -nr | head -n 10

5. 看到指定的ip究竟干了什么

cat default-access_log | grep 218.19.140.242 | awk '{print $1″\t”$8}' | sort | uniq -c | sort -nr | less

6. 查看访问次数最多的几个分钟(找到热点)

awk '{print $4}' default-access_log |cut -c 14-18|sort|uniq -c|sort -nr|head

7. Apache log
から　date/hours/ request_path http_status

gzip -cd /a/nbackup202d/tw_log/apache_log/wtwconv10?d/apache22-conv01/review.rakuten.com.tw/access.log/2012/11/access_201211??.log.gz | cut -d' ' -f 4,7,9 | sed 's/:/ /g' | sed 's/\[//g' | awk -F' ' '{if($6=="200") print $1,$2,$5 }'

8. 一定時間帯のアクセス集計

cat default-access_log | sed -n '/02:19:/, /02:49:/p' | wc -l

9. ps

10. ps -mp <PID> | wc -l

11.or

ls -la  /proc/<PID>/task/ | wc -l

12. Thread dump

13. kill -3 <PID>

14. tomcat.logかcatalina.outに出力される

15.OR

jstackでもできるはずだが、JDK7になってうまくできない。Why?

16. curl
i. head

ii.     [mshao@dev-wtwconv101zd ]$

curl -x 172.25.36.173:50102 -ILv search.rakuten.com.tw/index.html

17. shell(bash)

for i in wtwconv10{1,2,3,4,5,6}d; do ssh $i 'grep "(Inventory) API error" /usr/local/var/log/conview/id-approot/shop.rakuten.web.id/conview_20120902.log | wc -l'; done

18. svn merge

19.svn checkout {trunk_url}

20.cd {trunk_work_copy}

21.svn merge {branch_url}@{base_version} {branch_url}

22.--- Merging r{base_version} through r{branch_head_version} into '.':

23.U    xxxx/xxxxxxxx/xxx.py

24.A    xxxx/xxxxxxxx/xxx.cs

svn commit -m"{comment}"