- kernel: httpd invoked oom-killer: gfp mask=0x280da, order=0, oom adj=0, oom score adj=0
1 /var/log/messages[ | ]
Jul 17 20:43:53 zetawiki auditd[1209]: Audit daemon rotating log files
Jul 18 00:30:45 zetawiki kernel: httpd invoked oom-killer: gfp_mask=0x280da, order=0, oom_adj=0, oom_score_adj=0
Jul 18 00:30:46 zetawiki varnishd[1756]: Child (1759) not responding to CLI, killing it.
Jul 18 00:31:04 zetawiki varnishd[1756]: Child (1759) not responding to CLI, killing it.
Jul 18 00:31:04 zetawiki varnishd[1756]: Child (1759) died signal=9
Jul 18 00:31:04 zetawiki kernel: httpd cpuset=/ mems_allowed=0
Jul 18 00:31:04 zetawiki kernel: Pid: 25661, comm: httpd Not tainted 2.6.32-431.17.1.el6.x86_64 #1
Jul 18 00:31:04 zetawiki kernel: Call Trace:
Jul 18 00:31:04 zetawiki kernel: [<ffffffff810d0211>] ? cpuset_print_task_mems_allowed+0x91/0xb0
Jul 18 00:31:04 zetawiki kernel: [<ffffffff811225c0>] ? dump_header+0x90/0x1b0
Jul 18 00:31:04 zetawiki kernel: [<ffffffff8122761c>] ? security_real_capable_noaudit+0x3c/0x70
Jul 18 00:31:04 zetawiki kernel: [<ffffffff81122a42>] ? oom_kill_process+0x82/0x2a0
Jul 18 00:31:04 zetawiki kernel: [<ffffffff81122981>] ? select_bad_process+0xe1/0x120
Jul 18 00:31:04 zetawiki kernel: [<ffffffff81122e80>] ? out_of_memory+0x220/0x3c0
Jul 18 00:31:04 zetawiki kernel: [<ffffffff8116769a>] ? alloc_pages_current+0xaa/0x110
Jul 18 00:31:04 zetawiki kernel: [<ffffffff8152d73e>] ? do_page_fault+0x3e/0xa0
Jul 18 00:31:04 zetawiki kernel: [<ffffffff8152aaf5>] ? page_fault+0x25/0x30
Jul 18 00:31:04 zetawiki kernel: Mem-Info:
Jul 18 00:31:04 zetawiki kernel: Node 0 DMA per-cpu:
Jul 18 00:31:04 zetawiki kernel: CPU 0: hi: 0, btch: 1 usd: 0
Jul 18 00:31:04 zetawiki kernel: CPU 1: hi: 0, btch: 1 usd: 0
Jul 18 00:31:04 zetawiki kernel: CPU 2: hi: 0, btch: 1 usd: 0
Jul 18 00:31:04 zetawiki kernel: CPU 3: hi: 0, btch: 1 usd: 0
Jul 18 00:31:04 zetawiki kernel: CPU 4: hi: 0, btch: 1 usd: 0
Jul 18 00:31:04 zetawiki kernel: CPU 5: hi: 0, btch: 1 usd: 0
Jul 18 00:31:04 zetawiki kernel: CPU 6: hi: 0, btch: 1 usd: 0
Jul 18 00:31:04 zetawiki kernel: CPU 7: hi: 0, btch: 1 usd: 0
Jul 18 00:31:04 zetawiki kernel: Node 0 DMA32 per-cpu:
Jul 18 00:31:04 zetawiki kernel: CPU 0: hi: 186, btch: 31 usd: 155
Jul 18 00:31:04 zetawiki kernel: CPU 1: hi: 186, btch: 31 usd: 81
Jul 18 00:31:04 zetawiki kernel: CPU 2: hi: 186, btch: 31 usd: 8
Jul 18 00:31:04 zetawiki kernel: CPU 3: hi: 186, btch: 31 usd: 103
Jul 18 00:31:04 zetawiki kernel: CPU 4: hi: 186, btch: 31 usd: 129
Jul 18 00:31:04 zetawiki kernel: CPU 5: hi: 186, btch: 31 usd: 49
Jul 18 00:31:04 zetawiki kernel: CPU 6: hi: 186, btch: 31 usd: 157
Jul 18 00:31:04 zetawiki kernel: CPU 7: hi: 186, btch: 31 usd: 94
Jul 18 00:31:04 zetawiki kernel: active_anon:275394 inactive_anon:92014 isolated_anon:5247
Jul 18 00:31:04 zetawiki kernel: active_file:67 inactive_file:250 isolated_file:63
Jul 18 00:31:04 zetawiki kernel: unevictable:20736 dirty:1 writeback:202 unstable:0
Jul 18 00:31:04 zetawiki kernel: free:13873 slab_reclaimable:4344 slab_unreclaimable:17131
Jul 18 00:31:04 zetawiki kernel: mapped:21436 shmem:664 pagetables:41173 bounce:0
Jul 18 00:31:04 zetawiki kernel: lowmem_reserve[]: 0 2004 2004 2004
Jul 18 00:31:04 zetawiki kernel: lowmem_reserve[]: 0 0 0 0
Jul 18 00:31:04 zetawiki kernel: Node 0 DMA: 37*4kB 20*8kB 16*16kB 6*32kB 2*64kB 1*128kB 5*256kB 4*512kB 2*1024kB 1*2048kB 0*4096kB = 8436kB
Jul 18 00:31:04 zetawiki kernel: Node 0 DMA32: 10698*4kB 76*8kB 0*16kB 0*32kB 0*64kB 2*128kB 2*256kB 2*512kB 2*1024kB 0*2048kB 0*4096kB = 47240kB
Jul 18 00:31:04 zetawiki kernel: 35868 total pagecache pages
Jul 18 00:31:04 zetawiki kernel: 13976 pages in swap cache
Jul 18 00:31:04 zetawiki kernel: Swap cache stats: add 2935744, delete 2921768, find 3036539/3243594
Jul 18 00:31:04 zetawiki kernel: Free swap = 0kB
Jul 18 00:31:04 zetawiki kernel: Total swap = 4128760kB
Jul 18 00:31:04 zetawiki kernel: 524284 pages RAM
Jul 18 00:31:04 zetawiki kernel: 43879 pages reserved
Jul 18 00:31:04 zetawiki kernel: 175680 pages shared
Jul 18 00:31:04 zetawiki kernel: 434711 pages non-shared
Jul 18 00:31:04 zetawiki kernel: [ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
Jul 18 00:31:04 zetawiki kernel: [ 510] 0 510 2741 12 0 -17 -1000 udevd
Jul 18 00:31:04 zetawiki kernel: [ 1209] 0 1209 23294 37 1 -17 -1000 auditd
Jul 18 00:31:04 zetawiki kernel: [ 1225] 0 1225 64048 583 0 0 0 rsyslogd
Jul 18 00:31:04 zetawiki kernel: [ 1254] 0 1254 2705 36 0 0 0 irqbalance
Jul 18 00:31:04 zetawiki kernel: [ 1370] 81 1370 5351 13 0 0 0 dbus-daemon
Jul 18 00:31:04 zetawiki kernel: [ 1399] 0 1399 1020 12 0 0 0 acpid
Jul 18 00:31:04 zetawiki kernel: [ 1408] 68 1408 9457 107 4 0 0 hald
Jul 18 00:31:04 zetawiki kernel: [ 1409] 0 1409 5100 12 3 0 0 hald-runner
Jul 18 00:31:04 zetawiki kernel: [ 1441] 0 1441 5630 11 0 0 0 hald-addon-inpu
Jul 18 00:31:04 zetawiki kernel: [ 1452] 68 1452 4502 14 0 0 0 hald-addon-acpi
Jul 18 00:31:04 zetawiki kernel: [ 1465] 0 1465 2665 12 0 -17 -1000 udevd
Jul 18 00:31:04 zetawiki kernel: [ 1471] 0 1471 113076 47 7 0 0 automount
Jul 18 00:31:04 zetawiki kernel: [ 1487] 0 1487 1695 5 3 0 0 mcelog
Jul 18 00:31:04 zetawiki kernel: [ 1499] 0 1499 16652 36 7 -17 -1000 sshd
Jul 18 00:31:04 zetawiki kernel: [ 1516] 0 1516 22834 53 2 0 0 sendmail
Jul 18 00:31:04 zetawiki kernel: [ 1524] 51 1524 20178 11 0 0 0 sendmail
Jul 18 00:31:04 zetawiki kernel: [ 1547] 0 1547 28660 13 3 0 0 abrtd
Jul 18 00:31:04 zetawiki kernel: [ 1555] 0 1555 28133 12 0 0 0 abrt-dump-oops
Jul 18 00:31:04 zetawiki kernel: [ 1563] 0 1563 29332 34 3 0 0 crond
Jul 18 00:31:04 zetawiki kernel: [ 1579] 0 1579 121061 367 0 0 0 fail2ban-server
Jul 18 00:31:04 zetawiki kernel: [ 1605] 0 1605 5385 8 0 0 0 atd
Jul 18 00:31:04 zetawiki kernel: [ 1624] 0 1624 15585 19 6 0 0 certmonger
Jul 18 00:31:04 zetawiki kernel: [ 1642] 0 1642 1016 10 0 0 0 mingetty
Jul 18 00:31:04 zetawiki kernel: [ 1644] 0 1644 1016 10 3 0 0 mingetty
Jul 18 00:31:04 zetawiki kernel: [ 1646] 0 1646 1016 10 5 0 0 mingetty
Jul 18 00:31:04 zetawiki kernel: [ 1648] 0 1648 1016 10 5 0 0 mingetty
Jul 18 00:31:04 zetawiki kernel: [ 1650] 0 1650 1016 10 5 0 0 mingetty
Jul 18 00:31:04 zetawiki kernel: [ 1652] 0 1652 1016 10 6 0 0 mingetty
Jul 18 00:31:04 zetawiki kernel: [ 1653] 0 1653 2740 11 0 -17 -1000 udevd
Jul 18 00:31:04 zetawiki kernel: [20047] 48 20047 106803 615 2 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [20180] 48 20180 107299 712 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [20193] 48 20193 105940 683 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [20268] 48 20268 104544 629 4 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [22042] 48 22042 105298 701 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [22142] 48 22142 105858 710 5 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25323] 48 25323 103860 919 4 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25324] 48 25324 101222 910 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25327] 48 25327 102390 756 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25328] 48 25328 102646 659 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25333] 48 25333 102582 934 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25335] 48 25335 102585 666 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25343] 48 25343 100917 977 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25344] 48 25344 102455 902 3 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25345] 48 25345 101877 759 7 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25346] 48 25346 102266 768 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25347] 48 25347 104886 741 2 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25348] 48 25348 103222 641 2 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25350] 48 25350 100733 976 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25351] 48 25351 101055 729 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25352] 48 25352 102311 697 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25354] 48 25354 101570 1114 4 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25360] 48 25360 100802 709 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25362] 48 25362 102168 717 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25364] 48 25364 99897 784 3 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25365] 48 25365 100761 782 2 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25367] 48 25367 100621 732 3 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25370] 48 25370 102856 713 4 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25372] 48 25372 103604 857 6 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25375] 48 25375 101902 758 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25377] 48 25377 104074 755 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25384] 48 25384 102214 761 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25385] 48 25385 102470 745 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25390] 48 25390 102516 732 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25409] 48 25409 101052 691 1 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25435] 48 25435 101553 958 5 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25436] 48 25436 101817 698 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25471] 48 25471 100778 792 4 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25475] 48 25475 101549 693 2 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25476] 48 25476 102391 717 1 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25479] 48 25479 101293 620 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25481] 48 25481 100400 865 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25482] 48 25482 101693 943 4 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25483] 48 25483 99751 674 5 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25484] 48 25484 100196 991 7 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25485] 48 25485 103033 656 6 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25486] 48 25486 100838 801 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25487] 48 25487 99751 598 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25488] 48 25488 100581 662 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25491] 48 25491 102384 635 2 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25492] 48 25492 100587 971 3 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25493] 48 25493 100203 770 6 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25494] 48 25494 99110 937 2 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25495] 48 25495 101040 713 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25496] 48 25496 99684 858 4 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25497] 48 25497 100324 738 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25498] 48 25498 99623 772 1 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25499] 48 25499 101240 762 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25500] 48 25500 99881 615 1 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25501] 48 25501 99945 756 2 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25502] 48 25502 99311 1369 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25503] 48 25503 100912 825 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25504] 48 25504 100076 1234 7 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25505] 48 25505 100526 1067 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25506] 48 25506 100902 748 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25508] 48 25508 101227 686 1 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25509] 48 25509 97319 828 1 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25510] 48 25510 101360 836 3 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25511] 48 25511 101451 855 1 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25512] 48 25512 100972 908 4 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25513] 48 25513 102158 1047 7 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25514] 48 25514 102327 761 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25515] 48 25515 101128 890 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25517] 48 25517 101710 716 6 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25518] 48 25518 101576 734 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25520] 48 25520 102538 1024 2 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25521] 48 25521 102521 881 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25522] 48 25522 101512 948 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25523] 48 25523 101036 773 2 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25525] 48 25525 99976 801 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25526] 48 25526 100038 837 7 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25527] 48 25527 101572 864 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25528] 48 25528 101382 767 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25530] 48 25530 103799 865 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25531] 48 25531 101486 729 4 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25532] 48 25532 101828 833 2 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25533] 48 25533 103608 788 2 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25534] 48 25534 101956 779 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25535] 48 25535 101416 709 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25536] 48 25536 103430 794 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25537] 48 25537 101444 721 2 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25538] 48 25538 103048 880 1 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25539] 48 25539 101060 843 6 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25540] 48 25540 102404 934 7 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25541] 48 25541 100804 750 1 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25542] 48 25542 101828 799 4 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25543] 48 25543 102197 963 5 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25546] 48 25546 103475 662 6 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25547] 48 25547 103608 767 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25548] 48 25548 102512 831 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25549] 48 25549 102198 909 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25550] 48 25550 103480 823 6 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25551] 48 25551 103672 743 4 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25552] 48 25552 102647 1080 6 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25553] 48 25553 103536 854 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25554] 48 25554 102704 899 3 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25555] 48 25555 103604 819 3 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25556] 48 25556 101480 1083 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25557] 48 25557 101107 914 5 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25558] 48 25558 102319 936 6 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25560] 48 25560 103932 980 4 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25561] 48 25561 103668 1625 6 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25562] 48 25562 102326 1090 4 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25563] 48 25563 103610 892 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25565] 48 25565 101872 783 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25566] 48 25566 103214 1935 7 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25567] 48 25567 103545 857 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25568] 48 25568 103155 1454 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25569] 48 25569 103527 2163 7 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25570] 48 25570 103601 3575 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25571] 48 25571 103418 4171 1 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25572] 48 25572 103993 2036 1 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25573] 48 25573 102579 1745 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25574] 48 25574 102520 5592 2 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25575] 48 25575 103413 3523 5 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25576] 48 25576 103545 3083 1 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25577] 48 25577 103412 5197 3 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25578] 48 25578 103669 1692 3 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25593] 48 25593 103481 1683 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25594] 48 25594 102567 2422 7 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25595] 48 25595 102392 1218 4 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25604] 48 25604 99509 2708 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25605] 48 25605 100459 2989 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25606] 48 25606 99943 2691 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25607] 48 25607 100007 3457 3 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25608] 48 25608 101616 6092 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25609] 48 25609 100007 3101 3 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25611] 48 25611 99890 3088 2 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25629] 48 25629 99885 3461 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25630] 48 25630 100203 4000 5 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25631] 48 25631 101748 4462 4 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25632] 48 25632 100709 5311 3 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25633] 48 25633 99404 3254 2 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25634] 48 25634 99815 3245 3 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25635] 48 25635 100346 3917 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25636] 48 25636 101559 3608 4 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25642] 48 25642 100837 5360 4 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25643] 48 25643 99470 4504 2 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25644] 48 25644 101040 4902 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25645] 48 25645 100198 4445 4 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25646] 48 25646 101485 6047 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25647] 48 25647 100978 4584 5 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25648] 48 25648 99340 3978 2 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25650] 48 25650 99916 4013 3 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25651] 48 25651 101104 4918 1 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25652] 48 25652 98577 4107 3 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25653] 48 25653 101364 5720 2 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25654] 48 25654 100139 4778 3 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25655] 48 25655 99852 4581 5 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25656] 48 25656 100517 5178 1 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25657] 48 25657 101094 7056 2 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25658] 48 25658 100078 4744 7 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25659] 48 25659 99815 4872 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25661] 48 25661 99660 5071 3 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25663] 48 25663 101266 6961 3 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25664] 48 25664 99622 5156 1 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25665] 48 25665 99820 5299 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25666] 48 25666 101737 7057 6 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25667] 48 25667 99725 5256 1 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25671] 48 25671 99916 5475 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25672] 48 25672 98577 4077 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25673] 48 25673 98828 4276 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25674] 48 25674 100492 6005 3 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25675] 48 25675 97482 3206 3 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25676] 48 25676 97740 3228 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25677] 48 25677 100110 5625 1 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25679] 48 25679 99276 5161 7 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25680] 48 25680 99543 5122 1 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25681] 48 25681 98579 4146 2 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25682] 48 25682 98431 4265 5 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25683] 48 25683 99404 4904 1 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25684] 48 25684 97740 3234 3 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25685] 48 25685 98577 4123 7 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25686] 48 25686 98579 4155 1 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25688] 48 25688 97742 3253 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25689] 48 25689 99812 5369 6 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25690] 48 25690 99916 5897 1 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25691] 48 25691 99535 5093 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25693] 48 25693 96332 1793 4 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25694] 48 25694 97740 3253 3 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25697] 48 25697 97740 3280 6 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25698] 48 25698 98640 4254 2 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25700] 48 25700 97740 3236 2 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25701] 48 25701 96208 1663 2 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25702] 48 25702 96654 2178 4 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25703] 48 25703 96337 1781 3 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25704] 48 25704 97484 3011 1 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25705] 48 25705 95758 1206 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25706] 48 25706 97742 3284 1 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25707] 48 25707 97548 3020 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25709] 48 25709 95758 1208 5 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25710] 48 25710 97548 3025 4 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25711] 48 25711 97740 3280 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25712] 48 25712 95820 1211 6 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25713] 48 25713 95428 808 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25714] 48 25714 95758 1209 7 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25715] 48 25715 95756 1211 3 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25716] 48 25716 95820 1208 1 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25717] 0 25717 16105 144 0 0 0 sshd
Jul 18 00:31:04 zetawiki kernel: [25718] 48 25718 95820 1200 3 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25719] 48 25719 95820 1217 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25720] 0 25720 16105 145 1 0 0 sshd
Jul 18 00:31:04 zetawiki kernel: [25723] 48 25723 95101 432 5 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25724] 0 25724 95067 408 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25725] 48 25725 95101 432 2 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25726] 48 25726 95101 426 3 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25727] 48 25727 95067 409 1 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25728] 48 25728 95067 424 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25729] 0 25729 728 12 0 0 0 sshd
Jul 18 00:31:04 zetawiki kernel: [25730] 48 25730 95101 431 1 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25731] 48 25731 95101 426 1 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25732] 0 25732 95067 405 6 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25733] 0 25733 95067 388 3 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25734] 48 25734 95067 410 0 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25735] 48 25735 95067 411 1 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25736] 0 25736 95067 385 2 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25737] 0 25737 95067 404 2 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25738] 0 25738 95068 405 1 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25739] 48 25739 95067 410 5 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25740] 0 25740 95067 404 6 0 0 httpd
Jul 18 00:31:04 zetawiki kernel: [25741] 0 25741 29332 24 1 0 0 crond
Jul 18 00:31:04 zetawiki kernel: [25742] 0 25742 29332 36 0 0 0 crond
Jul 18 00:31:04 zetawiki kernel: Out of memory: Kill process 1759 (varnishd) score 76 or sacrifice child
Jul 18 00:31:04 zetawiki kernel: Killed process 1759, UID 498, (varnishd) total-vm:1067052kB, anon-rss:41160kB, file-rss:82044kB
Jul 18 00:32:49 zetawiki kernel: httpd invoked oom-killer: gfp_mask=0x200da, order=0, oom_adj=0, oom_score_adj=0
Jul 18 00:33:49 zetawiki kernel: httpd cpuset=/ mems_allowed=0
Jul 18 00:33:50 zetawiki kernel: Pid: 25569, comm: httpd Not tainted 2.6.32-431.17.1.el6.x86_64 #1
Jul 18 00:33:50 zetawiki kernel: Call Trace:
Jul 18 00:33:50 zetawiki kernel: [<ffffffff810d0211>] ? cpuset_print_task_mems_allowed+0x91/0xb0
Jul 18 00:33:50 zetawiki kernel: [<ffffffff811225c0>] ? dump_header+0x90/0x1b0
Jul 18 00:33:50 zetawiki kernel: [<ffffffff8122761c>] ? security_real_capable_noaudit+0x3c/0x70
Jul 18 00:33:50 zetawiki kernel: [<ffffffff81122a42>] ? oom_kill_process+0x82/0x2a0
Jul 18 00:33:50 zetawiki kernel: [<ffffffff81122981>] ? select_bad_process+0xe1/0x120
Jul 18 00:33:50 zetawiki kernel: [<ffffffff81122e80>] ? out_of_memory+0x220/0x3c0
Jul 18 00:33:50 zetawiki kernel: [<ffffffff8112f79f>] ? __alloc_pages_nodemask+0x89f/0x8d0
Jul 18 00:33:50 zetawiki kernel: [<ffffffff8116779a>] ? alloc_pages_vma+0x9a/0x150
Jul 18 00:33:50 zetawiki kernel: [<ffffffff8115b472>] ? read_swap_cache_async+0xf2/0x160
Jul 18 00:33:50 zetawiki kernel: [<ffffffff8115bf99>] ? valid_swaphandles+0x69/0x150
Jul 18 00:33:50 zetawiki kernel: [<ffffffff8115b567>] ? swapin_readahead+0x87/0xc0
Jul 18 00:33:50 zetawiki kernel: [<ffffffff8114a83d>] ? handle_pte_fault+0x6dd/0xb00
Jul 18 00:33:50 zetawiki kernel: [<ffffffffa00c97b9>] ? ext4_check_acl+0x29/0x90 [ext4]
Jul 18 00:33:50 zetawiki kernel: [<ffffffff8114ae8a>] ? handle_mm_fault+0x22a/0x300
Jul 18 00:33:50 zetawiki kernel: [<ffffffff8114d846>] ? find_vma+0x46/0x80
Jul 18 00:33:50 zetawiki kernel: [<ffffffff8104a8d8>] ? __do_page_fault+0x138/0x480
Jul 18 00:33:50 zetawiki kernel: [<ffffffff81288bec>] ? rb_erase+0x1bc/0x310
Jul 18 00:33:50 zetawiki kernel: [<ffffffff8100988e>] ? __switch_to+0x26e/0x320
Jul 18 00:33:50 zetawiki kernel: [<ffffffff8100bb8e>] ? apic_timer_interrupt+0xe/0x20
Jul 18 00:33:50 zetawiki kernel: [<ffffffff8100bb8e>] ? apic_timer_interrupt+0xe/0x20
Jul 18 00:33:50 zetawiki kernel: [<ffffffff8152d73e>] ? do_page_fault+0x3e/0xa0
Jul 18 00:33:50 zetawiki kernel: [<ffffffff8152aaf5>] ? page_fault+0x25/0x30
Jul 18 00:33:50 zetawiki kernel: Mem-Info:
Jul 18 00:33:50 zetawiki kernel: Node 0 DMA per-cpu:
Jul 18 00:33:50 zetawiki kernel: CPU 0: hi: 0, btch: 1 usd: 0
Jul 18 00:33:50 zetawiki kernel: CPU 1: hi: 0, btch: 1 usd: 0
Jul 18 00:33:50 zetawiki kernel: CPU 2: hi: 0, btch: 1 usd: 0
Jul 18 00:33:50 zetawiki kernel: CPU 3: hi: 0, btch: 1 usd: 0
Jul 18 00:33:50 zetawiki kernel: CPU 4: hi: 0, btch: 1 usd: 0
Jul 18 00:33:50 zetawiki kernel: CPU 5: hi: 0, btch: 1 usd: 0
Jul 18 00:33:50 zetawiki kernel: CPU 6: hi: 0, btch: 1 usd: 0
Jul 18 00:33:50 zetawiki kernel: CPU 7: hi: 0, btch: 1 usd: 0
Jul 18 00:33:50 zetawiki kernel: Node 0 DMA32 per-cpu:
Jul 18 00:33:50 zetawiki kernel: CPU 0: hi: 186, btch: 31 usd: 74
Jul 18 00:33:50 zetawiki kernel: CPU 1: hi: 186, btch: 31 usd: 17
Jul 18 00:33:50 zetawiki kernel: CPU 2: hi: 186, btch: 31 usd: 72
Jul 18 00:33:50 zetawiki kernel: CPU 3: hi: 186, btch: 31 usd: 20
Jul 18 00:33:50 zetawiki kernel: CPU 4: hi: 186, btch: 31 usd: 43
Jul 18 00:33:50 zetawiki kernel: CPU 5: hi: 186, btch: 31 usd: 27
Jul 18 00:33:50 zetawiki kernel: CPU 6: hi: 186, btch: 31 usd: 88
Jul 18 00:33:50 zetawiki kernel: CPU 7: hi: 186, btch: 31 usd: 33
Jul 18 00:33:50 zetawiki kernel: active_anon:285820 inactive_anon:95819 isolated_anon:7008
Jul 18 00:33:50 zetawiki kernel: active_file:84 inactive_file:67 isolated_file:225
Jul 18 00:33:50 zetawiki kernel: unevictable:2080 dirty:0 writeback:279 unstable:0
Jul 18 00:33:50 zetawiki kernel: free:13486 slab_reclaimable:3787 slab_unreclaimable:17922
Jul 18 00:33:50 zetawiki kernel: mapped:3079 shmem:691 pagetables:45285 bounce:0
Jul 18 00:33:50 zetawiki kernel: Node 0 DMA free:8424kB min:332kB low:412kB high:496kB active_anon:2868kB inactive_anon:2884kB active_file:20kB inactive_file:
0kB unevictable:0kB isolated(anon):768kB isolated(file):0kB present:15348kB mlocked:0kB dirty:0kB writeback:40kB mapped:16kB shmem:12kB slab_reclaimable:48kB
slab_unreclaimable:184kB kernel_stack:8kB pagetables:484kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:12 all_unreclaimable? no
Jul 18 00:33:50 zetawiki kernel: lowmem_reserve[]: 0 2004 2004 2004
Jul 18 00:33:50 zetawiki kernel: Node 0 DMA32 free:45520kB min:44720kB low:55900kB high:67080kB active_anon:1140412kB inactive_anon:380392kB active_file:316kB
inactive_file:268kB unevictable:8320kB isolated(anon):27264kB isolated(file):900kB present:2052308kB mlocked:8320kB dirty:0kB writeback:1076kB mapped:12300kB
shmem:2752kB slab_reclaimable:15100kB slab_unreclaimable:71504kB kernel_stack:3624kB pagetables:180656kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scan
ned:2304 all_unreclaimable? no
Jul 18 00:33:50 zetawiki kernel: lowmem_reserve[]: 0 0 0 0
Jul 18 00:33:50 zetawiki kernel: Node 0 DMA: 38*4kB 15*8kB 11*16kB 7*32kB 11*64kB 5*128kB 3*256kB 3*512kB 2*1024kB 1*2048kB 0*4096kB = 8416kB
Jul 18 00:33:50 zetawiki kernel: Node 0 DMA32: 1254*4kB 867*8kB 255*16kB 120*32kB 28*64kB 61*128kB 27*256kB 12*512kB 3*1024kB 0*2048kB 0*4096kB = 45600kB
Jul 18 00:33:50 zetawiki kernel: 38913 total pagecache pages
Jul 18 00:33:50 zetawiki kernel: 35681 pages in swap cache
Jul 18 00:33:50 zetawiki kernel: Swap cache stats: add 3268594, delete 3232913, find 3089978/3325189
Jul 18 00:33:50 zetawiki kernel: Free swap = 0kB
Jul 18 00:33:50 zetawiki kernel: Total swap = 4128760kB
Jul 18 00:33:50 zetawiki kernel: 524284 pages RAM
Jul 18 00:33:50 zetawiki kernel: 43879 pages reserved
Jul 18 00:33:50 zetawiki kernel: 150252 pages shared
Jul 18 00:33:50 zetawiki kernel: 452276 pages non-shared
Jul 18 00:33:50 zetawiki kernel: [ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
Jul 18 00:33:50 zetawiki kernel: [ 510] 0 510 2741 10 0 -17 -1000 udevd
Jul 18 00:33:50 zetawiki kernel: [ 1209] 0 1209 23294 58 7 -17 -1000 auditd
... (생략)
Jul 18 01:36:45 zetawiki kernel: [26212] 0 26212 16911 95 3 0 0 sendmail
Jul 18 01:36:45 zetawiki kernel: [26213] 0 26213 3789 248 3 0 0 python
Jul 18 01:36:45 zetawiki kernel: [26216] 0 26216 4370 48 1 0 0 sshd
Jul 18 01:36:45 zetawiki kernel: [26217] 0 26217 2834 51 0 0 0 sshd
Jul 18 01:36:45 zetawiki kernel: Out of memory: Kill process 25548 (httpd) score 6 or sacrifice child
Jul 18 01:36:45 zetawiki kernel: Killed process 25548, UID 48, (httpd) total-vm:414152kB, anon-rss:4968kB, file-rss:84kB
Jul 18 07:55:15 zetawiki varnishd[1756]: Manager got SIGINT
2 Call Trace[ | ]
[root@zetawiki ~]# grep 'Call Trace' /var/log/messages
Jul 18 00:31:04 zetawiki kernel: Call Trace:
Jul 18 00:33:50 zetawiki kernel: Call Trace:
Jul 18 00:33:50 zetawiki kernel: Call Trace:
Jul 18 00:34:30 zetawiki kernel: Call Trace:
Jul 18 00:34:56 zetawiki kernel: Call Trace:
Jul 18 00:35:26 zetawiki kernel: Call Trace:
Jul 18 00:36:05 zetawiki kernel: Call Trace:
Jul 18 00:36:20 zetawiki kernel: Call Trace:
Jul 18 00:36:57 zetawiki kernel: Call Trace:
Jul 18 00:37:22 zetawiki kernel: Call Trace:
Jul 18 00:38:28 zetawiki kernel: Call Trace:
Jul 18 00:39:53 zetawiki kernel: Call Trace:
Jul 18 00:39:59 zetawiki kernel: Call Trace:
Jul 18 00:40:14 zetawiki kernel: Call Trace:
Jul 18 00:41:21 zetawiki kernel: Call Trace:
Jul 18 00:42:25 zetawiki kernel: Call Trace:
Jul 18 00:42:35 zetawiki kernel: Call Trace:
Jul 18 00:42:43 zetawiki kernel: Call Trace:
Jul 18 00:44:26 zetawiki kernel: Call Trace:
Jul 18 00:47:19 zetawiki kernel: Call Trace:
Jul 18 00:48:14 zetawiki kernel: Call Trace:
Jul 18 00:49:30 zetawiki kernel: Call Trace:
Jul 18 00:50:21 zetawiki kernel: Call Trace:
Jul 18 00:51:04 zetawiki kernel: Call Trace:
Jul 18 00:52:14 zetawiki kernel: Call Trace:
Jul 18 00:52:14 zetawiki kernel: Call Trace:
Jul 18 00:53:14 zetawiki kernel: Call Trace:
Jul 18 00:53:14 zetawiki kernel: Call Trace:
Jul 18 00:56:20 zetawiki kernel: Call Trace:
Jul 18 00:57:08 zetawiki kernel: Call Trace:
Jul 18 00:57:42 zetawiki kernel: Call Trace:
Jul 18 00:59:16 zetawiki kernel: Call Trace:
Jul 18 01:01:49 zetawiki kernel: Call Trace:
Jul 18 01:03:50 zetawiki kernel: Call Trace:
Jul 18 01:04:09 zetawiki kernel: Call Trace:
Jul 18 01:05:07 zetawiki kernel: Call Trace:
Jul 18 01:07:48 zetawiki kernel: Call Trace:
Jul 18 01:10:25 zetawiki kernel: Call Trace:
Jul 18 01:11:11 zetawiki kernel: Call Trace:
Jul 18 01:13:38 zetawiki kernel: Call Trace:
Jul 18 01:14:50 zetawiki kernel: Call Trace:
Jul 18 01:22:00 zetawiki kernel: Call Trace:
Jul 18 01:22:29 zetawiki kernel: Call Trace:
Jul 18 01:24:05 zetawiki kernel: Call Trace:
Jul 18 01:29:53 zetawiki kernel: Call Trace:
Jul 18 01:36:31 zetawiki kernel: Call Trace:
3 sar[ | ]
- sar
[root@zetawiki ~]# sar -s 00:00:00 -e 04:30:00
Linux 2.6.32-431.17.1.el6.x86_64 (zetawiki) 07/18/2015 _x86_64_ (8 CPU)
12:00:01 AM CPU %user %nice %system %iowait %steal %idle
12:10:01 AM all 1.96 0.00 0.15 0.02 0.00 97.87
12:20:03 AM all 1.78 0.00 0.19 0.02 0.00 98.01
01:31:06 AM all 0.92 0.00 4.48 78.24 0.00 16.36
01:40:49 AM all 0.38 0.00 1.53 64.38 0.00 33.72
01:50:44 AM all 0.60 0.00 0.99 87.04 0.00 11.38
02:00:59 AM all 0.56 0.00 0.85 88.40 0.00 10.20
02:11:14 AM all 0.93 0.00 0.90 83.52 0.00 14.65
02:20:24 AM all 1.05 0.00 0.94 85.53 0.00 12.48
02:30:15 AM all 1.06 0.00 1.04 86.02 0.00 11.88
02:40:14 AM all 0.85 0.00 0.95 80.10 0.00 18.11
02:50:14 AM all 0.90 0.00 0.86 71.81 0.00 26.43
03:00:09 AM all 0.41 0.00 0.87 76.53 0.00 22.19
03:10:45 AM all 0.08 0.00 0.38 75.20 0.00 24.34
03:20:01 AM all 1.29 0.05 0.45 11.82 0.00 86.38
03:30:02 AM all 2.91 0.00 0.44 10.10 0.00 86.55
03:40:02 AM all 3.01 0.00 0.51 3.67 0.00 92.81
03:50:01 AM all 0.02 0.00 0.02 0.10 0.00 99.86
04:00:01 AM all 0.02 0.00 0.03 0.09 0.00 99.87
04:10:01 AM all 0.02 0.00 0.03 0.07 0.00 99.89
04:20:01 AM all 0.02 0.00 0.03 0.04 0.00 99.91
Average: all 0.93 0.00 1.63 52.68 0.00 44.75
- sar -r
[root@zetawiki ~]# sar -r -s 00:00:00 -e 04:30:00
Linux 2.6.32-431.17.1.el6.x86_64 (zetawiki) 07/18/2015 _x86_64_ (8 CPU)
12:00:01 AM kbmemfree kbmemused %memused kbbuffers kbcached kbcommit %commit
12:10:01 AM 124508 1797112 93.52 134916 892708 1537740 25.42
12:20:03 AM 126724 1794896 93.41 135416 893580 1535436 25.38
01:31:06 AM 54992 1866628 97.14 1688 96708 6904580 114.12
01:40:49 AM 53096 1868524 97.24 2788 109628 6731492 111.26
01:50:44 AM 53188 1868432 97.23 2216 109112 6748272 111.53
02:00:59 AM 57352 1864268 97.02 1300 106908 6482264 107.14
02:11:14 AM 53192 1868428 97.23 1036 109180 5959164 98.49
02:20:24 AM 53496 1868124 97.22 844 107584 5269544 87.09
02:30:15 AM 53364 1868256 97.22 900 110124 4718240 77.98
02:40:14 AM 53552 1868068 97.21 1396 108768 4426820 73.17
02:50:14 AM 53136 1868484 97.23 724 104112 4412880 72.94
03:00:09 AM 73380 1848240 96.18 9280 97696 3850164 63.64
03:10:45 AM 259492 1662128 86.50 12988 98720 2303984 38.08
03:20:01 AM 222872 1698748 88.40 101560 799932 926916 15.32
03:30:02 AM 64452 1857168 96.65 74292 1079564 929268 15.36
03:40:02 AM 78604 1843016 95.91 77728 1083680 936188 15.47
03:50:01 AM 78596 1843024 95.91 78096 1083888 936216 15.47
04:00:01 AM 77860 1843760 95.95 78468 1083912 936560 15.48
04:10:01 AM 88804 1832816 95.38 78980 1085100 921420 15.23
04:20:01 AM 88176 1833444 95.41 79396 1085164 921420 15.23
Average: 88442 1833178 95.40 43701 512303 3369428 55.69
- sar -b
[root@zetawiki ~]# sar -b -s 00:00:00 -e 04:30:00
Linux 2.6.32-431.17.1.el6.x86_64 (zetawiki) 07/18/2015 _x86_64_ (8 CPU)
12:00:01 AM tps rtps wtps bread/s bwrtn/s
12:10:01 AM 3.43 0.56 2.88 14.22 27.86
12:20:03 AM 2.96 0.37 2.59 7.78 25.02
01:31:06 AM 3093.99 2119.96 974.03 37313.03 10665.55
01:40:49 AM 2966.96 2138.84 828.12 33173.65 8729.40
01:50:44 AM 2547.48 1977.27 570.20 28194.53 4750.94
02:00:59 AM 2602.10 2040.07 562.03 28590.45 4808.86
02:11:14 AM 2588.91 2002.04 586.88 28003.81 4963.56
02:20:24 AM 2695.84 2025.41 670.44 27817.64 5623.05
02:30:15 AM 2768.63 2109.00 659.63 28791.68 5655.82
02:40:14 AM 2651.86 2021.80 630.06 28212.11 5359.98
02:50:14 AM 2664.41 2027.90 636.50 28113.58 5536.10
03:00:09 AM 2643.26 2042.48 600.78 27777.98 5089.39
03:10:45 AM 948.45 816.28 132.17 9682.22 1155.17
03:20:01 AM 481.48 312.46 169.01 6968.23 2551.04
03:30:02 AM 567.40 176.98 390.43 9427.40 6140.34
03:40:02 AM 417.27 143.65 273.62 17225.67 4321.62
03:50:01 AM 1.22 0.07 1.15 0.98 9.91
04:00:01 AM 1.23 0.05 1.18 0.45 10.24
04:10:01 AM 1.77 0.18 1.59 8.30 14.46
04:20:01 AM 1.31 0.06 1.25 0.79 10.57
Average: 1823.63 1312.06 511.57 21318.08 5269.99
4 같이 보기[ | ]
- /var/log/messages
- sar
- restart_apache_and_varnish.sh
- kernel: httpd invoked oom-killer: gfp_mask=0x200da, order=0, oom_adj=0, oom_score_adj=0
5 참고[ | ]
로그인하시면 댓글을 쓸 수 있습니다.
{{ comment.name }}
{{ comment.created | snstime }}
-
{{comment.page_title}} ―{{comment.name}}