- SAP Community
- Products and Technology
- Technology
- Technology Q&A
- maxdb 7.8 going offline without any information wh...
- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Bookmark
- Subscribe
- Printer Friendly Page
- Report Inappropriate Content
maxdb 7.8 going offline without any information while users are logged in
- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Bookmark
- Subscribe
- Printer Friendly Page
- Report Inappropriate Content
on 01-18-2013 4:54 AM
Hello All
maxdb 7.8 going offline without any information while users are logged in the system. we have maxdb7.8 in sles11. i looked int he log files KLNMSGARC & KLNMSGOLD.
Anybody faced this issue, Could you please look into the log & help to resolve this.
Thanks in advance
KLNMSGARC:
Thread 0x4229 Task - 2013-01-11 11:09:52 ERR RTEKernel 102: Kernel exited without core and exit status 0x9,_FILE=RTEKernel_Termination+noPIC.cpp,_LINE=68 3
Thread 0x4229 Task - 2013-01-11 11:09:52 ERR RTEKernel 98: Kernel exited due to signal 9 (SIGKILL),_FILE=RTEKernel_Termination+noPIC.cpp,_LI NE=729
Thread 0x4229 Task - 2013-01-11 11:09:52 MsgOutput 28: ___ Stopping GMT 2013-01-11 05:39:52 7.8.01 Build 014-121-233-288
Thread - Task - 2013-01-11 11:11:18 MsgOutput 27: --- Starting GMT 2013-01-11 05:41:18 7.8.01 Build 014-121-233-288
Thread 0x327D Task 80 2013-01-11 11:11:32 AdminMsg 0: 50EFA60C001A 0000 RST RESTART
Thread 0x3280 Task 80 2013-01-11 11:12:14 AdminMsg 0: 50EFA636006B 0000 RST RETURNCODE 0;RESTART
Thread 0x325B Task - 2013-01-11 12:39:09 ERR RTEKernel 102: Kernel exited without core and exit status 0x9,_FILE=RTEKernel_Termination+noPIC.cpp,_LINE=68 3
Thread 0x325B Task - 2013-01-11 12:39:09 ERR RTEKernel 98: Kernel exited due to signal 9 (SIGKILL),_FILE=RTEKernel_Termination+noPIC.cpp,_LI NE=729
Thread 0x325B Task - 2013-01-11 12:39:10 MsgOutput 28: ___ Stopping GMT 2013-01-11 07:09:10 7.8.01 Build 014-121-233-288
Thread - Task - 2013-01-11 12:40:04 MsgOutput 27: --- Starting GMT 2013-01-11 07:10:04 7.8.01 Build 014-121-233-288
Thread 0x453E Task 81 2013-01-11 12:40:17 AdminMsg 0: 50EFBAD90018 0000 RST RESTART
Thread 0x453F Task 81 2013-01-11 12:41:07 AdminMsg 0: 50EFBB0B00BF 0000 RST RETURNCODE 0;RESTART
Thread 0x451B Task - 2013-01-11 13:14:57 ERR RTEKernel 102: Kernel exited without core and exit status 0x9,_FILE=RTEKernel_Termination+noPIC.cpp,_LINE=68 3
Thread 0x451B Task - 2013-01-11 13:14:57 ERR RTEKernel 98: Kernel exited due to signal 9 (SIGKILL),_FILE=RTEKernel_Termination+noPIC.cpp,_LI NE=729
Thread 0x451B Task - 2013-01-11 13:14:57 MsgOutput 28: ___ Stopping GMT 2013-01-11 07:44:57 7.8.01 Build 014-121-233-288
Thread - Task - 2013-01-11 13:20:08 MsgOutput 27: --- Starting GMT 2013-01-11 07:50:08 7.8.01 Build 014-121-233-288
Thread 0x4E7F Task 81 2013-01-11 13:20:22 AdminMsg 0: 50EFC43E0006 0000 RST RESTART
Thread 0x4E80 Task 81 2013-01-11 13:20:27 AdminMsg 0: 50EFC443000D 0000 RST RETURNCODE 0;RESTART
Thread 0x4E5D Task - 2013-01-11 16:28:07 ERR RTEKernel 102: Kernel exited without core and exit status 0x9,_FILE=RTEKernel_Termination+noPIC.cpp,_LINE=68 3
Thread 0x4E5D Task - 2013-01-11 16:28:07 ERR RTEKernel 98: Kernel exited due to signal 9 (SIGKILL),_FILE=RTEKernel_Termination+noPIC.cpp,_LI NE=729
Thread 0x4E5D Task - 2013-01-11 16:28:07 MsgOutput 28: ___ Stopping GMT 2013-01-11 10:58:07 7.8.01 Build 014-121-233-288
Thread - Task - 2013-01-11 16:29:34 MsgOutput 27: --- Starting GMT 2013-01-11 10:59:34 7.8.01 Build 014-121-233-288
Thread 0x7809 Task 80 2013-01-11 16:29:47 AdminMsg 0: 50EFF0A30022 0000 RST RESTART
Thread 0x780B Task 80 2013-01-11 16:30:19 AdminMsg 0: 50EFF0C3007B 0000 RST RETURNCODE 0;RESTART
Thread 0x77C9 Task - 2013-01-11 18:05:37 ERR RTEKernel 102: Kernel exited without core and exit status 0x9,_FILE=RTEKernel_Termination+noPIC.cpp,_LINE=68 3
Thread 0x77C9 Task - 2013-01-11 18:05:37 ERR RTEKernel 98: Kernel exited due to signal 9 (SIGKILL),_FILE=RTEKernel_Termination+noPIC.cpp,_LI NE=729
Thread 0x77C9 Task - 2013-01-11 18:05:37 MsgOutput 28: ___ Stopping GMT 2013-01-11 12:35:37 7.8.01 Build 014-121-233-288
Thread - Task - 2013-01-11 18:06:00 MsgOutput 27: --- Starting GMT 2013-01-11 12:36:00 7.8.01 Build 014-121-233-288
Thread 0xE37 Task 81 2013-01-11 18:06:14 AdminMsg 0: 50F0073E0010 0000 RST RESTART
Thread 0xE3A Task 81 2013-01-11 18:06:47 AdminMsg 0: 50F0075F008F 0000 RST RETURNCODE 0;RESTART
Thread 0xE14 Task - 2013-01-11 18:48:57 ERR RTEKernel 102: Kernel exited without core and exit status 0x9,_FILE=RTEKernel_Termination+noPIC.cpp,_LINE=68 3
Thread 0xE14 Task - 2013-01-11 18:48:57 ERR RTEKernel 98: Kernel exited due to signal 9 (SIGKILL),_FILE=RTEKernel_Termination+noPIC.cpp,_LI NE=729
Thread 0xE14 Task - 2013-01-11 18:48:57 MsgOutput 28: ___ Stopping GMT 2013-01-11 13:18:57 7.8.01 Build 014-121-233-288
Thread - Task - 2013-01-11 18:54:11 MsgOutput 27: --- Starting GMT 2013-01-11 13:24:11 7.8.01 Build 014-121-233-288
Thread 0x1852 Task 81 2013-01-11 18:54:26 AdminMsg 0: 50F0128A0004 0000 RST RESTART
Thread 0x1852 Task 81 2013-01-11 18:54:33 AdminMsg 0: 50F012910005 0000 RST RETURNCODE 0;RESTART
Thread 0x181D Task - 2013-01-15 21:47:40 ERR RTEKernel 102: Kernel exited without core and exit status 0x9,_FILE=RTEKernel_Termination+noPIC.cpp,_LINE=68 3
Thread 0x181D Task - 2013-01-15 21:47:40 ERR RTEKernel 98: Kernel exited due to signal 9 (SIGKILL),_FILE=RTEKernel_Termination+noPIC.cpp,_LI NE=729
Thread 0x181D Task - 2013-01-15 21:47:40 MsgOutput 28: ___ Stopping GMT 2013-01-15 16:17:40 7.8.01 Build 014-121-233-288
Thread - Task - 2013-01-15 22:34:26 MsgOutput 27: --- Starting GMT 2013-01-15 17:04:26 7.8.01 Build 014-121-233-288
Thread 0x6FE8 Task 81 2013-01-15 22:34:39 AdminMsg 0: 50F58C270004 0000 RST RESTART
Thread 0x6FEB Task 81 2013-01-15 22:35:22 AdminMsg 0: 50F58C520027 0000 RST RETURNCODE 0;RESTART
Thread 0x6FC6 Task - 2013-01-16 09:50:15 ERR RTEKernel 102: Kernel exited without core and exit status 0x9,_FILE=RTEKernel_Termination+noPIC.cpp,_LINE=68 3
Thread 0x6FC6 Task - 2013-01-16 09:50:15 ERR RTEKernel 98: Kernel exited due to signal 9 (SIGKILL),_FILE=RTEKernel_Termination+noPIC.cpp,_LI NE=729
Thread - Task - 2013-01-16 10:03:18 MsgOutput 27: --- Starting GMT 2013-01-16 04:33:18 7.8.01 Build 014-121-233-288
Thread 0x1844 Task 81 2013-01-16 10:03:35 AdminMsg 0: 50F62D9F0004 0000 RST RESTART
Thread 0x1845 Task 81 2013-01-16 10:04:17 AdminMsg 0: 50F62DC90005 0000 RST RETURNCODE 0;RESTART
KNLMSGOLD
---
Thread 0x6FE7 Task 1 2013-01-16 09:47:18 Savepoint 1: Savepoint (Time) started by T1
Thread 0x6FE4 Task 181 2013-01-16 09:47:18 Pager 20003: SVP(1) Start Write Data
Thread 0x6FE4 Task 181 2013-01-16 09:47:19 Pager 20004: SVP(1) Stop Data IO, Pages: 361 IO: 260
Thread 0x6FE4 Task 181 2013-01-16 09:47:19 Pager 20005: SVP(2) Wait for last synchronizing task: 181
Thread 0x6FE4 Task 181 2013-01-16 09:47:19 Pager 20006: SVP(2) Stop Wait for last synchronizing task, Pages: 0 IO: 0
Thread 0x6FE4 Task 181 2013-01-16 09:47:19 DataCache 4: Mark data pages for savepoint (prepare phase)
Thread 0x6FE4 Task 181 2013-01-16 09:47:19 Pager 20007: SVP(3) Start Write Data
Thread 0x6FE4 Task 181 2013-01-16 09:47:19 Pager 20008: SVP(3) Stop Data IO, Pages: 3 IO: 3
Thread 0x6FE4 Task 181 2013-01-16 09:47:19 Pager 20009: SVP(3) Start Write Converter
Thread 0x6FE4 Task 181 2013-01-16 09:47:19 Pager 20011: SVP(3) Stop Converter IO, Pages: 258 IO: 258
Thread 0x6FE4 Task 181 2013-01-16 09:47:19 DataCache 3: Savepoint with ID 13430 completed
Thread 0x6FC6 Task - 2013-01-16 09:50:15 RTEKernel 61: rtedump written to file 'rtedump'
Thread 0x6FC6 Task - 2013-01-16 09:50:15 ERR RTEKernel 102: Kernel exited without core and exit status 0x9,_FILE=RTEKernel_Termination+noPIC.cpp,_LINE=68 3
Thread 0x6FC6 Task - 2013-01-16 09:50:15 ERR RTEKernel 98: Kernel exited due to signal 9 (SIGKILL),_FILE=RTEKernel_Termination+noPIC.cpp,_LI NE=729
Thread 0x6FC6 Task - 2013-01-16 09:50:15 RTEKernel 58: Backup of diagnostic files will be forced at next restart
Thread 0x6FC6 Task - 2013-01-16 09:50:15 RTEKernel 107: Flushing knltrace pages (emergency)
- SAP Managed Tags:
- SAP MaxDB
Accepted Solutions (1)
Accepted Solutions (1)
- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Report Inappropriate Content
Hi,
please check as root '/var/log/messages', if the database kernel was killed by the Linux operating system. This can happen, if the Linux OS runs out of memory - it then starts a so called 'oom killer' program which identifies suitable processes to kill. As the MaxDB kernel usually allocates a lot of memory (depends on the CACHE_SIZE setting), it is a likely candidate for termination.
If this was indeed the oom killer, you should find some hint in the 'messages' file like:
/var/log/messages
kernel: [33872.707196] Out of memory: kill process 17092 (kernel)
score 958925227 or a child
kernel: [33872.707199] Killed process 17095 (kernel)
If you are an SAP customer, you can find further info in note 1647204.
Thorsten
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Report Inappropriate Content
Hello Thorsten
Thanks for your reply. i found the log file & pasted the 2 files (under /var/log/messages and KNLMSGARC) below. could you please tell me is this related to memory issue. if so, we are using the system under vmware, so that we could increase the memory for the particular system.
/var/log/messages
Jan 17 00:00:01 iwsred1 /usr/sbin/cron[26775]: (root) CMD ([ -x /usr/lib64/sa/sa1 ] && exec /usr/lib64/sa/sa1 -S ALL 1 1)
Jan 17 00:03:09 iwsred1 syslog-ng[1361]: Log statistics; dropped='pipe(/dev/xconsole)=0', dropped='pipe(/dev/tty10)=0', processed='center(queued)=8984', processed='center(received)=4310', processed='destination(messages)=4303', processed='destination(mailinfo)=1', processed='destination(mailwarn)=0', processed='destination(localmessages)=1', processed='destination(newserr)=0', processed='destination(mailerr)=2', processed='destination(netmgm)=0', processed='destination(warn)=1562', processed='destination(console)=1554', processed='destination(null)=2', processed='destination(mail)=3', processed='destination(xconsole)=1554', processed='destination(firewall)=0', processed='destination(acpid)=2', processed='destination(newscrit)=0', processed='destination(newsnotice)=0', processed='source(src)=4310'
Jan 17 00:10:01 iwsred1 /usr/sbin/cron[27302]: (root) CMD ([ -x /usr/lib64/sa/sa1 ] && exec /usr/lib64/sa/sa1 -S ALL 1 1)
Jan 17 00:20:01 iwsred1 /usr/sbin/cron[27831]: (root) CMD ([ -x /usr/lib64/sa/sa1 ] && exec /usr/lib64/sa/sa1 -S ALL 1 1)
Jan 17 00:30:01 iwsred1 /usr/sbin/cron[28334]: (root) CMD ([ -x /usr/lib64/sa/sa1 ] && exec /usr/lib64/sa/sa1 -S ALL 1 1)
Jan 17 00:40:01 iwsred1 /usr/sbin/cron[28861]: (root) CMD ([ -x /usr/lib64/sa/sa1 ] && exec /usr/lib64/sa/sa1 -S ALL 1 1)
Jan 17 00:50:01 iwsred1 /usr/sbin/cron[29390]: (root) CMD ([ -x /usr/lib64/sa/sa1 ] && exec /usr/lib64/sa/sa1 -S ALL 1 1)
Jan 17 01:00:01 iwsred1 /usr/sbin/cron[29900]: (root) CMD ([ -x /usr/lib64/sa/sa1 ] && exec /usr/lib64/sa/sa1 -S ALL 1 1)
Jan 17 01:01:35 iwsred1 kernel: [53919.564676] kernel invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0, oom_score_adj=0
Jan 17 01:01:35 iwsred1 kernel: [53919.564687] kernel cpuset=/ mems_allowed=0
Jan 17 01:01:35 iwsred1 kernel: [53919.564689] Pid: 11529, comm: kernel Not tainted 3.0.13-0.27-default #1
Jan 17 01:01:35 iwsred1 kernel: [53919.564691] Call Trace:
Jan 17 01:01:35 iwsred1 kernel: [53919.564711] [<ffffffff810048b5>] dump_trace+0x75/0x300
Jan 17 01:01:35 iwsred1 kernel: [53919.564717] [<ffffffff8143ea0f>] dump_stack+0x69/0x6f
Jan 17 01:01:35 iwsred1 kernel: [53919.564724] [<ffffffff810f2b6f>] dump_header+0x8f/0x1f0
Jan 17 01:01:35 iwsred1 kernel: [53919.564736] [<ffffffff810f3235>] oom_kill_process+0x95/0x180
Jan 17 01:01:35 iwsred1 kernel: [53919.564740] [<ffffffff810f346c>] out_of_memory+0x14c/0x230
Jan 17 01:01:35 iwsred1 kernel: [53919.564744] [<ffffffff810f8efb>] __alloc_pages_slowpath+0x7ab/0x7f0
Jan 17 01:01:35 iwsred1 kernel: [53919.564756] [<ffffffff810f90f1>] __alloc_pages_nodemask+0x1b1/0x1c0
Jan 17 01:01:35 iwsred1 kernel: [53919.564767] [<ffffffff811312b5>] alloc_pages_current+0xa5/0x120
Jan 17 01:01:35 iwsred1 kernel: [53919.564772] [<ffffffff810f08f2>] filemap_fault+0x172/0x3d0
Jan 17 01:01:35 iwsred1 kernel: [53919.564776] [<ffffffff8111916a>] __do_fault+0x7a/0x5d0
Jan 17 01:01:35 iwsred1 kernel: [53919.564780] [<ffffffff8111975d>] handle_pte_fault+0x9d/0x230
Jan 17 01:01:35 iwsred1 kernel: [53919.564784] [<ffffffff81445327>] do_page_fault+0x207/0x4c0
Jan 17 01:01:35 iwsred1 kernel: [53919.564788] [<ffffffff81442065>] page_fault+0x25/0x30
Jan 17 01:01:35 iwsred1 kernel: [53919.565610] DWARF2 unwinder stuck at page_fault+0x25/0x30
Jan 17 01:01:35 iwsred1 kernel: [53919.565611]
Jan 17 01:01:35 iwsred1 kernel: [53919.565612] Leftover inexact backtrace:
Jan 17 01:01:35 iwsred1 kernel: [53919.565613]
Jan 17 01:01:35 iwsred1 kernel: [53919.565615] Mem-Info:
Jan 17 01:01:35 iwsred1 kernel: [53919.565617] Node 0 DMA per-cpu:
Jan 17 01:01:35 iwsred1 kernel: [53919.565619] CPU 0: hi: 0, btch: 1 usd: 0
Jan 17 01:01:35 iwsred1 kernel: [53919.565621] CPU 1: hi: 0, btch: 1 usd: 0
Jan 17 01:01:35 iwsred1 kernel: [53919.565622] CPU 2: hi: 0, btch: 1 usd: 0
Jan 17 01:01:35 iwsred1 kernel: [53919.565624] CPU 3: hi: 0, btch: 1 usd: 0
Jan 17 01:01:35 iwsred1 kernel: [53919.565625] CPU 4: hi: 0, btch: 1 usd: 0
Jan 17 01:01:35 iwsred1 kernel: [53919.565627] CPU 5: hi: 0, btch: 1 usd: 0
Jan 17 01:01:35 iwsred1 kernel: [53919.565628] Node 0 DMA32 per-cpu:
Jan 17 01:01:35 iwsred1 kernel: [53919.565630] CPU 0: hi: 186, btch: 31 usd: 0
Jan 17 01:01:35 iwsred1 kernel: [53919.565632] CPU 1: hi: 186, btch: 31 usd: 0
Jan 17 01:01:35 iwsred1 kernel: [53919.565633] CPU 2: hi: 186, btch: 31 usd: 142
Jan 17 01:01:35 iwsred1 kernel: [53919.565635] CPU 3: hi: 186, btch: 31 usd: 0
Jan 17 01:01:35 iwsred1 kernel: [53919.565637] CPU 4: hi: 186, btch: 31 usd: 0
Jan 17 01:01:35 iwsred1 kernel: [53919.565638] CPU 5: hi: 186, btch: 31 usd: 0
Jan 17 01:01:35 iwsred1 kernel: [53919.565639] Node 0 Normal per-cpu:
Jan 17 01:01:35 iwsred1 kernel: [53919.565641] CPU 0: hi: 186, btch: 31 usd: 59
Jan 17 01:01:35 iwsred1 kernel: [53919.565643] CPU 1: hi: 186, btch: 31 usd: 0
Jan 17 01:01:35 iwsred1 kernel: [53919.565644] CPU 2: hi: 186, btch: 31 usd: 159
Jan 17 01:01:35 iwsred1 kernel: [53919.565646] CPU 3: hi: 186, btch: 31 usd: 17
Jan 17 01:01:35 iwsred1 kernel: [53919.565647] CPU 4: hi: 186, btch: 31 usd: 26
Jan 17 01:01:35 iwsred1 kernel: [53919.565649] CPU 5: hi: 186, btch: 31 usd: 1
Jan 17 01:01:35 iwsred1 kernel: [53919.565652] active_anon:1256026 inactive_anon:86959 isolated_anon:0
Jan 17 01:01:35 iwsred1 kernel: [53919.565653] active_file:0 inactive_file:1919 isolated_file:103
Jan 17 01:01:35 iwsred1 kernel: [53919.565654] unevictable:0 dirty:0 writeback:0 unstable:0
Jan 17 01:01:35 iwsred1 kernel: [53919.565655] free:28823 slab_reclaimable:3966 slab_unreclaimable:8613
Jan 17 01:01:35 iwsred1 kernel: [53919.565656] mapped:534923 shmem:687094 pagetables:14564 bounce:0
Jan 17 01:01:35 iwsred1 kernel: [53919.565658] Node 0 DMA free:15908kB min:84kB low:104kB high:124kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15684kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
Jan 17 01:01:35 iwsred1 kernel: [53919.565666] lowmem_reserve[]: 0 3768 11816 11816
Jan 17 01:01:35 iwsred1 kernel: [53919.565669] Node 0 DMA32 free:53576kB min:21520kB low:26900kB high:32280kB active_anon:3401600kB inactive_anon:207144kB active_file:8kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3858656kB mlocked:0kB dirty:0kB writeback:0kB mapped:1617712kB shmem:1900012kB slab_reclaimable:7532kB slab_unreclaimable:4772kB kernel_stack:1008kB pagetables:25632kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:2808 all_unreclaimable? yes
Jan 17 01:01:35 iwsred1 kernel: [53919.565678] lowmem_reserve[]: 0 0 8048 8048
Jan 17 01:01:35 iwsred1 kernel: [53919.565681] Node 0 Normal free:45808kB min:45972kB low:57464kB high:68956kB active_anon:1622504kB inactive_anon:140692kB active_file:0kB inactive_file:7784kB unevictable:0kB isolated(anon):0kB isolated(file):412kB present:2093504kB mlocked:0kB dirty:0kB writeback:0kB mapped:521980kB shmem:848364kB slab_reclaimable:8332kB slab_unreclaimable:29680kB kernel_stack:2832kB pagetables:32624kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:704 all_unreclaimable? yes
Jan 17 01:01:35 iwsred1 kernel: [53919.565690] lowmem_reserve[]: 0 0 0 0
Jan 17 01:01:35 iwsred1 kernel: [53919.565692] Node 0 DMA: 1*4kB 0*8kB 0*16kB 1*32kB 2*64kB 1*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15908kB
Jan 17 01:01:35 iwsred1 kernel: [53919.565699] Node 0 DMA32: 1817*4kB 1064*8kB 567*16kB 198*32kB 59*64kB 30*128kB 8*256kB 3*512kB 5*1024kB 1*2048kB 1*4096kB = 53652kB
Jan 17 01:01:35 iwsred1 kernel: [53919.565705] Node 0 Normal: 767*4kB 519*8kB 266*16kB 140*32kB 68*64kB 18*128kB 8*256kB 25*512kB 8*1024kB 0*2048kB 0*4096kB = 45652kB
Jan 17 01:01:35 iwsred1 kernel: [53919.565712] 689127 total pagecache pages
Jan 17 01:01:35 iwsred1 kernel: [53919.565713] 0 pages in swap cache
Jan 17 01:01:35 iwsred1 kernel: [53919.565715] Swap cache stats: add 0, delete 0, find 0/0
Jan 17 01:01:35 iwsred1 kernel: [53919.565716] Free swap = 0kB
Jan 17 01:01:35 iwsred1 kernel: [53919.565717] Total swap = 0kB
Jan 17 01:01:36 iwsred1 kernel: [53919.590226] 3071984 pages RAM
Jan 17 01:01:36 iwsred1 kernel: [53919.590228] 1632463 pages reserved
Jan 17 01:01:36 iwsred1 kernel: [53919.590229] 2309784 pages shared
Jan 17 01:01:36 iwsred1 kernel: [53919.590230] 866355 pages non-shared
Jan 17 01:01:36 iwsred1 kernel: [53919.590231] [ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
Jan 17 01:01:36 iwsred1 kernel: [53919.590245] [ 427] 0 427 4250 132 0 -17 -1000 udevd
Jan 17 01:01:36 iwsred1 kernel: [53919.590250] [ 1328] 0 1328 998 28 4 0 0 acpid
Jan 17 01:01:36 iwsred1 kernel: [53919.590255] [ 1343] 100 1343 5396 139 3 0 0 dbus-daemon
Jan 17 01:01:36 iwsred1 kernel: [53919.590259] [ 1361] 0 1361 4955 227 0 0 0 syslog-ng
Jan 17 01:01:36 iwsred1 kernel: [53919.590263] [ 1364] 0 1364 1065 89 3 0 0 klogd
Jan 17 01:01:36 iwsred1 kernel: [53919.590266] [ 1518] 101 1518 8520 212 0 0 0 hald
Jan 17 01:01:36 iwsred1 kernel: [53919.590271] [ 1521] 0 1521 27277 224 4 0 0 console-kit-dae
Jan 17 01:01:36 iwsred1 kernel: [53919.590275] [ 1522] 0 1522 4505 55 4 0 0 hald-runner
Jan 17 01:01:36 iwsred1 kernel: [53919.590279] [ 1617] 0 1617 8690 79 0 0 0 hald-addon-inpu
Jan 17 01:01:36 iwsred1 kernel: [53919.590283] [ 1642] 101 1642 9129 79 1 0 0 hald-addon-acpi
Jan 17 01:01:36 iwsred1 kernel: [53919.590287] [ 2449] 0 2449 7409 61 0 -17 -1000 auditd
Jan 17 01:01:36 iwsred1 kernel: [53919.590290] [ 2451] 0 2451 3606 38 0 0 0 audispd
Jan 17 01:01:36 iwsred1 kernel: [53919.590294] [ 2511] 0 2511 2059 1064 0 0 0 haveged
Jan 17 01:01:36 iwsred1 kernel: [53919.590298] [ 2554] 0 2554 4724 52 0 0 0 rpcbind
Jan 17 01:01:36 iwsred1 kernel: [53919.590302] [ 2636] 0 2636 4249 131 2 -17 -1000 udevd
Jan 17 01:01:36 iwsred1 kernel: [53919.590306] [ 2638] 0 2638 4249 131 1 -17 -1000 udevd
Jan 17 01:01:36 iwsred1 kernel: [53919.590310] [ 3145] 0 3145 82346 200 0 0 0 collectd
Jan 17 01:01:36 iwsred1 kernel: [53919.590313] [ 3169] 0 3169 2277 40 0 0 0 irqbalance
Jan 17 01:01:36 iwsred1 kernel: [53919.590317] [ 3184] 0 3184 6882 107 1 0 0 mcelog
Jan 17 01:01:36 iwsred1 kernel: [53919.590321] [ 3488] 0 3488 17296 174 0 -17 -1000 sshd
Jan 17 01:01:36 iwsred1 kernel: [53919.590325] [ 3502] 0 3502 17902 226 0 0 0 cupsd
Jan 17 01:01:36 iwsred1 kernel: [53919.590329] [ 3520] 0 3520 10269 183 0 0 0 saphostexec
Jan 17 01:01:36 iwsred1 kernel: [53919.590333] [ 3599] 1004 3599 54673 18100 0 0 0 sapstartsrv
Jan 17 01:01:36 iwsred1 kernel: [53919.590337] [ 3894] 1001 3894 86236 9698 0 0 0 sapstartsrv
Jan 17 01:01:36 iwsred1 kernel: [53919.590341] [ 4156] 1005 4156 50301 5684 4 0 0 sapstartsrv
Jan 17 01:01:36 iwsred1 kernel: [53919.590345] [ 4173] 0 4173 59598 99 0 0 0 nscd
Jan 17 01:01:36 iwsred1 kernel: [53919.590348] [ 5029] 1005 5029 11049 293 3 0 0 sapstart
Jan 17 01:01:36 iwsred1 kernel: [53919.590352] [ 5184] 0 5184 16711 162 3 0 0 gdm
Jan 17 01:01:36 iwsred1 kernel: [53919.590356] [ 5377] 0 5377 3697 38 0 0 0 cron
Jan 17 01:01:36 iwsred1 kernel: [53919.590360] [ 5386] 0 5386 13545 294 0 0 0 gdm-simple-slav
Jan 17 01:01:36 iwsred1 kernel: [53919.590363] [ 5445] 0 5445 29655 5329 0 0 0 X
Jan 17 01:01:36 iwsred1 kernel: [53919.590367] [ 5475] 0 5475 1121 29 1 0 0 mingetty
Jan 17 01:01:36 iwsred1 kernel: [53919.590371] [ 5476] 0 5476 1121 29 2 0 0 mingetty
Jan 17 01:01:36 iwsred1 kernel: [53919.590375] [ 5477] 0 5477 1121 29 5 0 0 mingetty
Jan 17 01:01:36 iwsred1 kernel: [53919.590379] [ 5478] 0 5478 1121 28 5 0 0 mingetty
Jan 17 01:01:36 iwsred1 kernel: [53919.590384] [ 5479] 0 5479 1121 29 4 0 0 mingetty
Jan 17 01:01:36 iwsred1 kernel: [53919.590388] [ 5480] 0 5480 1121 29 5 0 0 mingetty
Jan 17 01:01:36 iwsred1 kernel: [53919.590392] [ 5482] 1005 5482 16391 3224 0 0 0 jc.sapDAA_SMDA9
Jan 17 01:01:36 iwsred1 kernel: [53919.590396] [ 6039] 1005 6039 242560 55764 2 0 0 jstart
Jan 17 01:01:36 iwsred1 kernel: [53919.590400] [ 6053] 1002 6053 5432 76 0 0 0 vserver
Jan 17 01:01:36 iwsred1 kernel: [53919.590404] [ 6054] 1002 6054 5432 76 0 0 0 vserver
Jan 17 01:01:36 iwsred1 kernel: [53919.590408] [ 6057] 1002 6057 9792 210 0 0 0 niserver
Jan 17 01:01:36 iwsred1 kernel: [53919.590412] [ 6060] 1002 6060 9865 218 2 0 0 vserver
Jan 17 01:01:36 iwsred1 kernel: [53919.590416] [ 6062] 1002 6062 5485 79 0 0 0 vserver
Jan 17 01:01:36 iwsred1 kernel: [53919.590420] [ 6107] 109 6107 5548 55 5 0 0 dbus-launch
Jan 17 01:01:36 iwsred1 kernel: [53919.590424] [ 6122] 0 6122 12689 5174 1 0 0 saposcol
Jan 17 01:01:36 iwsred1 kernel: [53919.590428] [ 6347] 102 6347 1514 26 3 0 0 uuidd
Jan 17 01:01:36 iwsred1 kernel: [53919.590431] [ 8174] 1001 8174 11045 298 0 0 0 sapstart
Jan 17 01:01:36 iwsred1 kernel: [53919.590435] [ 8202] 1001 8202 19615 6528 0 0 0 ms.sapED1_DVEBM
Jan 17 01:01:36 iwsred1 kernel: [53919.590439] [ 8203] 1001 8203 1293008 16140 3 0 0 ED1_00_DP
Jan 17 01:01:36 iwsred1 kernel: [53919.590443] [ 8204] 1001 8204 12407 271 0 0 0 ig.sapED1_DVEBM
Jan 17 01:01:36 iwsred1 kernel: [53919.590447] [ 8209] 1001 8209 93620 4783 0 0 0 igsmux_mt
Jan 17 01:01:36 iwsred1 kernel: [53919.590450] [ 8210] 1001 8210 77231 6165 0 0 0 igspw_mt
Jan 17 01:01:36 iwsred1 kernel: [53919.590454] [ 8211] 1001 8211 77231 6230 3 0 0 igspw_mt
Jan 17 01:01:36 iwsred1 kernel: [53919.590458] [ 8275] 1001 8275 97105 16684 0 0 0 gwrd
Jan 17 01:01:36 iwsred1 kernel: [53919.590462] [ 8276] 1001 8276 168176 24481 5 0 0 icman
Jan 17 01:01:36 iwsred1 kernel: [53919.590466] [ 8282] 1001 8282 1486172 17968 1 0 0 ED1_00_DIA_W5
Jan 17 01:01:36 iwsred1 kernel: [53919.590469] [ 8288] 1001 8288 1483402 10957 5 0 0 ED1_00_ENQ_W11
Jan 17 01:01:36 iwsred1 kernel: [53919.590473] [ 8289] 1001 8289 1484314 14157 1 0 0 ED1_00_BTC_W12
Jan 17 01:01:36 iwsred1 kernel: [53919.590477] [ 8290] 1001 8290 1485809 34679 0 0 0 ED1_00_BTC_W13
Jan 17 01:01:36 iwsred1 kernel: [53919.590480] [ 8291] 1001 8291 1485063 26990 3 0 0 ED1_00_BTC_W14
Jan 17 01:01:36 iwsred1 kernel: [53919.590484] [ 8292] 1001 8292 1484033 20573 1 0 0 ED1_00_SPO_W15
Jan 17 01:01:36 iwsred1 kernel: [53919.590488] [ 8294] 1001 8294 1484095 15298 3 0 0 ED1_00_UP2_W16
Jan 17 01:01:36 iwsred1 kernel: [53919.590492] [19516] 1001 19516 7701 1748 1 0 0 sapxpg
Jan 17 01:01:36 iwsred1 kernel: [53919.590495] [19517] 1001 19517 12470 1960 0 0 0 dbmrfc
Jan 17 01:01:36 iwsred1 kernel: [53919.590499] [19528] 1002 19528 15893 4797 0 0 0 dbmsrv
Jan 17 01:01:36 iwsred1 kernel: [53919.590503] [24890] 0 24890 25130 236 2 0 0 gdm-session-wor
Jan 17 01:01:36 iwsred1 kernel: [53919.590507] [25073] 0 25073 39581 437 0 0 0 gnome-session
Jan 17 01:01:36 iwsred1 kernel: [53919.590511] [25143] 0 25143 4178 57 0 0 0 gpg-agent
Jan 17 01:01:36 iwsred1 kernel: [53919.590514] [25144] 0 25144 13504 144 0 0 0 ssh-agent
Jan 17 01:01:36 iwsred1 kernel: [53919.590518] [25150] 0 25150 5548 56 0 0 0 dbus-launch
Jan 17 01:01:36 iwsred1 kernel: [53919.590522] [25151] 0 25151 3428 150 0 0 0 dbus-daemon
Jan 17 01:01:36 iwsred1 kernel: [53919.590526] [25154] 0 25154 9887 708 0 0 0 gconfd-2
Jan 17 01:01:36 iwsred1 kernel: [53919.590530] [25167] 0 25167 90774 924 1 0 0 gnome-settings-
Jan 17 01:01:36 iwsred1 kernel: [53919.590533] [25168] 0 25168 40197 195 2 0 0 gnome-keyring-d
Jan 17 01:01:36 iwsred1 kernel: [53919.590537] [25174] 0 25174 10940 102 1 0 0 gvfsd
Jan 17 01:01:36 iwsred1 kernel: [53919.590541] [25179] 0 25179 35289 166 1 0 0 gvfs-fuse-daemo
Jan 17 01:01:36 iwsred1 kernel: [53919.590545] [25184] 0 25184 38550 1015 4 0 0 metacity
Jan 17 01:01:36 iwsred1 kernel: [53919.590549] [25189] 0 25189 93102 1630 0 0 0 gnome-panel
Jan 17 01:01:36 iwsred1 kernel: [53919.590552] [25191] 0 25191 110643 2108 0 0 0 nautilus
Jan 17 01:01:36 iwsred1 kernel: [53919.590556] [25193] 0 25193 53013 749 0 0 0 bonobo-activati
Jan 17 01:01:36 iwsred1 kernel: [53919.590560] [25202] 0 25202 81491 1301 0 0 0 main-menu
Jan 17 01:01:36 iwsred1 kernel: [53919.590564] [25204] 0 25204 12082 112 0 0 0 gvfsd-trash
Jan 17 01:01:36 iwsred1 kernel: [53919.590567] [25210] 0 25210 13539 166 0 0 0 gvfs-hal-volume
Jan 17 01:01:36 iwsred1 kernel: [53919.590571] [25212] 0 25212 15703 193 1 0 0 gvfs-gphoto2-vo
Jan 17 01:01:36 iwsred1 kernel: [53919.590575] [25221] 0 25221 56944 2606 5 0 0 python
Jan 17 01:01:36 iwsred1 kernel: [53919.590578] [25227] 0 25227 75463 755 0 0 0 gnome-volume-co
Jan 17 01:01:36 iwsred1 kernel: [53919.590582] [25231] 0 25231 10961 95 5 0 0 gvfsd-burn
Jan 17 01:01:36 iwsred1 kernel: [53919.590586] [25254] 0 25254 48186 275 5 0 0 pulseaudio
Jan 17 01:01:36 iwsred1 kernel: [53919.590589] [25255] 0 25255 57562 910 0 0 0 gnome-power-man
Jan 17 01:01:36 iwsred1 kernel: [53919.590593] [25263] 0 25263 38021 429 0 0 0 gnome-screensav
Jan 17 01:01:36 iwsred1 kernel: [53919.590597] [25272] 0 25272 9271 100 0 0 0 gvfsd-metadata
Jan 17 01:01:36 iwsred1 kernel: [53919.590600] [ 512] 0 512 15327 148 0 0 0 gvfsd-network
Jan 17 01:01:36 iwsred1 kernel: [53919.590604] [ 517] 0 517 13086 119 0 0 0 gvfsd-dnssd
Jan 17 01:01:36 iwsred1 kernel: [53919.590608] [ 657] 0 657 27484 419 5 0 0 gvfsd-smb-brows
Jan 17 01:01:36 iwsred1 kernel: [53919.590612] [ 2513] 1001 2513 1490928 260646 1 0 0 ED1_00_DIA_W3
Jan 17 01:01:36 iwsred1 kernel: [53919.590615] [ 2848] 1001 2848 1488168 75809 1 0 0 ED1_00_DIA_W8
Jan 17 01:01:36 iwsred1 kernel: [53919.590619] [ 5467] 1001 5467 1492993 208298 0 0 0 ED1_00_DIA_W7
Jan 17 01:01:36 iwsred1 kernel: [53919.590623] [ 5722] 1001 5722 1487020 115768 5 0 0 ED1_00_DIA_W0
Jan 17 01:01:36 iwsred1 kernel: [53919.590628] [ 5827] 1001 5827 1491725 423715 2 0 0 ED1_00_DIA_W9
Jan 17 01:01:36 iwsred1 kernel: [53919.590632] [10849] 1001 10849 1491425 218091 2 0 0 ED1_00_DIA_W4
Jan 17 01:01:36 iwsred1 kernel: [53919.590636] [11137] 1001 11137 1492571 329586 5 0 0 ED1_00_DIA_W2
Jan 17 01:01:36 iwsred1 kernel: [53919.590640] [11246] 1001 11246 1491646 352858 0 0 0 ED1_00_DIA_W6
Jan 17 01:01:36 iwsred1 kernel: [53919.590645] [11355] 1001 11355 1491329 294961 0 0 0 ED1_00_DIA_W1
Jan 17 01:01:36 iwsred1 kernel: [53919.590649] [11494] 1002 11494 25726 4066 0 0 0 kernel
Jan 17 01:01:36 iwsred1 kernel: [53919.590652] [11497] 1002 11497 389544 304476 0 0 0 kernel
Jan 17 01:01:36 iwsred1 kernel: [53919.590657] [16217] 1001 16217 1485725 18835 2 0 0 ED1_00_UPD_W10
Jan 17 01:01:36 iwsred1 kernel: [53919.590661] Out of memory: Kill process 5827 (ED1_00_DIA_W9) score 295 or sacrifice child
Jan 17 01:01:36 iwsred1 kernel: [53919.590665] Killed process 5827 (ED1_00_DIA_W9) total-vm:5966900kB, anon-rss:66848kB, file-rss:1628012kB
Jan 17 01:01:53 iwsred1 kernel: [53937.183841] igspw_mt invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0, oom_score_adj=0
Jan 17 01:01:53 iwsred1 kernel: [53937.183846] igspw_mt cpuset=/ mems_allowed=0
Jan 17 01:01:53 iwsred1 kernel: [53937.183850] Pid: 8790, comm: igspw_mt Not tainted 3.0.13-0.27-default #1
Jan 17 01:01:53 iwsred1 kernel: [53937.183852] Call Trace:
Jan 17 01:01:53 iwsred1 kernel: [53937.183866] [<ffffffff810048b5>] dump_trace+0x75/0x300
Jan 17 01:01:53 iwsred1 kernel: [53937.183874] [<ffffffff8143ea0f>] dump_stack+0x69/0x6f
Jan 17 01:01:53 iwsred1 kernel: [53937.183882] [<ffffffff810f2b6f>] dump_header+0x8f/0x1f0
Jan 17 01:01:53 iwsred1 kernel: [53937.183889] [<ffffffff810f3235>] oom_kill_process+0x95/0x180
Jan 17 01:01:53 iwsred1 kernel: [53937.183895] [<ffffffff810f346c>] out_of_memory+0x14c/0x230
Jan 17 01:01:53 iwsred1 kernel: [53937.183901] [<ffffffff810f8efb>] __alloc_pages_slowpath+0x7ab/0x7f0
Jan 17 01:01:53 iwsred1 kernel: [53937.183907] [<ffffffff810f90f1>] __alloc_pages_nodemask+0x1b1/0x1c0
Jan 17 01:01:53 iwsred1 kernel: [53937.183914] [<ffffffff811312b5>] alloc_pages_current+0xa5/0x120
Jan 17 01:01:53 iwsred1 kernel: [53937.183921] [<ffffffff810f08f2>] filemap_fault+0x172/0x3d0
Jan 17 01:01:53 iwsred1 kernel: [53937.183927] [<ffffffff8111916a>] __do_fault+0x7a/0x5d0
Jan 17 01:01:53 iwsred1 kernel: [53937.183933] [<ffffffff8111975d>] handle_pte_fault+0x9d/0x230
Jan 17 01:01:53 iwsred1 kernel: [53937.183939] [<ffffffff81445327>] do_page_fault+0x207/0x4c0
Jan 17 01:01:53 iwsred1 kernel: [53937.183945] [<ffffffff81442065>] page_fault+0x25/0x30
Jan 17 01:01:53 iwsred1 kernel: [53937.185505] DWARF2 unwinder stuck at page_fault+0x25/0x30
Jan 17 01:01:53 iwsred1 kernel: [53937.185507]
Jan 17 01:01:53 iwsred1 kernel: [53937.185508] Leftover inexact backtrace:
Jan 17 01:01:53 iwsred1 kernel: [53937.185509]
Jan 17 01:01:53 iwsred1 kernel: [53937.185512] Mem-Info:
Jan 17 01:01:54 iwsred1 kernel: [53937.185514] Node 0 DMA per-cpu:
Jan 17 01:01:54 iwsred1 kernel: [53937.185517] CPU 0: hi: 0, btch: 1 usd: 0
Jan 17 01:01:54 iwsred1 kernel: [53937.185520] CPU 1: hi: 0, btch: 1 usd: 0
Jan 17 01:01:54 iwsred1 kernel: [53937.185522] CPU 2: hi: 0, btch: 1 usd: 0
Jan 17 01:01:54 iwsred1 kernel: [53937.185525] CPU 3: hi: 0, btch: 1 usd: 0
Jan 17 01:01:54 iwsred1 kernel: [53937.185527] CPU 4: hi: 0, btch: 1 usd: 0
Jan 17 01:01:54 iwsred1 kernel: [53937.185529] CPU 5: hi: 0, btch: 1 usd: 0
Jan 17 01:01:54 iwsred1 kernel: [53937.185531] Node 0 DMA32 per-cpu:
Jan 17 01:01:54 iwsred1 kernel: [53937.185534] CPU 0: hi: 186, btch: 31 usd: 0
Jan 17 01:01:54 iwsred1 kernel: [53937.185537] CPU 1: hi: 186, btch: 31 usd: 156
Jan 17 01:01:54 iwsred1 kernel: [53937.185539] CPU 2: hi: 186, btch: 31 usd: 4
Jan 17 01:01:54 iwsred1 kernel: [53937.185542] CPU 3: hi: 186, btch: 31 usd: 115
Jan 17 01:01:54 iwsred1 kernel: [53937.185544] CPU 4: hi: 186, btch: 31 usd: 17
Jan 17 01:01:54 iwsred1 kernel: [53937.185547] CPU 5: hi: 186, btch: 31 usd: 27
Jan 17 01:01:54 iwsred1 kernel: [53937.185548] Node 0 Normal per-cpu:
Jan 17 01:01:54 iwsred1 kernel: [53937.185551] CPU 0: hi: 186, btch: 31 usd: 0
Jan 17 01:01:54 iwsred1 kernel: [53937.185554] CPU 1: hi: 186, btch: 31 usd: 157
Jan 17 01:01:54 iwsred1 kernel: [53937.185556] CPU 2: hi: 186, btch: 31 usd: 8
Jan 17 01:01:54 iwsred1 kernel: [53937.185558] CPU 3: hi: 186, btch: 31 usd: 0
Jan 17 01:01:54 iwsred1 kernel: [53937.185561] CPU 4: hi: 186, btch: 31 usd: 30
Jan 17 01:01:55 iwsred1 kernel: [53937.185563] CPU 5: hi: 186, btch: 31 usd: 34
Jan 17 01:01:55 iwsred1 kernel: [53937.185569] active_anon:1260806 inactive_anon:83053 isolated_anon:0
Jan 17 01:01:55 iwsred1 kernel: [53937.185571] active_file:204 inactive_file:1008 isolated_file:77
Jan 17 01:01:55 iwsred1 kernel: [53937.185572] unevictable:0 dirty:14 writeback:0 unstable:0
Jan 17 01:01:55 iwsred1 kernel: [53937.185573] free:28845 slab_reclaimable:3962 slab_unreclaimable:8633
Jan 17 01:01:55 iwsred1 kernel: [53937.185575] mapped:472507 shmem:687094 pagetables:13494 bounce:0
Jan 17 01:01:55 iwsred1 kernel: [53937.185577] Node 0 DMA free:15908kB min:84kB low:104kB high:124kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15684kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
Jan 17 01:01:55 iwsred1 kernel: [53937.185590] lowmem_reserve[]: 0 3768 11816 11816
Jan 17 01:01:55 iwsred1 kernel: [53937.185594] Node 0 DMA32 free:53508kB min:21520kB low:26900kB high:32280kB active_anon:3398500kB inactive_anon:203856kB active_file:788kB inactive_file:3836kB unevictable:0kB isolated(anon):0kB isolated(file):308kB present:3858656kB mlocked:0kB dirty:64kB writeback:0kB mapped:1565644kB shmem:1900012kB slab_reclaimable:7540kB slab_unreclaimable:4832kB kernel_stack:1008kB pagetables:23892kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:1011938 all_unreclaimable? yes
Jan 17 01:01:55 iwsred1 kernel: [53937.185608] lowmem_reserve[]: 0 0 8048 8048
Jan 17 01:01:55 iwsred1 kernel: [53937.185612] Node 0 Normal free:45964kB min:45972kB low:57464kB high:68956kB active_anon:1644724kB inactive_anon:128356kB active_file:28kB inactive_file:196kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:2093504kB mlocked:0kB dirty:0kB writeback:0kB mapped:324384kB shmem:848364kB slab_reclaimable:8308kB slab_unreclaimable:29700kB kernel_stack:2832kB pagetables:30084kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:980 all_unreclaimable? yes
Jan 17 01:01:55 iwsred1 kernel: [53937.185625] lowmem_reserve[]: 0 0 0 0
Jan 17 01:01:55 iwsred1 kernel: [53937.185629] Node 0 DMA: 1*4kB 0*8kB 0*16kB 1*32kB 2*64kB 1*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15908kB
Jan 17 01:01:55 iwsred1 kernel: [53937.185639] Node 0 DMA32: 1145*4kB 615*8kB 489*16kB 167*32kB 84*64kB 31*128kB 4*256kB 0*512kB 2*1024kB 3*2048kB 3*4096kB = 53516kB
Jan 17 01:01:55 iwsred1 kernel: [53937.185649] Node 0 Normal: 1413*4kB 567*8kB 265*16kB 106*32kB 50*64kB 18*128kB 8*256kB 25*512kB 8*1024kB 0*2048kB 0*4096kB = 46364kB
Jan 17 01:01:55 iwsred1 kernel: [53937.185660] 688603 total pagecache pages
Jan 17 01:01:55 iwsred1 kernel: [53937.185661] 0 pages in swap cache
Jan 17 01:01:55 iwsred1 kernel: [53937.185664] Swap cache stats: add 0, delete 0, find 0/0
Jan 17 01:01:55 iwsred1 kernel: [53937.185666] Free swap = 0kB
Jan 17 01:01:55 iwsred1 kernel: [53937.185667] Total swap = 0kB
Jan 17 01:01:55 iwsred1 kernel: [53937.210239] 3071984 pages RAM
Jan 17 01:01:55 iwsred1 kernel: [53937.210241] 1632463 pages reserved
Jan 17 01:01:55 iwsred1 kernel: [53937.210242] 1905942 pages shared
Jan 17 01:01:55 iwsred1 kernel: [53937.210243] 927363 pages non-shared
Jan 17 01:01:55 iwsred1 kernel: [53937.210244] [ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
Jan 17 01:01:55 iwsred1 kernel: [53937.210259] [ 427] 0 427 4250 132 0 -17 -1000 udevd
Jan 17 01:01:55 iwsred1 kernel: [53937.210263] [ 1328] 0 1328 998 28 4 0 0 acpid
Jan 17 01:01:55 iwsred1 kernel: [53937.210267] [ 1343] 100 1343 5396 139 3 0 0 dbus-daemon
Jan 17 01:01:55 iwsred1 kernel: [53937.210270] [ 1361] 0 1361 4955 228 4 0 0 syslog-ng
Jan 17 01:01:55 iwsred1 kernel: [53937.210273] [ 1364] 0 1364 1065 89 2 0 0 klogd
Jan 17 01:01:55 iwsred1 kernel: [53937.210276] [ 1518] 101 1518 8520 212 3 0 0 hald
Jan 17 01:01:55 iwsred1 kernel: [53937.210280] [ 1521] 0 1521 27277 224 4 0 0 console-kit-dae
Jan 17 01:01:55 iwsred1 kernel: [53937.210284] [ 1522] 0 1522 4505 55 4 0 0 hald-runner
Jan 17 01:01:55 iwsred1 kernel: [53937.210287] [ 1617] 0 1617 8690 79 0 0 0 hald-addon-inpu
Jan 17 01:01:55 iwsred1 kernel: [53937.210290] [ 1642] 101 1642 9129 79 1 0 0 hald-addon-acpi
Jan 17 01:01:55 iwsred1 kernel: [53937.210293] [ 2449] 0 2449 7409 61 0 -17 -1000 auditd
Jan 17 01:01:55 iwsred1 kernel: [53937.210296] [ 2451] 0 2451 3606 38 0 0 0 audispd
Jan 17 01:01:55 iwsred1 kernel: [53937.210299] [ 2511] 0 2511 2059 1064 0 0 0 haveged
Jan 17 01:01:55 iwsred1 kernel: [53937.210302] [ 2554] 0 2554 4724 52 1 0 0 rpcbind
Jan 17 01:01:55 iwsred1 kernel: [53937.210305] [ 2636] 0 2636 4249 131 2 -17 -1000 udevd
Jan 17 01:01:55 iwsred1 kernel: [53937.210309] [ 2638] 0 2638 4249 131 1 -17 -1000 udevd
Jan 17 01:01:55 iwsred1 kernel: [53937.210311] [ 3145] 0 3145 82346 200 3 0 0 collectd
Jan 17 01:01:55 iwsred1 kernel: [53937.210314] [ 3169] 0 3169 2277 40 3 0 0 irqbalance
Jan 17 01:01:55 iwsred1 kernel: [53937.210318] [ 3184] 0 3184 6882 107 1 0 0 mcelog
Jan 17 01:01:55 iwsred1 kernel: [53937.210321] [ 3488] 0 3488 17296 174 0 -17 -1000 sshd
Jan 17 01:01:55 iwsred1 kernel: [53937.210324] [ 3502] 0 3502 17902 226 0 0 0 cupsd
Jan 17 01:01:55 iwsred1 kernel: [53937.210327] [ 3520] 0 3520 10269 183 3 0 0 saphostexec
Jan 17 01:01:55 iwsred1 kernel: [53937.210330] [ 3599] 1004 3599 54673 18118 0 0 0 sapstartsrv
Jan 17 01:01:55 iwsred1 kernel: [53937.210333] [ 3894] 1001 3894 86236 9747 0 0 0 sapstartsrv
Jan 17 01:01:55 iwsred1 kernel: [53937.210336] [ 4156] 1005 4156 50301 5684 4 0 0 sapstartsrv
Jan 17 01:01:55 iwsred1 kernel: [53937.210339] [ 4173] 0 4173 59598 99 0 0 0 nscd
Jan 17 01:01:55 iwsred1 kernel: [53937.210342] [ 5029] 1005 5029 11049 293 3 0 0 sapstart
Jan 17 01:01:55 iwsred1 kernel: [53937.210345] [ 5184] 0 5184 16711 162 3 0 0 gdm
Jan 17 01:01:55 iwsred1 kernel: [53937.210348] [ 5377] 0 5377 3697 38 0 0 0 cron
Jan 17 01:01:55 iwsred1 kernel: [53937.210350] [ 5386] 0 5386 13545 294 0 0 0 gdm-simple-slav
Jan 17 01:01:55 iwsred1 kernel: [53937.210353] [ 5445] 0 5445 29655 5319 0 0 0 X
Jan 17 01:01:55 iwsred1 kernel: [53937.210356] [ 5475] 0 5475 1121 29 1 0 0 mingetty
Jan 17 01:01:55 iwsred1 kernel: [53937.210359] [ 5476] 0 5476 1121 29 2 0 0 mingetty
Jan 17 01:01:55 iwsred1 kernel: [53937.210362] [ 5477] 0 5477 1121 29 5 0 0 mingetty
Jan 17 01:01:55 iwsred1 kernel: [53937.210365] [ 5478] 0 5478 1121 28 5 0 0 mingetty
Jan 17 01:01:55 iwsred1 kernel: [53937.210368] [ 5479] 0 5479 1121 29 4 0 0 mingetty
Jan 17 01:01:55 iwsred1 kernel: [53937.210371] [ 5480] 0 5480 1121 29 5 0 0 mingettyJan 17 01:01:55 iwsred1 kernel: [53937.210374] [ 5482] 1005 5482 16391 3224 0 0 0 jc.sapDAA_SMDA9
Jan 17 01:01:55 iwsred1 kernel: [53937.210378] [ 6039] 1005 6039 242560 55748 2 0 0 jstart
Jan 17 01:01:55 iwsred1 kernel: [53937.210381] [ 6053] 1002 6053 5432 76 0 0 0 vserver
Jan 17 01:01:55 iwsred1 kernel: [53937.210384] [ 6054] 1002 6054 5432 76 0 0 0 vserver
Jan 17 01:01:55 iwsred1 kernel: [53937.210387] [ 6057] 1002 6057 9792 210 0 0 0 niserver
Jan 17 01:01:55 iwsred1 kernel: [53937.210390] [ 6060] 1002 6060 9865 218 2 0 0 vserver
Jan 17 01:01:55 iwsred1 kernel: [53937.210392] [ 6062] 1002 6062 5485 79 0 0 0 vserver
Jan 17 01:01:55 iwsred1 kernel: [53937.210395] [ 6107] 109 6107 5548 55 5 0 0 dbus-launch
Jan 17 01:01:55 iwsred1 kernel: [53937.210398] [ 6122] 0 6122 12689 5170 0 0 0 saposcol
Jan 17 01:01:55 iwsred1 kernel: [53937.210401] [ 6347] 102 6347 1514 26 4 0 0 uuidd
Jan 17 01:01:55 iwsred1 kernel: [53937.210404] [ 8174] 1001 8174 11045 298 0 0 0 sapstart
Jan 17 01:01:55 iwsred1 kernel: [53937.210407] [ 8202] 1001 8202 19615 6528 0 0 0 ms.sapED1_DVEBM
Jan 17 01:01:55 iwsred1 kernel: [53937.210410] [ 8203] 1001 8203 1293008 16137 0 0 0 ED1_00_DP
Jan 17 01:01:55 iwsred1 kernel: [53937.210413] [ 8204] 1001 8204 12407 271 0 0 0 ig.sapED1_DVEBM
Jan 17 01:01:55 iwsred1 kernel: [53937.210416] [ 8209] 1001 8209 93620 4783 0 0 0 igsmux_mt
Jan 17 01:01:55 iwsred1 kernel: [53937.210418] [ 8210] 1001 8210 77231 6165 4 0 0 igspw_mt
Jan 17 01:01:55 iwsred1 kernel: [53937.210422] [ 8211] 1001 8211 77231 6230 2 0 0 igspw_mt
Jan 17 01:01:55 iwsred1 kernel: [53937.210425] [ 8275] 1001 8275 97105 16692 5 0 0 gwrd
Jan 17 01:01:55 iwsred1 kernel: [53937.210427] [ 8276] 1001 8276 168176 24495 3 0 0 icman
Jan 17 01:01:55 iwsred1 kernel: [53937.210430] [ 8282] 1001 8282 1486172 17968 1 0 0 ED1_00_DIA_W5
Jan 17 01:01:55 iwsred1 kernel: [53937.210433] [ 8288] 1001 8288 1483402 10957 5 0 0 ED1_00_ENQ_W11
Jan 17 01:01:55 iwsred1 kernel: [53937.210436] [ 8289] 1001 8289 1484314 14157 1 0 0 ED1_00_BTC_W12
Jan 17 01:01:55 iwsred1 kernel: [53937.210439] [ 8290] 1001 8290 1485809 34679 0 0 0 ED1_00_BTC_W13
Jan 17 01:01:55 iwsred1 kernel: [53937.210441] [ 8291] 1001 8291 1485063 26990 3 0 0 ED1_00_BTC_W14
Jan 17 01:01:55 iwsred1 kernel: [53937.210444] [ 8292] 1001 8292 1484033 20658 0 0 0 ED1_00_SPO_W15
Jan 17 01:01:55 iwsred1 kernel: [53937.210447] [ 8294] 1001 8294 1484095 15298 3 0 0 ED1_00_UP2_W16
Jan 17 01:01:55 iwsred1 kernel: [53937.210450] [19516] 1001 19516 7701 1748 1 0 0 sapxpg
Jan 17 01:01:55 iwsred1 kernel: [53937.210453] [19517] 1001 19517 12470 1960 0 0 0 dbmrfc
Jan 17 01:01:55 iwsred1 kernel: [53937.210456] [19528] 1002 19528 15893 4797 0 0 0 dbmsrv
Jan 17 01:01:55 iwsred1 kernel: [53937.210459] [24890] 0 24890 25130 236 2 0 0 gdm-session-wor
Jan 17 01:01:55 iwsred1 kernel: [53937.210462] [25073] 0 25073 39581 437 0 0 0 gnome-session
Jan 17 01:01:55 iwsred1 kernel: [53937.210465] [25143] 0 25143 4178 57 4 0 0 gpg-agent
Jan 17 01:01:55 iwsred1 kernel: [53937.210468] [25144] 0 25144 13504 144 0 0 0 ssh-agent
Jan 17 01:01:55 iwsred1 kernel: [53937.210471] [25150] 0 25150 5548 56 0 0 0 dbus-launch
Jan 17 01:01:55 iwsred1 kernel: [53937.210474] [25151] 0 25151 3428 150 0 0 0 dbus-daemon
Jan 17 01:01:55 iwsred1 kernel: [53937.210476] [25154] 0 25154 9887 708 0 0 0 gconfd-2
Jan 17 01:01:55 iwsred1 kernel: [53937.210479] [25167] 0 25167 90774 937 0 0 0 gnome-settings-
Jan 17 01:01:56 iwsred1 kernel: [53937.210482] [25168] 0 25168 40197 195 2 0 0 gnome-keyring-d
Jan 17 01:01:56 iwsred1 kernel: [53937.210485] [25174] 0 25174 10940 102 1 0 0 gvfsd
Jan 17 01:01:56 iwsred1 kernel: [53937.210488] [25179] 0 25179 35289 166 1 0 0 gvfs-fuse-daemo
Jan 17 01:01:56 iwsred1 kernel: [53937.210491] [25184] 0 25184 38550 995 4 0 0 metacity
Jan 17 01:01:56 iwsred1 kernel: [53937.210494] [25189] 0 25189 93102 1653 4 0 0 gnome-panel
Jan 17 01:01:56 iwsred1 kernel: [53937.210497] [25191] 0 25191 110643 2096 0 0 0 nautilus
Jan 17 01:01:56 iwsred1 kernel: [53937.210499] [25193] 0 25193 53013 749 0 0 0 bonobo-activati
Jan 17 01:01:56 iwsred1 kernel: [53937.210502] [25202] 0 25202 81491 1318 0 0 0 main-menu
Jan 17 01:01:56 iwsred1 kernel: [53937.210505] [25204] 0 25204 12082 112 0 0 0 gvfsd-trash
Jan 17 01:01:56 iwsred1 kernel: [53937.210508] [25210] 0 25210 13539 166 0 0 0 gvfs-hal-volume
Jan 17 01:01:56 iwsred1 kernel: [53937.210511] [25212] 0 25212 15703 193 1 0 0 gvfs-gphoto2-vo
Jan 17 01:01:56 iwsred1 kernel: [53937.210514] [25221] 0 25221 56944 2606 5 0 0 python
Jan 17 01:01:56 iwsred1 kernel: [53937.210516] [25227] 0 25227 75463 755 0 0 0 gnome-volume-co
Jan 17 01:01:56 iwsred1 kernel: [53937.210519] [25231] 0 25231 10961 95 5 0 0 gvfsd-burn
Jan 17 01:01:56 iwsred1 kernel: [53937.210522] [25254] 0 25254 48186 275 5 0 0 pulseaudio
Jan 17 01:01:56 iwsred1 kernel: [53937.210525] [25255] 0 25255 57562 910 0 0 0 gnome-power-man
Jan 17 01:01:56 iwsred1 kernel: [53937.210527] [25263] 0 25263 38021 429 0 0 0 gnome-screensav
Jan 17 01:01:56 iwsred1 kernel: [53937.210530] [25272] 0 25272 9271 100 0 0 0 gvfsd-metadata
Jan 17 01:01:56 iwsred1 kernel: [53937.210533] [ 512] 0 512 15327 148 0 0 0 gvfsd-network
Jan 17 01:01:56 iwsred1 kernel: [53937.210536] [ 517] 0 517 13086 119 0 0 0 gvfsd-dnssd
Jan 17 01:01:56 iwsred1 kernel: [53937.210539] [ 657] 0 657 27484 419 5 0 0 gvfsd-smb-brows
Jan 17 01:01:56 iwsred1 kernel: [53937.210541] [ 2513] 1001 2513 1490928 260646 1 0 0 ED1_00_DIA_W3
Jan 17 01:01:56 iwsred1 kernel: [53937.210544] [ 2848] 1001 2848 1488168 75809 1 0 0 ED1_00_DIA_W8
Jan 17 01:01:56 iwsred1 kernel: [53937.210547] [ 5467] 1001 5467 1492993 208319 1 0 0 ED1_00_DIA_W7
Jan 17 01:01:56 iwsred1 kernel: [53937.210550] [ 5722] 1001 5722 1487020 115768 5 0 0 ED1_00_DIA_W0
Jan 17 01:01:56 iwsred1 kernel: [53937.210553] [10849] 1001 10849 1491425 218091 2 0 0 ED1_00_DIA_W4
Jan 17 01:01:56 iwsred1 kernel: [53937.210556] [11137] 1001 11137 1492571 329586 5 0 0 ED1_00_DIA_W2
Jan 17 01:01:56 iwsred1 kernel: [53937.210558] [11246] 1001 11246 1491646 352938 0 0 0 ED1_00_DIA_W6
Jan 17 01:01:56 iwsred1 kernel: [53937.210561] [11355] 1001 11355 1491329 294971 0 0 0 ED1_00_DIA_W1
Jan 17 01:01:56 iwsred1 kernel: [53937.210564] [11494] 1002 11494 25726 4075 4 0 0 kernel
Jan 17 01:01:56 iwsred1 kernel: [53937.210567] [11497] 1002 11497 389544 316013 0 0 0 kernel
Jan 17 01:01:56 iwsred1 kernel: [53937.210570] [16217] 1001 16217 1485725 18835 2 0 0 ED1_00_UPD_W10
Jan 17 01:01:56 iwsred1 kernel: [53937.210573] [29978] 1001 29978 1295079 7829 0 0 0 ED1_00_DIA_W9
Jan 17 01:01:56 iwsred1 kernel: [53937.210575] Out of memory: Kill process 11246 (ED1_00_DIA_W6) score 245 or sacrifice child
Jan 17 01:01:56 iwsred1 kernel: [53937.210578] Killed process 11246 (ED1_00_DIA_W6) total-vm:5966584kB, anon-rss:66176kB, file-rss:1345576kB
Jan 17 01:02:40 iwsred1 kernel: [53984.907810] jstart invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0, oom_score_adj=0
Jan 17 01:02:40 iwsred1 kernel: [53984.907814] jstart cpuset=/ mems_allowed=0
Jan 17 01:02:40 iwsred1 kernel: [53984.907817] Pid: 6158, comm: jstart Not tainted 3.0.13-0.27-default #1
Jan 17 01:02:40 iwsred1 kernel: [53984.907819] Call Trace:
Jan 17 01:02:40 iwsred1 kernel: [53984.907838] [<ffffffff810048b5>] dump_trace+0x75/0x300
Jan 17 01:02:40 iwsred1 kernel: [53984.907845] [<ffffffff8143ea0f>] dump_stack+0x69/0x6f
Jan 17 01:02:40 iwsred1 kernel: [53984.907851] [<ffffffff810f2b6f>] dump_header+0x8f/0x1f0
Jan 17 01:02:40 iwsred1 kernel: [53984.907855] [<ffffffff810f3235>] oom_kill_process+0x95/0x180
Jan 17 01:02:40 iwsred1 kernel: [53984.907867] [<ffffffff810f346c>] out_of_memory+0x14c/0x230
Jan 17 01:02:40 iwsred1 kernel: [53984.907871] [<ffffffff810f8efb>] __alloc_pages_slowpath+0x7ab/0x7f0
Jan 17 01:02:40 iwsred1 kernel: [53984.907875] [<ffffffff810f90f1>] __alloc_pages_nodemask+0x1b1/0x1c0
Jan 17 01:02:40 iwsred1 kernel: [53984.907881] [<ffffffff811312b5>] alloc_pages_current+0xa5/0x120
Jan 17 01:02:40 iwsred1 kernel: [53984.907885] [<ffffffff810f08f2>] filemap_fault+0x172/0x3d0
Jan 17 01:02:40 iwsred1 kernel: [53984.907889] [<ffffffff8111916a>] __do_fault+0x7a/0x5d0
Jan 17 01:02:40 iwsred1 kernel: [53984.907900] [<ffffffff8111975d>] handle_pte_fault+0x9d/0x230
Jan 17 01:02:40 iwsred1 kernel: [53984.907906] [<ffffffff81445327>] do_page_fault+0x207/0x4c0
Jan 17 01:02:40 iwsred1 kernel: [53984.907910] [<ffffffff81442065>] page_fault+0x25/0x30
Jan 17 01:02:40 iwsred1 kernel: [53984.909056] DWARF2 unwinder stuck at page_fault+0x25/0x30
Jan 17 01:02:40 iwsred1 kernel: [53984.909058]
Jan 17 01:02:40 iwsred1 kernel: [53984.909059] Leftover inexact backtrace:
Jan 17 01:02:40 iwsred1 kernel: [53984.909060]
Jan 17 01:02:40 iwsred1 kernel: [53984.909062] Mem-Info:
Jan 17 01:02:41 iwsred1 kernel: [53984.909063] Node 0 DMA per-cpu:
Jan 17 01:02:41 iwsred1 kernel: [53984.909066] CPU 0: hi: 0, btch: 1 usd: 0
Jan 17 01:02:41 iwsred1 kernel: [53984.909067] CPU 1: hi: 0, btch: 1 usd: 0
Jan 17 01:02:41 iwsred1 kernel: [53984.909069] CPU 2: hi: 0, btch: 1 usd: 0
Jan 17 01:02:41 iwsred1 kernel: [53984.909070] CPU 3: hi: 0, btch: 1 usd: 0
Jan 17 01:02:41 iwsred1 kernel: [53984.909072] CPU 4: hi: 0, btch: 1 usd: 0
Jan 17 01:02:41 iwsred1 kernel: [53984.909074] CPU 5: hi: 0, btch: 1 usd: 0
Jan 17 01:02:41 iwsred1 kernel: [53984.909075] Node 0 DMA32 per-cpu:
Jan 17 01:02:41 iwsred1 kernel: [53984.909077] CPU 0: hi: 186, btch: 31 usd: 30
Jan 17 01:02:41 iwsred1 kernel: [53984.909079] CPU 1: hi: 186, btch: 31 usd: 32
Jan 17 01:02:41 iwsred1 kernel: [53984.909080] CPU 2: hi: 186, btch: 31 usd: 27
Jan 17 01:02:41 iwsred1 kernel: [53984.909082] CPU 3: hi: 186, btch: 31 usd: 29
Jan 17 01:02:41 iwsred1 kernel: [53984.909083] CPU 4: hi: 186, btch: 31 usd: 105
Jan 17 01:02:41 iwsred1 kernel: [53984.909085] CPU 5: hi: 186, btch: 31 usd: 50
Jan 17 01:02:41 iwsred1 kernel: [53984.909086] Node 0 Normal per-cpu:
Jan 17 01:02:41 iwsred1 kernel: [53984.909088] CPU 0: hi: 186, btch: 31 usd: 183
Jan 17 01:02:41 iwsred1 kernel: [53984.909090] CPU 1: hi: 186, btch: 31 usd: 61
Jan 17 01:02:41 iwsred1 kernel: [53984.909091] CPU 2: hi: 186, btch: 31 usd: 30
Jan 17 01:02:41 iwsred1 kernel: [53984.909093] CPU 3: hi: 186, btch: 31 usd: 0
Jan 17 01:02:41 iwsred1 kernel: [53984.909094] CPU 4: hi: 186, btch: 31 usd: 74
Jan 17 01:02:41 iwsred1 kernel: [53984.909096] CPU 5: hi: 186, btch: 31 usd: 18
Jan 17 01:02:41 iwsred1 kernel: [53984.909099] active_anon:1263080 inactive_anon:82278 isolated_anon:0
Jan 17 01:02:41 iwsred1 kernel: [53984.909100] active_file:0 inactive_file:1106 isolated_file:81
Jan 17 01:02:41 iwsred1 kernel: [53984.909101] unevictable:0 dirty:68 writeback:0 unstable:0
Jan 17 01:02:41 iwsred1 kernel: [53984.909102] free:28860 slab_reclaimable:3960 slab_unreclaimable:8607
Jan 17 01:02:41 iwsred1 kernel: [53984.909103] mapped:465393 shmem:687098 pagetables:12776 bounce:0
Jan 17 01:02:41 iwsred1 kernel: [53984.909105] Node 0 DMA free:15908kB min:84kB low:104kB high:124kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15684kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15684kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
Jan 17 01:02:41 iwsred1 kernel: [53984.909113] lowmem_reserve[]: 0 3768 11816 11816
Jan 17 01:02:41 iwsred1 kernel: [53984.909116] Node 0 DMA32 free:53680kB min:21520kB low:26900kB high:32280kB active_anon:3406320kB inactive_anon:201328kB active_file:0kB inactive_file:2996kB unevictable:0kB isolated(anon):0kB isolated(file):236kB present:3858656kB mlocked:0kB dirty:200kB writeback:0kB mapped:1545648kB shmem:1900024kB slab_reclaimable:7544kB slab_unreclaimable:4840kB kernel_stack:1040kB pagetables:22636kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:192 all_unreclaimable? yes
Jan 17 01:02:41 iwsred1 kernel: [53984.909125] lowmem_reserve[]: 0 0 8048 8048
Jan 17 01:02:41 iwsred1 kernel: [53984.909128] Node 0 Normal free:45852kB min:45972kB low:57464kB high:68956kB active_anon:1646000kB inactive_anon:127784kB active_file:0kB inactive_file:1428kB unevictable:0kB isolated(anon):0kB isolated(file):88kB present:2093504kB mlocked:0kB dirty:72kB writeback:0kB mapped:315924kB shmem:848368kB slab_reclaimable:8296kB slab_unreclaimable:29588kB kernel_stack:2800kB pagetables:28468kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:350 all_unreclaimable? yes
Jan 17 01:02:41 iwsred1 kernel: [53984.909137] lowmem_reserve[]: 0 0 0 0
Jan 17 01:02:41 iwsred1 kernel: [53984.909139] Node 0 DMA: 1*4kB 0*8kB 0*16kB 1*32kB 2*64kB 1*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15908kB
Jan 17 01:02:41 iwsred1 kernel: [53984.909146] Node 0 DMA32: 1357*4kB 726*8kB 473*16kB 116*32kB 25*64kB 16*128kB 3*256kB 0*512kB 2*1024kB 4*2048kB 4*4096kB = 53556kB
Jan 17 01:02:41 iwsred1 kernel: [53984.909153] Node 0 Normal: 1596*4kB 914*8kB 342*16kB 141*32kB 45*64kB 11*128kB 5*256kB 8*512kB 8*1024kB 2*2048kB 0*4096kB = 45632kB
Jan 17 01:02:41 iwsred1 kernel: [53984.909160] 688505 total pagecache pages
Jan 17 01:02:41 iwsred1 kernel: [53984.909161] 0 pages in swap cache
Jan 17 01:02:41 iwsred1 kernel: [53984.909162] Swap cache stats: add 0, delete 0, find 0/0
Jan 17 01:02:41 iwsred1 kernel: [53984.909164] Free swap = 0kB
Jan 17 01:02:41 iwsred1 kernel: [53984.909165] Total swap = 0kB
Jan 17 01:02:41 iwsred1 kernel: [53984.935005] 3071984 pages RAM
Jan 17 01:02:41 iwsred1 kernel: [53984.935007] 1632463 pages reserved
Jan 17 01:02:41 iwsred1 kernel: [53984.935008] 1571378 pages shared
Jan 17 01:02:41 iwsred1 kernel: [53984.935009] 935643 pages non-shared
Jan 17 01:02:41 iwsred1 kernel: [53984.935011] [ pid ] uid tgid total_vm rss cpu oom_adj oom_score_adj name
Jan 17 01:02:41 iwsred1 kernel: [53984.935027] [ 427] 0 427 4250 132 0 -17 -1000 udevd
Jan 17 01:02:41 iwsred1 kernel: [53984.935032] [ 1328] 0 1328 998 28 4 0 0 acpid
Jan 17 01:02:41 iwsred1 kernel: [53984.935036] [ 1343] 100 1343 5396 139 3 0 0 dbus-daemon
Jan 17 01:02:41 iwsred1 kernel: [53984.935040] [ 1361] 0 1361 4955 229 2 0 0 syslog-ng
Jan 17 01:02:41 iwsred1 kernel: [53984.935044] [ 1364] 0 1364 1065 89 5 0 0 klogd
Jan 17 01:02:41 iwsred1 kernel: [53984.935047] [ 1518] 101 1518 8520 212 0 0 0 hald
Jan 17 01:02:41 iwsred1 kernel: [53984.935052] [ 1521] 0 1521 27277 224 4 0 0 console-kit-dae
Jan 17 01:02:41 iwsred1 kernel: [53984.935056] [ 1522] 0 1522 4505 55 4 0 0 hald-runner
Jan 17 01:02:41 iwsred1 kernel: [53984.935060] [ 1617] 0 1617 8690 79 0 0 0 hald-addon-inpu
Jan 17 01:02:41 iwsred1 kernel: [53984.935064] [ 1642] 101 1642 9129 79 1 0 0 hald-addon-acpi
Jan 17 01:02:41 iwsred1 kernel: [53984.935067] [ 2449] 0 2449 7409 61 0 -17 -1000 auditd
Jan 17 01:02:41 iwsred1 kernel: [53984.935071] [ 2451] 0 2451 3606 38 0 0 0 audispd
Jan 17 01:02:41 iwsred1 kernel: [53984.935075] [ 2511] 0 2511 2059 1064 5 0 0 haveged
Jan 17 01:02:41 iwsred1 kernel: [53984.935079] [ 2554] 0 2554 4724 52 0 0 0 rpcbind
Jan 17 01:02:41 iwsred1 kernel: [53984.935082] [ 2636] 0 2636 4249 131 2 -17 -1000 udevd
Jan 17 01:02:41 iwsred1 kernel: [53984.935085] [ 2638] 0 2638 4249 131 1 -17 -1000 udevd
Jan 17 01:02:41 iwsred1 kernel: [53984.935088] [ 3145] 0 3145 82346 200 0 0 0 collectd
Jan 17 01:02:41 iwsred1 kernel: [53984.935091] [ 3169] 0 3169 2277 40 0 0 0 irqbalance
Jan 17 01:02:41 iwsred1 kernel: [53984.935094] [ 3184] 0 3184 6882 107 1 0 0 mcelog
Jan 17 01:02:41 iwsred1 kernel: [53984.935097] [ 3488] 0 3488 17296 174 0 -17 -1000 sshd
Jan 17 01:02:41 iwsred1 kernel: [53984.935100] [ 3502] 0 3502 17902 226 0 0 0 cupsd
Jan 17 01:02:41 iwsred1 kernel: [53984.935103] [ 3520] 0 3520 10269 183 0 0 0 saphostexec
Jan 17 01:02:41 iwsred1 kernel: [53984.935106] [ 3599] 1004 3599 54673 18138 0 0 0 sapstartsrv
Jan 17 01:02:41 iwsred1 kernel: [53984.935109] [ 3894] 1001 3894 86236 9682 0 0 0 sapstartsrv
Jan 17 01:02:41 iwsred1 kernel: [53984.935112] [ 4156] 1005 4156 50301 5684 0 0 0 sapstartsrv
Jan 17 01:02:41 iwsred1 kernel: [53984.935115] [ 4173] 0 4173 59598 99 0 0 0 nscd
Jan 17 01:02:41 iwsred1 kernel: [53984.935118] [ 5029] 1005 5029 11049 293 3 0 0 sapstart
Jan 17 01:02:41 iwsred1 kernel: [53984.935121] [ 5184] 0 5184 16711 162 3 0 0 gdm
Jan 17 01:02:41 iwsred1 kernel: [53984.935124] [ 5377] 0 5377 3697 38 0 0 0 cron
Jan 17 01:02:41 iwsred1 kernel: [53984.935127] [ 5386] 0 5386 13545 294 0 0 0 gdm-simple-slav
Jan 17 01:02:41 iwsred1 kernel: [53984.935130] [ 5445] 0 5445 29655 5323 0 0 0 X
Jan 17 01:02:41 iwsred1 kernel: [53984.935133] [ 5475] 0 5475 1121 29 1 0 0 mingetty
Jan 17 01:02:41 iwsred1 kernel: [53984.935136] [ 5476] 0 5476 1121 29 2 0 0 mingetty
Jan 17 01:02:41 iwsred1 kernel: [53984.935139] [ 5477] 0 5477 1121 29 5 0 0 mingetty
Jan 17 01:02:41 iwsred1 kernel: [53984.935142] [ 5478] 0 5478 1121 28 5 0 0 mingetty
Jan 17 01:02:41 iwsred1 kernel: [53984.935145] [ 5479] 0 5479 1121 29 4 0 0 mingetty
Jan 17 01:02:41 iwsred1 kernel: [53984.935148] [ 5480] 0 5480 1121 29 5 0 0 mingetty
Jan 17 01:02:41 iwsred1 kernel: [53984.935151] [ 5482] 1005 5482 16391 3224 0 0 0 jc.sapDAA_SMDA9
Jan 17 01:02:41 iwsred1 kernel: [53984.935155] [ 6039] 1005 6039 242560 55832 2 0 0 jstart
Jan 17 01:02:41 iwsred1 kernel: [53984.935158] [ 6053] 1002 6053 5432 76 0 0 0 vserver
Jan 17 01:02:41 iwsred1 kernel: [53984.935161] [ 6054] 1002 6054 5432 76 0 0 0 vserver
Jan 17 01:02:41 iwsred1 kernel: [53984.935163] [ 6057] 1002 6057 9792 210 0 0 0 niserver
Jan 17 01:02:41 iwsred1 kernel: [53984.935166] [ 6060] 1002 6060 9865 218 2 0 0 vserver
Jan 17 01:02:41 iwsred1 kernel: [53984.935169] [ 6062] 1002 6062 5485 79 0 0 0 vserver
Jan 17 01:02:41 iwsred1 kernel: [53984.935172] [ 6107] 109 6107 5548 55 5 0 0 dbus-launch
Jan 17 01:02:41 iwsred1 kernel: [53984.935175] [ 6122] 0 6122 12689 5167 0 0 0 saposcol
Jan 17 01:02:41 iwsred1 kernel: [53984.935178] [ 6347] 102 6347 1514 26 5 0 0 uuidd
Jan 17 01:02:41 iwsred1 kernel: [53984.935181] [ 8174] 1001 8174 11045 298 0 0 0 sapstart
Jan 17 01:02:41 iwsred1 kernel: [53984.935184] [ 8202] 1001 8202 19615 6528 1 0 0 ms.sapED1_DVEBM
Jan 17 01:02:41 iwsred1 kernel: [53984.935187] [ 8203] 1001 8203 1293008 16166 0 0 0 ED1_00_DP
Jan 17 01:02:41 iwsred1 kernel: [53984.935190] [ 8204] 1001 8204 12407 271 0 0 0 ig.sapED1_DVEBM
Jan 17 01:02:41 iwsred1 kernel: [53984.935193] [ 8209] 1001 8209 93620 4783 0 0 0 igsmux_mt
Jan 17 01:02:41 iwsred1 kernel: [53984.935196] [ 8210] 1001 8210 77231 6165 0 0 0 igspw_mt
Jan 17 01:02:41 iwsred1 kernel: [53984.935199] [ 8211] 1001 8211 77231 6230 4 0 0 igspw_mt
Jan 17 01:02:41 iwsred1 kernel: [53984.935202] [ 8275] 1001 8275 97105 16690 0 0 0 gwrd
Jan 17 01:02:41 iwsred1 kernel: [53984.935205] [ 8276] 1001 8276 168176 24527 1 0 0 icman
Jan 17 01:02:41 iwsred1 kernel: [53984.935208] [ 8282] 1001 8282 1486172 17968 1 0 0 ED1_00_DIA_W5
Jan 17 01:02:41 iwsred1 kernel: [53984.935210] [ 8288] 1001 8288 1483402 10957 5 0 0 ED1_00_ENQ_W11
Jan 17 01:02:41 iwsred1 kernel: [53984.935213] [ 8289] 1001 8289 1484314 14163 2 0 0 ED1_00_BTC_W12
Jan 17 01:02:41 iwsred1 kernel: [53984.935216] [ 8290] 1001 8290 1485809 34679 0 0 0 ED1_00_BTC_W13
Jan 17 01:02:41 iwsred1 kernel: [53984.935219] [ 8291] 1001 8291 1485063 26997 0 0 0 ED1_00_BTC_W14
Jan 17 01:02:41 iwsred1 kernel: [53984.935222] [ 8292] 1001 8292 1484033 20607 0 0 0 ED1_00_SPO_W15
Jan 17 01:02:41 iwsred1 kernel: [53984.935225] [ 8294] 1001 8294 1484095 15298 3 0 0 ED1_00_UP2_W16
Jan 17 01:02:41 iwsred1 kernel: [53984.935228] [19516] 1001 19516 7701 1748 1 0 0 sapxpg
Jan 17 01:02:41 iwsred1 kernel: [53984.935231] [19517] 1001 19517 12470 1960 0 0 0 dbmrfc
Jan 17 01:02:41 iwsred1 kernel: [53984.935234] [19528] 1002 19528 15893 4797 0 0 0 dbmsrv
Jan 17 01:02:41 iwsred1 kernel: [53984.935237] [24890] 0 24890 25130 236 2 0 0 gdm-session-wor
Jan 17 01:02:41 iwsred1 kernel: [53984.935240] [25073] 0 25073 39581 437 0 0 0 gnome-session
Jan 17 01:02:41 iwsred1 kernel: [53984.935243] [25143] 0 25143 4178 57 0 0 0 gpg-agent
Jan 17 01:02:41 iwsred1 kernel: [53984.935246] [25144] 0 25144 13504 144 4 0 0 ssh-agent
Jan 17 01:02:41 iwsred1 kernel: [53984.935249] [25150] 0 25150 5548 56 0 0 0 dbus-launch
Jan 17 01:02:41 iwsred1 kernel: [53984.935252] [25151] 0 25151 3428 150 0 0 0 dbus-daemon
Jan 17 01:02:41 iwsred1 kernel: [53984.935254] [25154] 0 25154 9887 708 0 0 0 gconfd-2
Jan 17 01:02:41 iwsred1 kernel: [53984.935257] [25167] 0 25167 90774 903 4 0 0 gnome-settings-
Jan 17 01:02:41 iwsred1 kernel: [53984.935260] [25168] 0 25168 40197 195 2 0 0 gnome-keyring-d
Jan 17 01:02:41 iwsred1 kernel: [53984.935263] [25174] 0 25174 10940 102 1 0 0 gvfsd
Jan 17 01:02:41 iwsred1 kernel: [53984.935266] [25179] 0 25179 35289 166 1 0 0 gvfs-fuse-daemo
Jan 17 01:02:41 iwsred1 kernel: [53984.935269] [25184] 0 25184 38550 1002 3 0 0 metacity
Jan 17 01:02:41 iwsred1 kernel: [53984.935272] [25189] 0 25189 93102 1647 0 0 0 gnome-panel
Jan 17 01:02:41 iwsred1 kernel: [53984.935275] [25191] 0 25191 110643 2109 4 0 0 nautilus
Jan 17 01:02:41 iwsred1 kernel: [53984.935278] [25193] 0 25193 53013 749 0 0 0 bonobo-activati
Jan 17 01:02:41 iwsred1 kernel: [53984.935281] [25202] 0 25202 81491 1301 0 0 0 main-menu
Jan 17 01:02:41 iwsred1 kernel: [53984.935284] [25204] 0 25204 12082 112 0 0 0 gvfsd-trash
Jan 17 01:02:41 iwsred1 kernel: [53984.935287] [25210] 0 25210 13539 166 0 0 0 gvfs-hal-volume
Jan 17 01:02:41 iwsred1 kernel: [53984.935290] [25212] 0 25212 15703 193 1 0 0 gvfs-gphoto2-vo
Jan 17 01:02:41 iwsred1 kernel: [53984.935293] [25221] 0 25221 56944 2606 5 0 0 python
Jan 17 01:02:41 iwsred1 kernel: [53984.935295] [25227] 0 25227 75463 755 0 0 0 gnome-volume-co
Jan 17 01:02:41 iwsred1 kernel: [53984.935298] [25231] 0 25231 10961 95 5 0 0 gvfsd-burn
Jan 17 01:02:41 iwsred1 kernel: [53984.935301] [25254] 0 25254 48186 275 5 0 0 pulseaudio
Jan 17 01:02:41 iwsred1 kernel: [53984.935304] [25255] 0 25255 57562 910 0 0 0 gnome-power-man
Jan 17 01:02:41 iwsred1 kernel: [53984.935307] [25263] 0 25263 38021 429 0 0 0 gnome-screensav
Jan 17 01:02:41 iwsred1 kernel: [53984.935310] [25272] 0 25272 9271 100 0 0 0 gvfsd-metadata
Jan 17 01:02:41 iwsred1 kernel: [53984.935312] [ 512] 0 512 15327 148 0 0 0 gvfsd-network
Jan 17 01:02:41 iwsred1 kernel: [53984.935315] [ 517] 0 517 13086 119 0 0 0 gvfsd-dnssd
Jan 17 01:02:41 iwsred1 kernel: [53984.935318] [ 657] 0 657 27484 419 5 0 0 gvfsd-smb-brows
Jan 17 01:02:41 iwsred1 kernel: [53984.935321] [ 2513] 1001 2513 1490928 260646 1 0 0 ED1_00_DIA_W3
Jan 17 01:02:41 iwsred1 kernel: [53984.935324] [ 2848] 1001 2848 1488168 75809 1 0 0 ED1_00_DIA_W8
Jan 17 01:02:41 iwsred1 kernel: [53984.935327] [ 5467] 1001 5467 1492993 208318 1 0 0 ED1_00_DIA_W7
Jan 17 01:02:41 iwsred1 kernel: [53984.935330] [ 5722] 1001 5722 1487020 115768 5 0 0 ED1_00_DIA_W0
Jan 17 01:02:41 iwsred1 kernel: [53984.935333] [10849] 1001 10849 1491425 218091 2 0 0 ED1_00_DIA_W4
Jan 17 01:02:41 iwsred1 kernel: [53984.935335] [11137] 1001 11137 1492571 329586 5 0 0 ED1_00_DIA_W2
Jan 17 01:02:41 iwsred1 kernel: [53984.935338] [11355] 1001 11355 1491329 294942 0 0 0 ED1_00_DIA_W1
Jan 17 01:02:41 iwsred1 kernel: [53984.935341] [11494] 1002 11494 25726 4080 0 0 0 kernel
Jan 17 01:02:41 iwsred1 kernel: [53984.935344] [11497] 1002 11497 389544 323445 0 0 0 kernel
Jan 17 01:02:41 iwsred1 kernel: [53984.935347] [16217] 1001 16217 1485725 18835 2 0 0 ED1_00_UPD_W10
Jan 17 01:02:41 iwsred1 kernel: [53984.935350] [29978] 1001 29978 1483930 10009 0 0 0 ED1_00_DIA_W9
Jan 17 01:02:41 iwsred1 kernel: [53984.935353] [29981] 1001 29981 1484105 11358 0 0 0 ED1_00_DIA_W6
Jan 17 01:02:41 iwsred1 kernel: [53984.935355] Out of memory: Kill process 11137 (ED1_00_DIA_W2) score 229 or sacrifice child
Jan 17 01:02:41 iwsred1 kernel: [53984.935358] Killed process 11137 (ED1_00_DIA_W2) total-vm:5970284kB, anon-rss:72044kB, file-rss:1246300kB
Jan 17 01:03:09 iwsred1 syslog-ng[1361]: Log statistics; dropped='pipe(/dev/xconsole)=193', dropped='pipe(/dev/tty10)=0', processed='center(queued)=10122', processed='center(received)=4845', processed='destination(messages)=4838', processed='destination(mailinfo)=1', processed='destination(mailwarn)=0', processed='destination(localmessages)=1', processed='destination(newserr)=0', processed='destination(mailerr)=2', processed='destination(netmgm)=0', processed='destination(warn)=1763', processed='destination(console)=1755', processed='destination(null)=2', processed='destination(mail)=3', processed='destination(xconsole)=1755', processed='destination(firewall)=0', processed='destination(acpid)=2', processed='destination(newscrit)=0', processed='destination(newsnotice)=0', processed='source(src)=4845'
Jan 17 01:10:02 iwsred1 /usr/sbin/cron[30400]: (root) CMD ([ -x /usr/lib64/sa/sa1 ] && exec /usr/lib64/sa/sa1 -S ALL 1 1)
Jan 17 01:14:07 iwsred1 kernel: [54671.153504] igspw_mt invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0, oom_score_adj=0
Jan 17 01:14:07 iwsred1 kernel: [54671.153509] igspw_mt cpuset=/ mems_allowed=0
Jan 17 01:14:07 iwsred1 kernel: [54671.153513] Pid: 8790, comm: igspw_mt Not tainted 3.0.13-0.27-default #1
Jan 17 01:14:07 iwsred1 kernel: [54671.153516] Call Trace:
Jan 17 01:14:07 iwsred1 kernel: [54671.153531] [<ffffffff810048b5>] dump_trace+0x75/0x300
Jan 17 01:14:07 iwsred1 kernel: [54671.153539] [<ffffffff8143ea0f>] dump_stack+0x69/0x6f
Jan 17 01:14:07 iwsred1 kernel: [54671.153547] [<ffffffff810f2b6f>] dump_header+0x8f/0x1f0
Jan 17 01:14:07 iwsred1 kernel: [54671.153553] [<ffffffff810f3235>] oom_kill_process+0x95/0x180
Jan 17 01:14:07 iwsred1 kernel: [54671.153559] [<ffffffff810f346c>] out_of_memory+0x14c/0x230
Jan 17 01:14:07 iwsred1 kernel: [54671.153565] [<ffffffff810f8efb>] __alloc_pages_slowpath+0x7ab/0x7f0
Jan 17 01:14:07 iwsred1 kernel: [54671.153571] [<ffffffff810f90f1>] __alloc_pages_nodemask+0x1b1/0x1c0
Jan 17 01:14:07 iwsred1 kernel: [54671.153579] [<ffffffff811312b5>] alloc_pages_current+0xa5/0x120
Jan 17 01:14:07 iwsred1 kernel: [54671.153585] [<ffffffff810f08f2>] filemap_fault+0x172/0x3d0
Jan 17 01:14:07 iwsred1 kernel: [54671.153591] [<ffffffff8111916a>] __do_fault+0x7a/0x5d0
Jan 17 01:14:07 iwsred1 kernel: [54671.153596] [<ffffffff8111975d>] handle_pte_fault+0x9d/0x230
Jan 17 01:14:07 iwsred1 kernel: [54671.153603] [<ffffffff81445327>] do_page_fault+0x207/0x4c0
Jan 17 01:14:07 iwsred1 kernel: [54671.153609] [<ffffffff81442065>] page_fault+0x25/0x30
Jan 17 01:14:07 iwsred1 kernel: [54671.154832] DWARF2 unwinder stuck at page_fault+0x25/0x30
Jan 17 01:14:07 iwsred1 kernel: [54671.154834]
Jan 17 01:14:07 iwsred1 kernel: [54671.154836] Leftover inexact backtrace:
Jan 17 01:14:07 iwsred1 kernel: [54671.154837]
Jan 17 01:14:07 iwsred1 kernel: [54671.154839] Mem-Info:
Jan 17 01:14:07 iwsred1 kernel: [54671.154841] Node 0 DMA per-cpu:
log file - KNLMSGARC
Thread 0x2CE6 Task - 2013-01-17 01:14:08 ERR RTEKernel 102: Kernel exited without core and exit status 0x9,_FILE=RTEKernel_Termination+noPIC.cpp,_LINE=683
Thread 0x2CE6 Task - 2013-01-17 01:14:08 ERR RTEKernel 98: Kernel exited due to signal 9 (SIGKILL),_FILE=RTEKernel_Termination+noPIC.cpp,_LINE=729
Thread 0x2CE6 Task - 2013-01-17 01:14:08 MsgOutput 28: ___ Stopping GMT 2013-01-16 19:44:08 7.8.01 Build 014-121-233-288
Thread - Task - 2013-01-17 09:11:54 MsgOutput 27: --- Starting GMT 2013-01-17 03:41:54 7.8.01 Build 014-121-233-288
Thread 0x5B7E Task 81 2013-01-17 09:12:07 AdminMsg 0: 50F7730F001A 0000 RST RESTART
Thread 0x5B80 Task 81 2013-01-17 09:12:48 AdminMsg 0: 50F773380027 0000 RST RETURNCODE 0;RESTART
Thread 0x5B5C Task - 2013-01-17 12:06:56 ERR RTEKernel 102: Kernel exited without core and exit status 0x9,_FILE=RTEKernel_Termination+noPIC.cpp,_LINE=683
Thread 0x5B5C Task - 2013-01-17 12:06:56 ERR RTEKernel 98: Kernel exited due to signal 9 (SIGKILL),_FILE=RTEKernel_Termination+noPIC.cpp,_LINE=729
Thread 0x5B5C Task - 2013-01-17 12:06:56 MsgOutput 28: ___ Stopping GMT 2013-01-17 06:36:56 7.8.01 Build 014-121-233-288
Thread - Task - 2013-01-17 12:07:44 MsgOutput 27: --- Starting GMT 2013-01-17 06:37:44 7.8.01 Build 014-121-233-288
Thread 0x1F1 Task 81 2013-01-17 12:07:56 AdminMsg 0: 50F79C440014 0000 RST RESTART
Thread 0x1F3 Task 81 2013-01-17 12:08:01 AdminMsg 0: 50F79C49001D 0000 RST RETURNCODE 0;RESTART
Thread 0x1CF Task - 2013-01-17 14:49:08 ERR RTEKernel 102: Kernel exited without core and exit status 0x9,_FILE=RTEKernel_Termination+noPIC.cpp,_LINE=683
Thread 0x1CF Task - 2013-01-17 14:49:08 ERR RTEKernel 98: Kernel exited due to signal 9 (SIGKILL),_FILE=RTEKernel_Termination+noPIC.cpp,_LINE=729
Thread 0x1CF Task - 2013-01-17 14:49:08 MsgOutput 28: ___ Stopping GMT 2013-01-17 09:19:08 7.8.01 Build 014-121-233-288
Thread - Task - 2013-01-17 14:51:03 MsgOutput 27: --- Starting GMT 2013-01-17 09:21:03 7.8.01 Build 014-121-233-288
Thread 0x2491 Task 81 2013-01-17 14:51:16 AdminMsg 0: 50F7C28C0020 0000 RST RESTART
Thread 0x2493 Task 81 2013-01-17 14:51:59 AdminMsg 0: 50F7C2B70067 0000 RST RETURNCODE 0;RESTART
Thread 0x246F Task - 2013-01-17 17:51:24 ERR RTEKernel 102: Kernel exited without core and exit status 0x9,_FILE=RTEKernel_Termination+noPIC.cpp,_LINE=683
Thread 0x246F Task - 2013-01-17 17:51:24 ERR RTEKernel 98: Kernel exited due to signal 9 (SIGKILL),_FILE=RTEKernel_Termination+noPIC.cpp,_LINE=729
Thread 0x246F Task - 2013-01-17 17:51:24 MsgOutput 28: ___ Stopping GMT 2013-01-17 12:21:24 7.8.01 Build 014-121-233-288
Thread - Task - 2013-01-17 17:52:43 MsgOutput 27: --- Starting GMT 2013-01-17 12:22:43 7.8.01 Build 014-121-233-288
Thread 0x4A31 Task 81 2013-01-17 17:52:56 AdminMsg 0: 50F7ED200022 0000 RST RESTART
Thread 0x4A33 Task 81 2013-01-17 17:53:03 AdminMsg 0: 50F7ED27002B 0000 RST RETURNCODE 0;RESTART
Thread 0x4A0F Task - 2013-01-17 18:39:23 ERR RTEKernel 102: Kernel exited without core and exit status 0x9,_FILE=RTEKernel_Termination+noPIC.cpp,_LINE=683
Thread 0x4A0F Task - 2013-01-17 18:39:23 ERR RTEKernel 98: Kernel exited due to signal 9 (SIGKILL),_FILE=RTEKernel_Termination+noPIC.cpp,_LINE=729
Thread 0x4A0F Task - 2013-01-17 18:39:23 MsgOutput 28: ___ Stopping GMT 2013-01-17 13:09:23 7.8.01 Build 014-121-233-288
Thread - Task - 2013-01-17 18:39:44 MsgOutput 27: --- Starting GMT 2013-01-17 13:09:44 7.8.01 Build 014-121-233-288
Thread 0x53E6 Task 80 2013-01-17 18:39:56 AdminMsg 0: 50F7F824002C 0000 RST RESTART
Thread 0x53E6 Task 80 2013-01-17 18:40:28 AdminMsg 0: 50F7F84400B5 0000 RST RETURNCODE 0;RESTART
Thread 0x53C4 Task - 2013-01-17 20:04:12 ERR RTEKernel 102: Kernel exited without core and exit status 0x9,_FILE=RTEKernel_Termination+noPIC.cpp,_LINE=683
Thread 0x53C4 Task - 2013-01-17 20:04:12 ERR RTEKernel 98: Kernel exited due to signal 9 (SIGKILL),_FILE=RTEKernel_Termination+noPIC.cpp,_LINE=729
Thread 0x53C4 Task - 2013-01-17 20:04:12 MsgOutput 28: ___ Stopping GMT 2013-01-17 14:34:12 7.8.01 Build 014-121-233-288
Thread - Task - 2013-01-17 20:04:53 MsgOutput 27: --- Starting GMT 2013-01-17 14:34:53 7.8.01 Build 014-121-233-288
Thread 0x65F2 Task 81 2013-01-17 20:05:05 AdminMsg 0: 50F80C190024 0000 RST RESTART
Thread 0x65F4 Task 81 2013-01-17 20:05:12 AdminMsg 0: 50F80C200031 0000 RST RETURNCODE 0;RESTART
Thread 0x65D0 Task - 2013-01-17 22:10:44 ERR RTEKernel 102: Kernel exited without core and exit status 0x9,_FILE=RTEKernel_Termination+noPIC.cpp,_LINE=683
Thread 0x65D0 Task - 2013-01-17 22:10:44 ERR RTEKernel 98: Kernel exited due to signal 9 (SIGKILL),_FILE=RTEKernel_Termination+noPIC.cpp,_LINE=729
Thread 0x65D0 Task - 2013-01-17 22:10:44 MsgOutput 28: ___ Stopping GMT 2013-01-17 16:40:44 7.8.01 Build 014-121-233-288
Thread - Task - 2013-01-17 22:15:21 MsgOutput 27: --- Starting GMT 2013-01-17 16:45:21 7.8.01 Build 014-121-233-288
Thread 0x164B Task 81 2013-01-17 22:15:33 AdminMsg 0: 50F82AAD0004 0000 RST RESTART
Thread 0x164B Task 81 2013-01-17 22:15:40 AdminMsg 0: 50F82AB40005 0000 RST RETURNCODE 0;RESTART
- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Report Inappropriate Content
Yes, it is definitely the oom-killer that has been terminating the database kernel. I would now suggest the following:
1.
Find out, if the memory usage of the database process 'kernel' is increasing over time or if there is an upper limit after some days of database usage.
One method to determine the memory usage is to start the MaxDB Analyzer and monitor the heap usage. The database kernel memory should be mostly allocated by the defined cache_size parameter plus some more memory on top that gets allocated when needed.
2.
In case the memory usage seems to grow more and more over time you should consider upgrading your MaxDB 7.8.01.14 to a recent version of 7.8 as you might be experiencing a memory leak in the database kernel. If it is really a memory leak, then increasing the memory for the VM would only temporarily help.
3. Maybe the MaxDB cache_size is configured too big or the VM has not enough memory available, so adjusting one of these parameters would help (unless it is a memory leak, of course).
Thorsten
- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Report Inappropriate Content
Hello Thorsten
I found the cachememorysize allocated in maxdb is - 107264. In this system(erp) we have allocated 5.5GB of memory + without any swap memory.
We have similar system in which we installed solman with the less configuration, like memory as 4GB + swap memory as 3GB. And its cachememorysize allocated in maxdb is - 342016
But why the db of system(erp) is getting down? do you have any idea on this?
thanks in advance
- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Report Inappropriate Content
Hi,
the database is killed by the Linux 'oom-killer' process when Linux runs out of memory - looking at the database call stacks verifies this.
In your system the cachememorysize is set to 107264 pages. Each MaxDB page has a size of 8 KB, so the database will use 838 MB memory plus maybe 200-300 MB on top (depending on how many user tasks are configured...). I do not know how much memory the other applications are using on that server, but you need to check the total memory consumption of all applications against how much ram you have allowed for your VM. Has there been a 'sizing check' for that system? Was the hardware/software changed lately?
Thorsten
Answers (0)
- 10+ ways to reshape your SAP landscape with SAP BTP - Blog 4 Interview in Technology Blogs by SAP
- 10+ ways to reshape your SAP landscape with SAP Business Technology Platform – Blog 4 in Technology Blogs by SAP
- What is Capacity Units for SAP Build Code? in Technology Q&A
- Top Picks: Innovations Highlights from SAP Business Technology Platform (Q1/2024) in Technology Blogs by SAP
- SAP GUI for Java 8.10 on the Horizon in Technology Blogs by SAP
| User | Count |
|---|---|
| 95 | |
| 11 | |
| 11 | |
| 10 | |
| 9 | |
| 7 | |
| 6 | |
| 5 | |
| 4 | |
| 4 |
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.