Oom-killer

JM regularly crashed after upgrading operating system from RH 7.2 to FC 4.

Messenger’‘s log doesn’'t contain any records about crash. But syslog does:

Dec 6 22:17:35 technotex kernel: oom-killer: gfp_mask=0x80d2

Dec 6 22:17:35 technotex kernel: Mem-info:

Dec 6 22:17:35 technotex kernel: DMA per-cpu:

Dec 6 22:17:35 technotex kernel: cpu 0 hot: low 2, high 6, batch 1

Dec 6 22:17:35 technotex kernel: cpu 0 cold: low 0, high 2, batch 1

Dec 6 22:17:35 technotex kernel: Normal per-cpu:

Dec 6 22:17:35 technotex kernel: cpu 0 hot: low 62, high 186, batch 31

Dec 6 22:17:35 technotex kernel: cpu 0 cold: low 0, high 62, batch 31

Dec 6 22:17:35 technotex kernel: HighMem per-cpu: empty

Dec 6 22:17:35 technotex kernel:

Dec 6 22:17:35 technotex kernel: Free pages: 2992kB (0kB HighMem)

Dec 6 22:17:35 technotex kernel: Active:58664 inactive:400 dirty:0 writeback:0 unstable:0 free:748 slab:2510 mapped:57998 pagetables:547

Dec 6 22:17:35 technotex kernel: DMA free:1080kB min:124kB low:152kB high:184kB active:11020kB inactive:0kB present:16384kB pages_scanned:11717 all_unreclaimable? yes

Dec 6 22:17:36 technotex kernel: lowmem_reserve[]: 0 239 239

Dec 6 22:17:36 technotex su(pam_unix)[26624]: session closed for user jive

Dec 6 22:17:36 technotex kernel: Normal free:1912kB min:1916kB low:2392kB high:2872kB active:223636kB inactive:1600kB present:245696kB pages_scanned:45864 all_unreclaimable? no

Dec 6 22:17:36 technotex kernel: lowmem_reserve[]: 0 0 0

Dec 6 22:17:36 technotex kernel: HighMem free:0kB min:128kB low:160kB high:192kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no

Dec 6 22:17:36 technotex kernel: lowmem_reserve[]: 0 0 0

Dec 6 22:17:36 technotex kernel: DMA: 04kB 18kB 116kB 132kB 064kB 0128kB 0256kB 0512kB 11024kB 02048kB 0*4096kB = 1080kB

Dec 6 22:17:36 technotex kernel: Normal: 04kB 18kB 716kB 032kB 064kB 2128kB 0256kB 1512kB 11024kB 02048kB 0*4096kB = 1912kB

Dec 6 22:17:36 technotex kernel: HighMem: empty

Dec 6 22:17:36 technotex kernel: Swap cache: add 0, delete 0, find 0/0, race 0+0

Dec 6 22:17:36 technotex kernel: Free swap = 0kB

Dec 6 22:17:36 technotex kernel: Total swap = 0kB

Dec 6 22:17:36 technotex kernel: Free swap: 0kB

Dec 6 22:17:36 technotex kernel: 65520 pages of RAM

Dec 6 22:17:36 technotex kernel: 0 pages of HIGHMEM

Dec 6 22:17:36 technotex kernel: 1692 reserved pages

Dec 6 22:17:36 technotex kernel: 6715 pages shared

Dec 6 22:17:36 technotex kernel: 0 pages swap cached

Dec 6 22:17:36 technotex kernel: Out of Memory: Killed process 26625 (java).

/code

JM versions: 2.2.2 and 2005_12_01.

OS: Fedora Core 4 (2.6.11-1.1369_FC4 #1 Thu Jun 2 22:55:56 EDT 2005 i686 i686 i386 GNU/Linux)

JDK: Sun 1.5.0_01 and 1.5.0_05

Changing the Xmx and Xss values doesn’'t resolve the problem.

I have found some discussions:

http://www.ussg.iu.edu/hypermail/linux/kernel/0504.0/1589.html

http://dag.wieers.com/howto/compatibility/

But, I have not had time to take advantage of the advice described there.

Fefelov,

Can you run some updates, your Kernel is old…

  1. Add various 3rd party RPM Repositories (ensure there is a blank line at the bottom of each of the config files)

a. DAG

edit /etc/yum.repos.d/dag.repo and insert the following:

name=Dag RPM Repository for Fedora Core

  baseurl=http://apt.sw.be/fedora/$releasever/en/$basearch/dag/

enabled=1

gpgcheck=1

b. FreshRPMS

edit /etc/yum.repos.d/freshrpms.repo and insert the following:

name=FreshRPMS-Core

 baseurl=http://ayo.freshrpms.net/fedora/linux/$releasever/$basearch/core

enabled=1

gpgcheck=1

#[extras]

#name=Fedora Linux $releasever - $basearch - extras

 #baseurl=http://ayo.freshrpms.net/fedora/linux/$releasever/$basearch/extras

#enabled=0

#gpgcheck=1

name=FreshRPMS-Updates

 baseurl=http://ayo.freshrpms.net/fedora/linux/$releasever/$basearch/updates

enabled=1

gpgcheck=1

name=FreshRPMS-Fresh

 baseurl=http://ayo.freshrpms.net/fedora/linux/$releasever/$basearch/freshrpms

enabled=1

gpgcheck=1

c. Dries

edit /etc/yum.repos.d/dries.repo and insert the following:

name=Extra Fedora rpms dries - $releasever - $basearch

 baseurl=http://ftp.belnet.be/packages/dries.ulyssis.org/fedora/linux/$releasever/$basear ch/dries/RPMS/

enabled=1

gpgcheck=1

d. NewRPMS

edit /etc/yum.repos.d/newrpms.repo and insert the following:

newrpms.sunsite.dk

name=Fedora Core 4 i386 NewRPMS.sunsite.dk

 baseurl=http://newrpms.sunsite.dk/apt/redhat/en/i386/fc4

enabled=1

gpgcheck=1

e. Install the GPG Keys for the repositories

   rpm --import http://dag.wieers.com/packages/RPM-GPG-KEY.dag.txt

   rpm --import http://freshrpms.net/packages/RPM-GPG-KEY.txt

   rpm --import http://dries.studentenweb.org/ayo/RPM-GPG-KEY.dries.txt

   rpm --import http://newrpms.sunsite.dk/gpg-pubkey-newrpms.txt
  1. Update the system (up2date -u)

Clear option 7 during configuration

  1. Reboot

  2. Run yum update

yum -y update

Really, my swap space was lost!

Dec 6 22:17:36 technotex kernel: Free swap = 0kB

Dec 6 22:17:36 technotex kernel: Total swap = 0kB

Dec 6 22:17:36 technotex kernel: Free swap: 0kB

/code

After restoring swap no oom-kills reappears.