|
Neohapsis is currently accepting applications for employment. For more information, please visit our website www.neohapsis.com or email hr@neohapsis.com |
"Out of memory!" errors running sa-learn on 3.6-STABLE AMD64
From: C. Bensend (benny
bennyvision.com)
Date: Mon Jan 31 2005 - 22:46:07 CST
- Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]
Hey folks,
I just cut over my personal web/mailserver to a 3.6-STABLE system,
running an AMD64 3000+ with 2GB of DDR400 RAM. For the most part,
things are running smoothly, but I'm seeing some strange memory
issues every now and again.
One thing I've noticed is occasional "pauses" - the machine seems
to pause for a few seconds. I'm not sure if this is due to my net
connection (I'm ssh'ed in remotely), but it never happened with the
old machine. Nothing in the log files that I've found, either.
The one I'm fighting with now is training my SpamAssassin Bayes
database using 'sa-learn'. I'm attempting to train a directory of
5000 corpus spam emails (something I did often on the old PIII-800
with 512MB of RAM).
What I'm getting is this (wrapped for your viewing comfort):
[benny
fusion ~]$ time sa-learn --showdots --spam --dir
/home/benny/Maildir/.SPAM.corpus.2004.archive10/cur/
..................................................................
..................................................................
..................................................................
..................................................................
..............................................Out of memory!
Out of memory? I still have over a gig of RAM free, no swap is
being used, and my user is in the 'staff' login group. OK, so I'm
obviously hitting some sort of limit - I changed my user to the
'daemon' login group (and yes, logged out and back in). Same thing.
Hrm.
So, can anyone give some hints as to what's going wrong? I've
ktrace'd it, giving the following final lines:
16789 perl CALL mprotect(0x490d6000,0x2000,0x1)
16789 perl RET mprotect 0
16789 perl CALL sigprocmask(0x3,0)
16789 perl RET sigprocmask -65793/0xfffefeff
16789 perl CALL munmap(0x40f2e000,0x1000)
16789 perl RET munmap 0
16789 perl CALL sigprocmask(0x1,0xffffffff)
16789 perl RET sigprocmask 0
16789 perl CALL mprotect(0x490d6000,0x2000,0x3)
16789 perl RET mprotect 0
16789 perl CALL mprotect(0x490d6000,0x2000,0x1)
16789 perl RET mprotect 0
16789 perl CALL sigprocmask(0x3,0)
16789 perl RET sigprocmask -65793/0xfffefeff
16789 perl CALL exit(0x1)
My dmesg:
OpenBSD 3.6-stable (GENERIC) #0: Thu Jan 13 23:17:24 CST 2005
root
fusion2.bennyvision.com:/usr/src/sys/arch/amd64/compile/GENERIC
real mem = 2146234368 (2095932K)
avail mem = 1836572672 (1793528K)
using 22937 buffers containing 214831104 bytes (209796K) of memory
mainbus0 (root)
cpu0 at mainbus0: (uniprocessor)
cpu0: AMD Athlon(tm) 64 Processor 3000+, 2002.86 MHz
cpu0:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CF
LUSH,MMX,FXSR,SSE,SSE2,NXE,MMXX,LONG,3DNOW2,3DNOW
cpu0: 64KB 64b/line 2-way I-cache, 64KB 64b/line 2-way D-cache, 512KB
64b/line 1
6-way L2 cache
cpu0: ITLB 32 4KB entries fully associative, 8 4MB entries fully associative
cpu0: DTLB 32 4KB entries fully associative, 8 4MB entries fully associative
pci0 at mainbus0 bus 0: configuration mode 1
pchb0 at pci0 dev 0 function 0 "VIA K8HTB Host" rev 0x01
ppb0 at pci0 dev 1 function 0 "VIA K8HTB AGP" rev 0x00
pci1 at ppb0 bus 1
fxp0 at pci0 dev 11 function 0 "Intel 82557" rev 0x08: irq 5, address
00:03:47:4
d:cc:a6
inphy0 at fxp0 phy 1: i82555 10/100 media interface, rev. 4
vga1 at pci0 dev 12 function 0 "Cirrus Logic CL-GD5446" rev 0x00
wsdisplay0 at vga1: console (80x25, vt100 emulation)
wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
pciide0 at pci0 dev 15 function 0 "VIA VT8237 SATA" rev 0x80: DMA
pciide0: using irq 11 for native-PCI interrupt
pciide1 at pci0 dev 15 function 1 "VIA VT82C571 IDE" rev 0x06: ATA133,
channel 0
configured to compatibility, channel 1 configured to compatibility
wd0 at pciide1 channel 0 drive 0: <ST380013A>
wd0: 16-sector PIO, LBA48, 76319MB, 156301488 sectors
wd0(pciide1:0:0): using PIO mode 4, Ultra-DMA mode 5
wd1 at pciide1 channel 1 drive 0: <ST380013A>
wd1: 16-sector PIO, LBA48, 76319MB, 156301488 sectors
wd1(pciide1:1:0): using PIO mode 4, Ultra-DMA mode 5
uhci0 at pci0 dev 16 function 0 "VIA VT83C572 USB" rev 0x81: irq 5
usb0 at uhci0: USB revision 1.0
uhub0 at usb0
uhub0: VIA UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub0: 2 ports with 2 removable, self powered
uhci1 at pci0 dev 16 function 1 "VIA VT83C572 USB" rev 0x81: irq 5
usb1 at uhci1: USB revision 1.0
uhub1 at usb1
uhub1: VIA UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub1: 2 ports with 2 removable, self powered
uhci2 at pci0 dev 16 function 2 "VIA VT83C572 USB" rev 0x81: irq 11
usb2 at uhci2: USB revision 1.0
uhub2 at usb2
uhub2: VIA UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub2: 2 ports with 2 removable, self powered
uhci3 at pci0 dev 16 function 3 "VIA VT83C572 USB" rev 0x81: irq 11
usb3 at uhci3: USB revision 1.0
uhub3 at usb3
uhub3: VIA UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub3: 2 ports with 2 removable, self powered
ehci0 at pci0 dev 16 function 4 "VIA VT6202 USB 2.0" rev 0x86: irq 10
ehci0: EHCI version 1.0
ehci0: companion controllers, 2 ports each: uhci0 uhci1 uhci2 uhci3
usb4 at ehci0: USB revision 2.0
uhub4 at usb4
uhub4: VIA EHCI root hub, class 9/0, rev 2.00/1.00, addr 1
uhub4: 8 ports with 8 removable, self powered
"VIA VT8237 ISA" rev 0x00 at pci0 dev 17 function 0 not configured
pchb1 at pci0 dev 24 function 0 "AMD AMD64 HyperTransport" rev 0x00
pchb2 at pci0 dev 24 function 1 "AMD AMD64 Address Map" rev 0x00
pchb3 at pci0 dev 24 function 2 "AMD AMD64 DRAM Cfg" rev 0x00
pchb4 at pci0 dev 24 function 3 "AMD AMD64 Misc Cfg" rev 0x00
isa0 at mainbus0
com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
pckbc0 at isa0 port 0x60/5
pckbd0 at pckbc0 (kbd slot)
pckbc0: using irq 1 for kbd slot
wskbd0 at pckbd0: console keyboard, using wsdisplay0
lm0 at isa0 port 0x290/8: W83697HF
dkcsum: wd0 matched BIOS disk 80
wd1: no disk label
dkcsum: wd1 matched BIOS disk 81
root on wd0a
rootdev=0x0 rrootdev=0x300 rawdev=0x302
This machine is running SpamAssassin 3.02 built from source, as I
opted for a newer version than is in the ports tree.
Any help would be greatly appreciated - I'm not familiar with
how operating systems (and especially non-i386 systems) handle memory,
and I'm kinda concerned about the stability of this server if I have
stuff like this going on.
Thanks much!
Benny
--
"I'm on the Zoloft to keep from killing y'all."
-- Mike Tyson
- Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]