graphite-dev team mailing list archive

[clohtd <question263940@xxxxxxxxxxxxxxxxxxxxx>]

Question #263940 on Graphite changed:
https://answers.launchpad.net/graphite/+question/263940

clohtd posted a new comment:
This happened two days ago (server is UTC time):

Mar 21 19:38:10 servername kernel: [1290534.490136] lowmem_reserve[]: 0 0 0 0
Mar 21 19:38:10 servername kernel: [1290534.490138] Node 0 DMA: 0*4kB 1*8kB 0*16kB 0*32kB 2*64kB 1*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15880kB
Mar 21 19:38:10 servername kernel: [1290534.490146] Node 0 DMA32: 5061*4kB 26*8kB 1*16kB 2*32kB 0*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 24500kB
Mar 21 19:38:10 servername kernel: [1290534.490152] Node 0 Normal: 855*4kB 14*8kB 11*16kB 2*32kB 0*64kB 0*128kB 1*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 7612kB
Mar 21 19:38:10 servername kernel: [1290534.490159] 116254 total pagecache pages
Mar 21 19:38:10 servername kernel: [1290534.490160] 115409 pages in swap cache
Mar 21 19:38:10 servername kernel: [1290534.490161] Swap cache stats: add 122467031, delete 122351622, find 41640805/55232345
Mar 21 19:38:10 servername kernel: [1290534.490163] Free swap  = 0kB
Mar 21 19:38:10 servername kernel: [1290534.490164] Total swap = 2103292kB
Mar 21 19:38:10 servername kernel: [1290534.490191] 2064746 pages RAM
Mar 21 19:38:10 servername kernel: [1290534.490335] Out of memory: Kill process 6540 (carbon-cache.py) score 696 or sacrifice child
Mar 21 19:38:10 servername kernel: [1290534.490342] Killed process 6540 (carbon-cache.py) total-vm:7596612kB, anon-rss:5429104kB, file-rss:12kB

I found that today process 6540 was still present when I did a ps -ef.
So the /var/log/warn says that it "Killed process 6540" but it didn't
kill it complete.  I think it just stabbed it in the leg and let it
bleed slowly.  When I ran "service carbon-cache status" it told me that
one was running, and the other was failed.  ( I run 2 cache's on a
server with a single relay in front of it).

-- 
You received this question notification because you are a member of
graphite-dev, which is an answer contact for Graphite.