| Thread Previous • Date Previous • Date Next • Thread Next |
Question #170527 on Graphite changed:
https://answers.launchpad.net/graphite/+question/170527
Status: Open => Answered
cbrinley proposed the following answer:
The default carbon cache size is "infinite". You can set a limit to bound
memory utilization but it would imply dropping metrics. Probably not what
you want for this type of historical import. Carbon cache is largely IO
bound. I suspect a check of iostat/sar or similar will likely display
elevated IO_WAIT times.
The high level suggestion i would make at this point is to rate limit your
input. I am happy to help with some more concrete suggestions if you can
provide additional context:
Are you able to rate limit the sending process or generally what level of
control do you have over this process?
If your ability to modify this sending process is limited, do you have
access to extract and format the data outside of the sending process?
What are your acceptable levels of utilization of memory/CPU/IO?
Aprox how many total data points per metric do you wish to import?
Aprox how many total metrics are you attempting to import?
regards,
On Thu, Sep 8, 2011 at 3:35 AM, Dyna
<question170527@xxxxxxxxxxxxxxxxxxxxx>wrote:
> New question #170527 on Graphite:
> https://answers.launchpad.net/graphite/+question/170527
>
> I'm submitting old data into graphite. There is five data points collected
> each five minutes. We have a text based archive of the data which I'm
> parsing and sending to the carbon-cache daemon. It starts a-ok but when I've
> submitted a two years worth of data the daemon grind to a halt, eating up
> 75% of the memory of the box (messured in top) with only 2% of the CPU
> activity. It's a bog standard settings of carbon-cache nothing changed.. and
> it's the lates release i.e. graphite-web-0.9.8
>
> Cheers
>
> --
> You received this question notification because you are a member of
> graphite-dev, which is an answer contact for Graphite.
>
> _______________________________________________
> Mailing list: https://launchpad.net/~graphite-dev
> Post to : graphite-dev@xxxxxxxxxxxxxxxxxxx
> Unsubscribe : https://launchpad.net/~graphite-dev
> More help : https://help.launchpad.net/ListHelp
>
--
regards,
Chris Brinley
Cleartrial
e: cbrinley@xxxxxxxxxxxxxx
p: 312-460-3038
m: 219-789-2811
--
You received this question notification because you are a member of
graphite-dev, which is an answer contact for Graphite.
| Thread Previous • Date Previous • Date Next • Thread Next |
