graphite-dev team mailing list archive

[Nick Leskiw <nleskiw@xxxxxxxxx>]

In response to resizing, I usually use the find command to operate on all the files. 

something like

find /opt/graphite/storage/whisper -name '*.wsp' -type f -exec whisper-resize.py {} [RETENTIONS] \; 

I also do a dry run by echoing everything first, (-exec echo whisper-reszie.py {} ...) and then testing just a single small directory before doing the whole lot.  

If it's going to slowly, start multiple find processes, and make sure you either remove all the .bak files it creates or use the --no-backup option (this is not recommended, but sometimes necessary) 

-Nick

Sidnei da Silva <question212303@xxxxxxxxxxxxxxxxxxxxx> wrote:

>Question #212303 on Graphite changed:
>https://answers.launchpad.net/graphite/+question/212303
>
>    Status: Open => Answered
>
>Sidnei da Silva proposed the following answer:
>Setting MAX_UPDATES_PER_SECOND (3) should do the trick.
>
>You can find the optimal number by dividing 1/avgUpdateTime/number of
>carbon-cache processes and shooting for a little under that. Once you
>restrict the number of writes, carbon-cache will naturally queue up
>writes (which is (2) above).
>
>As an example, I have an installation handling 70000 metrics.
>avgUpdateTime was hovering around 0.005 with MAX_UPDATES_PER_SECOND 400
>and IO utilization was 100% consistently. This had 6 carbon-cache
>processes.
>
>So: 1/0.005/6 = 33.333333333333336. I've set MAX_UPDATES_PER_SECOND = 30
>for each carbon-cache and now IO is consistently below 10% with
>pointsPerUpdate hovering around 8. I could raise that a little bit to
>get pointsPerUpdate to 4-5, but haven't bothered so far.
>
>-- 
>You received this question notification because you are a member of
>graphite-dev, which is an answer contact for Graphite.
>
>_______________________________________________
>Mailing list: https://launchpad.net/~graphite-dev
>Post to     : graphite-dev@xxxxxxxxxxxxxxxxxxx
>Unsubscribe : https://launchpad.net/~graphite-dev
>More help   : https://help.launchpad.net/ListHelp