graphite-dev team mailing list archive
-
graphite-dev team
-
Mailing list archive
-
Message #02615
Re: [Question #197816]: Mass ReSize of Metrics
Pass the path name in quotes, e.g. "*.wsp".
Jason Dixon
Sent from my iPhone
On May 19, 2012, at 2:30 PM, bhardy <question197816@xxxxxxxxxxxxxxxxxxxxx> wrote:
> New question #197816 on Graphite:
> https://answers.launchpad.net/graphite/+question/197816
>
> I am attempting to resize thousands of metrics and I am curious if anyone knows the most efficient way to do this (notes below). The servers are beefy and attached to SAN.
>
> I shutdown carbon while resizing metrics. If old find/exec is the only way to do this and will run for awhile, can this be done while carbon is running and not create any problems. I use a top level directory to find all metrics. Maybe going down a level or two and starting multiple resize scripts would also work to speed things up???
>
>
> XARGS does not work as it attempts to pass more than one wsp file name to the resize script and I get an error.
> find . -name *.wsp | xargs /usr/bin/whisper-resize.py 60:131400 --nobackup
>
> OLD EXEC works but takes a long time due to it going thru each and every whisper file one-by-one and not doing so in bulk.
> find . -name *.wsp -exec /usr/bin/whisper-resize.py {} 60:131400 --nobackup \;
>
> NEW EXEC does not work and suffers from the same problem as xargs.
> find . -name *.wsp -exec /usr/bin/whisper-resize.py 60:131400 --nobackup {} +
>
> GNU PARALLEL works but takes somewhat as long as old exec.
> find . -name \*.wsp | /usr/bin/parallel -j500 /usr/bin/whisper-resize.py {} 60:131400 --nobackup
>
> --
> You received this question notification because you are a member of
> graphite-dev, which is an answer contact for Graphite.
>
> _______________________________________________
> Mailing list: https://launchpad.net/~graphite-dev
> Post to : graphite-dev@xxxxxxxxxxxxxxxxxxx
> Unsubscribe : https://launchpad.net/~graphite-dev
> More help : https://help.launchpad.net/ListHelp
Follow ups
References