graphite-dev team mailing list archive

[Steve Brunton <question83274@xxxxxxxxxxxxxxxxxxxxx>]

Question #83274 on Graphite changed:
https://answers.launchpad.net/graphite/+question/83274

Steve Brunton posted a new comment:
The precision level is at 15 minutes, but yes it's still a bunch of data
to cull through. The number of metrics and which metrics they are that
get calculated for various ranges (-15min, -1h, -1d, -2d, -1w, -2w,
-1mon) is also a sliding window based on the last 15 minute collection
of data. So yes, I'm doing some post-processing of this data after I
extract it out. Sometime in October when this goes live you'll easily
figure out what I'm doing.

The aggregate example that you use is what I'm attempting to do only the
data that I'm pulling out is then getting tossed through another
algorithm based on the total data set for that window and some numbers
get crunched and then stored off somewhere else. For the -15min range I
then do feed that back into Graphite for making graphs with later just
for posterity though really.

I just tried messing around with a test schema setup of "retentions =
900:4,3600:24,86400:7,604800:4" from my previous question about schemas
and that sort of works other than the "#TODO another CF besides
average?" where sum instead of an average is more my need along with an
always propagate upwards through all the precision levels. So even if a
data point only has one value in a 15min span a request for -1w would
show that value.

But, let me ask you this. If I setup something with 3600:720 (and for
all my other ranges) .. When I update that every 15 minutes it will only
return the last value put into it correct? so it wouldn't sum up the
four 15 minutes values placed in there for the total of all the values
and then roll to the next hour segment? If that is the case we had
already drawn up on a white board when we were first working this stuff
out a collect, collect, collect, collect, sum up, shift sort of thing.
So if as I do my data requests for calculations if I were to request the
-1h breakdown from the -15min schema, after I sum the four values it
gives me I take that and add it into the 1h schema... Yeah.. I'll have
to draw this up on a white board tomorrow to see if it'll work.

Thanks though. This gives me something to work with. I'm still sure
Graphite is the answer to my problem, I just need to figure out the best
way to store all the data in it to be able to also extract it out.

-- 
You received this question notification because you are a member of
graphite-dev, which is an answer contact for Graphite.