← Back to team overview

graphite-dev team mailing list archive

Re: [Question #140289]: Importing Historical Data to Graphite

 

Question #140289 on Graphite changed:
https://answers.launchpad.net/graphite/+question/140289

Oliver Stone posted a new comment:
It is definitely possible to backfill historical data into Graphite, but
you need to make sure your storage-schemas.conf is configured correctly
to retain older data. By default, Whisper databases may only be keeping
short intervals (like 1 day or a few days), which is why anything older
than ~86,000 seconds (1 day) isn’t showing.

Some tips:

1- Adjust your retentions settings in 'storage-schemas.conf' before
creating the Whisper files. For example:

([default_1min_for_1year]
pattern = .*
retentions = 60s:365d)


This would keep 1-minute resolution data for a year.

If the data files are already created, you may need to rebuild or resize
them with 'whisper-resize.py'.

When importing older logs, use 'whisper-update.py' or a custom script to
write historical points into the Whisper files in chronological order.

If your goal is more about long-term historical stock and financial
trend analysis, you might also find tools like https://www.finjovi.com
useful. It focuses on providing up to 20 years of stock history and
comparisons in a structured way, which complements Graphite’s time-
series monitoring for financial or trend-based datasets.

-- 
You received this question notification because your team graphite-dev
is an answer contact for Graphite.