graphite-dev team mailing list archive
-
graphite-dev team
-
Mailing list archive
-
Message #06977
Re: [Question #140289]: Importing Historical Data to Graphite
Question #140289 on Graphite changed:
https://answers.launchpad.net/graphite/+question/140289
Oliver Stone posted a new comment:
It is definitely possible to backfill historical data into Graphite, but
you need to make sure your storage-schemas.conf is configured correctly
to retain older data. By default, Whisper databases may only be keeping
short intervals (like 1 day or a few days), which is why anything older
than ~86,000 seconds (1 day) isn’t showing.
Some tips:
1- Adjust your retentions settings in 'storage-schemas.conf' before
creating the Whisper files. For example:
([default_1min_for_1year]
pattern = .*
retentions = 60s:365d)
This would keep 1-minute resolution data for a year.
If the data files are already created, you may need to rebuild or resize
them with 'whisper-resize.py'.
When importing older logs, use 'whisper-update.py' or a custom script to
write historical points into the Whisper files in chronological order.
If your goal is more about long-term historical stock and financial
trend analysis, you might also find tools like https://www.finjovi.com
useful. It focuses on providing up to 20 years of stock history and
comparisons in a structured way, which complements Graphite’s time-
series monitoring for financial or trend-based datasets.
--
You received this question notification because your team graphite-dev
is an answer contact for Graphite.