graphite-dev team mailing list archive

[Steve Keller <question101729@xxxxxxxxxxxxxxxxxxxxx>]

New question #101729 on Graphite:
https://answers.launchpad.net/graphite/+question/101729

Hi - I don't use Graphite (yet), but it looks as if it can solve a big problem for me.  We currently use Opsview as our monitoring system, collecting about 1.5 million data points per day.  Opsview has a data warehouse capability which I plugged into our existing graphing application (an internally developed tool).  However, we have latency problems that keep the database from being updated regularly (the code that the Opsview team wrote didn't help here either) because of table locks when insertions are happening.  

This data is also stored locally in RRD databases - it looks to me as if I could bypass the data warehouse thing and just store the data in Whisper databases located near the monitoring systems.  We have 7 monitoring systems in each of two data centers (it's the remote data center that causes the DB locks mentioned above).

We would either have 2 or 14 Whisper databases:  Opsview currently has 1 "runtime" DB for each monitoring system, but the RRDs are stored locally on the Opsview system itself.  But I don't know if it would be better to use one Whisper DB for each monitoring system (approximately 100K data points daily) or one for each data center (approximately 750K data points daily).

So, the million-data-point question is this - can a Graphite front end successfully integrate data from multiple remote locations?  That is, can I look at data from multiple Whisper databases simultaneously, and has anyone ever implemented a system where one or more databases is located several hundred milliseconds away?  (Our data centers are in San Jose and Virginia.)  

And if that is possible, what is the maximum latency that is supported by this system?  For various reasons, it would be better for us to have monitoring systems in multiple remote locations, some that are far away, latency wise.

Thanks so much


-- 
You received this question notification because you are a member of
graphite-dev, which is an answer contact for Graphite.