graphite-dev team mailing list archive

Thread
Date

[Question #182603]: Bulk loading of existing data

To: graphite-dev@xxxxxxxxxxxxxxxxxxx
From: Kurt Telep <question182603@xxxxxxxxxxxxxxxxxxxxx>
Date: Thu, 22 Dec 2011 02:30:50 -0000
Reply-to: question182603@xxxxxxxxxxxxxxxxxxxxx
Sender: bounces@xxxxxxxxxxxxx

New question #182603 on Graphite:
https://answers.launchpad.net/graphite/+question/182603

I have a huge amount of existing data to load into Graphite.   I've found that unless I have a .5 second pause between every 30 or so records I insert that records get dropped, and the whisper files don't get created for the data being added.  

Is there any log that will actually show that this data is being dropped, as I don't see anything specifically in the logs.   Could it be that I'm pushing too much data to the socket and it's getting dropped?

Is there a better way for me to bulk load besides pushing it through carbon?

I've got about 2 billion rows to add initially, after that about 200 data points will be added every 2 minutes.

-- 
You received this question notification because you are a member of
graphite-dev, which is an answer contact for Graphite.