graphite-dev team mailing list archive

[Magnus Brange <question242966@xxxxxxxxxxxxxxxxxxxxx>]

New question #242966 on Graphite:
https://answers.launchpad.net/graphite/+question/242966

I have a problem with that recent data points are not visible in the graphs. 

First, it could take up to 15 minutes before the data was seen in the graphs. And then there were all the recent data points there. Then it started to fall behind again. 

After some modification of carbon.conf, I put up two carbon-cache and a carbon-relay. 

It helped a little. It helped even more when I raised MAX_UPDATES_PER_SECOND. 

First I had MAX_UPDATES_PER_SECOND = 60.
Now I have 120 and two carbon-cache. (So 240)

But recent data points will still not be included in the graphs, they could be 2-3 minutes late.

Here is my carbon.conf: 
[cache]
ENABLE_LOGROTATION = True
USER =
MAX_CACHE_SIZE = inf
MAX_UPDATES_PER_SECOND = 120
MAX_UPDATES_PER_SECOND_ON_SHUTDOWN = 1500
MAX_CREATES_PER_MINUTE = 50
LINE_RECEIVER_INTERFACE = 0.0.0.0
LINE_RECEIVER_PORT = 2203
ENABLE_UDP_LISTENER = False
UDP_RECEIVER_INTERFACE = 0.0.0.0
UDP_RECEIVER_PORT = 2203
PICKLE_RECEIVER_INTERFACE = 0.0.0.0
PICKLE_RECEIVER_PORT = 2204
LOG_LISTENER_CONNECTIONS = False
USE_INSECURE_UNPICKLER = False
CACHE_QUERY_INTERFACE = 0.0.0.0
CACHE_QUERY_PORT = 7002
USE_FLOW_CONTROL = True
LOG_UPDATES = False
LOG_CACHE_HITS = False
LOG_CACHE_QUEUE_SORTS = False
CACHE_WRITE_STRATEGY = sorted
WHISPER_AUTOFLUSH = False
WHISPER_FALLOCATE_CREATE = True
[cache:b]
LINE_RECEIVER_PORT = 2103
PICKLE_RECEIVER_PORT = 2104
CACHE_QUERY_PORT = 7102
[relay]
LINE_RECEIVER_INTERFACE = 0.0.0.0
LINE_RECEIVER_PORT = 2003
PICKLE_RECEIVER_INTERFACE = 0.0.0.0
PICKLE_RECEIVER_PORT = 2004
RELAY_METHOD = consistent-hashing
REPLICATION_FACTOR = 1
DESTINATIONS = 127.0.0.1:2204:a, 127.0.0.1:2104:b
MAX_DATAPOINTS_PER_MESSAGE = 500
MAX_QUEUE_SIZE = 10000
USE_FLOW_CONTROL = True

And here's local_settings.py: 
CARBONLINK_HOSTS = ["127.0.0.1:7002: a", "127.0.0.1:7102: b"] 
CARBONLINK_TIMEOUT = 1.0 
I tried to change CARBONLINK_TIMEOUT to 5.0, but it did not help.

Anyone have any idea of what to do?
I have around 30k metrics/minute, and 3k/second.

-- 
You received this question notification because you are a member of
graphite-dev, which is an answer contact for Graphite.