graphite-dev team mailing list archive

[Petri Ojala <question202826@xxxxxxxxxxxxxxxxxxxxx>]

New question #202826 on Graphite:
https://answers.launchpad.net/graphite/+question/202826

Webapp has three remote carbon-cache's configured:
CARBONLINK_HOSTS = ["1.2.3.4:7102:a", "1.2.3.4:7202:b", "1.2.3.4:7302:c"]

When I browse the data, at 15:23 I see that both In.400 and In.399 are showing the most recent data but Out.399 is showing data until 15:09 and Out.400 is behind a lot at 14:46
query.logs show that they are being asked for cached data:

==> carbon-cache-b/query.log <==
11/07/2012 15:23:45 :: [128.214.4.118:37824] cache query for "net.fe.vallila1-rtr.ifHCInOctets.399" returned 17 values
11/07/2012 15:23:46 :: [128.214.4.118:37824] cache query for "net.fe.vallila1-rtr.ifHCOutOctets.400" returned 0 values
==> carbon-cache-c/query.log <==
11/07/2012 15:23:46 :: [128.214.4.118:54748] cache query for "net.fe.vallila1-rtr.ifHCOutOctets.399" returned 0 values
11/07/2012 15:23:46 :: [128.214.4.118:54748] cache query for "net.fe.vallila1-rtr.ifHCInOctets.400" returned 37 values

Also as the graph is updated, both In.400 and In.399 seem to be keeping up with the incoming data.  A bit later things change, at 15:39 I get both In.400 and In.399 still showing the most recent data but Out.399 is now at 15:09 and out.400 just a few minutes late at 15:37.  Again, caches are being queried:

==> carbon-cache-b/query.log <==
11/07/2012 15:39:10 :: [128.214.4.118:37854] cache query for "net.fe.vallila1-rtr.ifHCInOctets.399" returned 33 values
11/07/2012 15:39:10 :: [128.214.4.118:37854] cache query for "net.fe.vallila1-rtr.ifHCOutOctets.400" returned 0 values
==> carbon-cache-c/query.log <==
11/07/2012 15:39:10 :: [128.214.4.118:54765] cache query for "net.fe.vallila1-rtr.ifHCOutOctets.399" returned 0 values
11/07/2012 15:39:10 :: [128.214.4.118:54765] cache query for "net.fe.vallila1-rtr.ifHCInOctets.400" returned 2 values

All the data is being fed to carbon once every minute, probably in the same pickle packets as they come from the same sources.

What is holding back the data?  As soon as it becomes visible, there are no gaps so no data is lost.  What is causing the different data (from the same source) behave so differently?


There's also the behaviour that in the first case if I choose to view only the last 15 minutes, eg. go outside the scope of Out.400, the Out.400 is not show in the graph nor it is being queried from the cache.


-- 
You received this question notification because you are a member of
graphite-dev, which is an answer contact for Graphite.