graphite-dev team mailing list archive

[Johnu George <question261219@xxxxxxxxxxxxxxxxxxxxx>]

New question #261219 on Graphite:
https://answers.launchpad.net/graphite/+question/261219

Hi All,

I am using collectd to collect system metrics which is sent to carbon cache. Now, I need to use skyline (https://github.com/etsy/skyline/wiki/Getting-Data-Into-Skyline)  where I have to use carbon relay to forward pickles to skyline listener. However, It is not able to get data from carbon. I couldn't understand the issue.  Collectd, carbon, graphite and skyline host is same. (172.29.86.27)

carbon.conf

[cache]

STORAGE_DIR    = /var/lib/graphite/
CONF_DIR       = /etc/carbon/
LOG_DIR        = /var/log/carbon/
PID_DIR        = /var/run/

LOCAL_DATA_DIR = /var/lib/graphite/whisper/
LINE_RECEIVER_INTERFACE = 0.0.0.0
LINE_RECEIVER_PORT = 2013

ENABLE_UDP_LISTENER = True
UDP_RECEIVER_INTERFACE = 0.0.0.0
UDP_RECEIVER_PORT = 2013

PICKLE_RECEIVER_INTERFACE = 0.0.0.0
PICKLE_RECEIVER_PORT = 2014

[relay]
LINE_RECEIVER_INTERFACE = 0.0.0.0
LINE_RECEIVER_PORT = 2003
PICKLE_RECEIVER_INTERFACE = 0.0.0.0
PICKLE_RECEIVER_PORT = 2004
ENABLE_UDP_LISTENER = True
UDP_RECEIVER_INTERFACE = 0.0.0.0
UDP_RECEIVER_PORT = 2003


RELAY_METHOD = rules
USE_FLOW_CONTROL = False

DESTINATIONS = 172.29.86.27:2024, 127.0.0.1:2014



relay-rules.conf

[all]
pattern = .*
destinations = 172.29.86.27:2024, 127.0.0.1:2014

[default]
default = true
destinations = 172.29.86.27:2024, 127.0.0.1:2014


collectd.conf

<Plugin write_graphite>
        <Node "graphing">
                Host "172.29.86.27"
                Port "2003"
                Protocol "udp"
                LogSendErrors true
                Prefix "collectd"
                Postfix "collectd"
                StoreRates true
                AlwaysAppendDS false
                EscapeCharacter "_"
        </Node>
</Plugin>

In my default collectd.conf, I had graphite port configured as 2013 (carbon-cache udp port).  Later, to make carbon-relay as primary listener for skyline, I changed port( in collectd.conf) to 2003. But, I still couldn't get anything forwarded to skyline.   However in both cases, I can see that whisper files are updated in /var/lib/graphite.  (only *.wsp files)

when I am issuing a  tcpdump -i lo port 2003, i can see udp packets. so, collectd is working fine but, carbon relay has some problems.

Additional observations

I have seen new whisper  files under carbon directory. 
/var/lib/graphite/whisper/carbon/relays/bd-1-2-a/destinations/127_0_0_1\:2014\:None/
     attemptedRelays.wsp  
queuedUntilReady.wsp  sent.wsp


Am I having the right configuration? 


-- 
You received this question notification because you are a member of
graphite-dev, which is an answer contact for Graphite.