← Back to team overview

graphite-dev team mailing list archive

[Question #212686]: Carbon aggregation and rewrite rules

 

New question #212686 on Graphite:
https://answers.launchpad.net/graphite/+question/212686

I have a setup where I am receiving metrics via UDP from many hosts – see carbon.conf configuration file below.  I need to rewrite some of the metric names before they are saved in the database.  In reviewing the documentation, it is possible to do that via the rewrite-rules.conf, which requires that I first enable carbon aggregation.  Since I am already receiving metrics via UDP, I would like to have the carbon aggregator to receive those via the UDP protocol, apply any rewrite rules, then store the metrics.  In this case, the carbon aggregator is the same as my carbon cache host.  

In trying to get this to work, it does not look like carbon aggregator will start on a UDP port.  When I have started and stopped the daemon, it never starts a service on the UDP port specified - I have looked at the log messages that get generated and 'ss -ua' command.

Note: the aggregation-rules.conf and rewrite-rules.conf are files that exist, but they are empty – zero bytes.

Questions:
1.	Can the aggregator run on a UDP port?
2.	Is my configuration file correct? 
3.	Anything else I should be looking at?

carbon.conf file:
[cache]
LOCAL_DATA_DIR = /raid/whisper/
USER = carbon
MAX_CACHE_SIZE = inf
MAX_UPDATES_PER_SECOND = inf
MAX_CREATES_PER_MINUTE = inf
LINE_RECEIVER_INTERFACE = 0.0.0.0
LINE_RECEIVER_PORT = 2023
ENABLE_UDP_LISTENER = True
UDP_RECEIVER_INTERFACE = 0.0.0.0
UDP_RECEIVER_PORT = 2023
PICKLE_RECEIVER_INTERFACE = 0.0.0.0
PICKLE_RECEIVER_PORT = 2004
USE_INSECURE_UNPICKLER = False
CACHE_QUERY_INTERFACE = 0.0.0.0
CACHE_QUERY_PORT = 7002
USE_FLOW_CONTROL = True
LOG_UPDATES = False
WHISPER_AUTOFLUSH = False

 [relay]
LINE_RECEIVER_INTERFACE = 0.0.0.0
LINE_RECEIVER_PORT = 2013
PICKLE_RECEIVER_INTERFACE = 0.0.0.0
PICKLE_RECEIVER_PORT = 2014
RELAY_METHOD = rules
REPLICATION_FACTOR = 1
DESTINATIONS = 127.0.0.1:2004
MAX_DATAPOINTS_PER_MESSAGE = 500
MAX_QUEUE_SIZE = 10000
USE_FLOW_CONTROL = True

[aggregator]
LINE_RECEIVER_INTERFACE = 0.0.0.0
LINE_RECEIVER_PORT = 2003
PICKLE_RECEIVER_INTERFACE = 0.0.0.0
PICKLE_RECEIVER_PORT = 2024
ENABLE_UDP_LISTENER = True
UDP_RECEIVER_INTERFACE = 0.0.0.0
UDP_RECEIVER_PORT = 2003
DESTINATIONS = 127.0.0.1:2023
REPLICATION_FACTOR = 1
MAX_QUEUE_SIZE = 10000
USE_FLOW_CONTROL = True
MAX_DATAPOINTS_PER_MESSAGE = 500
MAX_AGGREGATION_INTERVALS = 5


Thanks,
--Curt



-- 
You received this question notification because you are a member of
graphite-dev, which is an answer contact for Graphite.