graphite-dev team mailing list archive

[FRLinux <question214631@xxxxxxxxxxxxxxxxxxxxx>]

Question #214631 on Graphite changed:
https://answers.launchpad.net/graphite/+question/214631

FRLinux gave more information on the question:
Hello,

Here is my reporting after a week. My setup had one issue, I needed to
use carbon relay in persistent hashing mode then get all the caches to
report to it nicely. I have set max updates per second to 10 on mine,
caches do about 1000 metrics update per minute (so on a given box
1000*17) which gives roughly 283 metrics per second per cache.

My current setup is running with about 300.000 metrics per minute. This
is on 4 physical servers. Here is my setup in case that is of interest
to anyone:

cache 1 to 17 set up that way:

[cache:17]
USER = apache
LINE_RECEIVER_INTERFACE = 0.0.0.0
LINE_RECEIVER_PORT = 3603
PICKLE_RECEIVER_INTERFACE = 0.0.0.0
PICKLE_RECEIVER_PORT = 3604
CACHE_QUERY_INTERFACE = 0.0.0.0
CACHE_QUERY_PORT = 7217
MAX_CACHE_SIZE = inf
MAX_UPDATES_PER_SECOND = 10
WHISPER_AUTOFLUSH = False
LOG_UPDATES = False

[relay:1]
RELAY_METHOD = consistent-hashing
LINE_RECEIVER_INTERFACE = 0.0.0.0
LINE_RECEIVER_PORT = 2013
PICKLE_RECEIVER_INTERFACE = 0.0.0.0
PICKLE_RECEIVER_PORT = 2014
MAX_QUEUE_SIZE = 10000
MAX_DATAPOINTS_PER_MESSAGE = 500
USE_FLOW_CONTROL = True 
DESTINATIONS = carbon1:2004:1,carbon1:2104:2,carbon1:2204:3,carbon1:2304:4,carbon1:2404:5,carbon1:2504:6,carbon1:2604:7,carbon1:2704:8,carbon1:2804:9,carbon1:2904:10,carbon1:3004:11,carbon1:3104:12,carbon1:3204:13,carbon1:3304:14,carbon1:3404:15,carbon1:3504:16,carbon1:3604:17

Then obviously do the same for all the other carbons (carbon2 3 and 4).
My setup has 4 physical servers all running one relay per server and 17
caches. All writing back to semi fast NFS storage with some tuning.

On the webapp side you need to set it up to be able to query it all:

CARBONLINK_HOSTS = [
"carbon1:7201:1",
"carbon1:7202:2",
"carbon1:7203:3",
"carbon1:7204:4",
"carbon1:7205:5",
"carbon1:7206:6",
"carbon1:7207:7",
"carbon1:7208:8",
"carbon1:7209:9",
"carbon1:7210:10",
"carbon1:7211:11",
"carbon1:7212:12",
"carbon1:7213:13",
"carbon1:7214:14",
"carbon1:7215:15",
"carbon1:7216:16",
"carbon1:7217:17",
]

Hope this helps anyone, took me a while to get this one right
(hopefully).

-- 
You received this question notification because you are a member of
graphite-dev, which is an answer contact for Graphite.