graphite-dev team mailing list archive

Thread
Date
Re: [Question #148357]: federated storage and complex wildcard targets = suboptimal

To: graphite-dev@xxxxxxxxxxxxxxxxxxx
From: Kevin Blackham <question148357@xxxxxxxxxxxxxxxxxxxxx>
Date: Fri, 11 Mar 2011 22:12:11 -0000
Reply-to: question148357@xxxxxxxxxxxxxxxxxxxxx
Sender: bounces@xxxxxxxxxxxxx
Question #148357 on Graphite changed:
https://answers.launchpad.net/graphite/+question/148357

Kevin Blackham posted a new comment:
10.135.254.99 - - [11/Mar/2011:22:05:50 +0000] "GET /metrics/find/?local=1&format=pickle&query=app.tds.ut4.[0-9]*.storeData HTTP/1.1" 200 14559 "-" "-"
10.135.254.99 - - [11/Mar/2011:22:05:51 +0000] "GET /render/?target=app.tds.ut4.01.storeData&pickle=true&from=1299751506&until=1299881106 HTTP/1.1" 200 3852 "-" "-"
10.135.254.99 - - [11/Mar/2011:22:05:51 +0000] "GET /render/?target=app.tds.ut4.01-0.storeData&pickle=true&from=1299751506&until=1299881106 HTTP/1.1" 200 534 "-" "-"
10.135.254.99 - - [11/Mar/2011:22:05:51 +0000] "GET /render/?target=app.tds.ut4.01-1.storeData&pickle=true&from=1299751506&until=1299881106 HTTP/1.1" 200 3854 "-" "-"
10.135.254.99 - - [11/Mar/2011:22:05:51 +0000] "GET /render/?target=app.tds.ut4.01-2.storeData&pickle=true&from=1299751506&until=1299881106 HTTP/1.1" 200 3854 "-" "-"
10.135.254.99 - - [11/Mar/2011:22:05:51 +0000] "GET /render/?target=app.tds.ut4.01-3.storeData&pickle=true&from=1299751506&until=1299881106 HTTP/1.1" 200 3854 "-" "-"
10.135.254.99 - - [11/Mar/2011:22:05:51 +0000] "GET /render/?target=app.tds.ut4.02.storeData&pickle=true&from=1299751506&until=1299881106 HTTP/1.1" 200 3852 "-" "-"
10.135.254.99 - - [11/Mar/2011:22:05:51 +0000] "GET /render/?target=app.tds.ut4.02-0.storeData&pickle=true&from=1299751506&until=1299881106 HTTP/1.1" 200 534 "-" "-"
10.135.254.99 - - [11/Mar/2011:22:05:51 +0000] "GET /render/?target=app.tds.ut4.02-1.storeData&pickle=true&from=1299751506&until=1299881106 HTTP/1.1" 200 3854 "-" "-"
10.135.254.99 - - [11/Mar/2011:22:05:51 +0000] "GET /render/?target=app.tds.ut4.02-2.storeData&pickle=true&from=1299751506&until=1299881106 HTTP/1.1" 200 3854 "-" "-"
10.135.254.99 - - [11/Mar/2011:22:05:51 +0000] "GET /render/?target=app.tds.ut4.02-3.storeData&pickle=true&from=1299751506&until=1299881106 HTTP/1.1" 200 3854 "-" "-"
10.135.254.99 - - [11/Mar/2011:22:05:51 +0000] "GET /render/?target=app.tds.ut4.03.storeData&pickle=true&from=1299751506&until=1299881106 HTTP/1.1" 200 3852 "-" "-"
10.135.254.99 - - [11/Mar/2011:22:05:51 +0000] "GET /render/?target=app.tds.ut4.03-0.storeData&pickle=true&from=1299751506&until=1299881106 HTTP/1.1" 200 534 "-" "-"
10.135.254.99 - - [11/Mar/2011:22:05:51 +0000] "GET /render/?target=app.tds.ut4.03-1.storeData&pickle=true&from=1299751506&until=1299881106 HTTP/1.1" 200 3854 "-" "-"
10.135.254.99 - - [11/Mar/2011:22:05:51 +0000] "GET /render/?target=app.tds.ut4.03-2.storeData&pickle=true&from=1299751506&until=1299881106 HTTP/1.1" 200 3854 "-" "-"
10.135.254.99 - - [11/Mar/2011:22:05:51 +0000] "GET /render/?target=app.tds.ut4.03-3.storeData&pickle=true&from=1299751506&until=1299881106 HTTP/1.1" 200 3854 "-" "-"
10.135.254.99 - - [11/Mar/2011:22:05:51 +0000] "GET /render/?target=app.tds.ut4.04.storeData&pickle=true&from=1299751506&until=1299881106 HTTP/1.1" 200 3852 "-" "-"
10.135.254.99 - - [11/Mar/2011:22:05:51 +0000] "GET /render/?target=app.tds.ut4.04-0.storeData&pickle=true&from=1299751506&until=1299881106 HTTP/1.1" 200 534 "-" "-"
10.135.254.99 - - [11/Mar/2011:22:05:51 +0000] "GET /render/?target=app.tds.ut4.04-1.storeData&pickle=true&from=1299751506&until=1299881106 HTTP/1.1" 200 3854 "-" "-"
10.135.254.99 - - [11/Mar/2011:22:05:51 +0000] "GET /render/?target=app.tds.ut4.04-2.storeData&pickle=true&from=1299751506&until=1299881106 HTTP/1.1" 200 3854 "-" "-"
10.135.254.99 - - [11/Mar/2011:22:05:51 +0000] "GET /render/?target=app.tds.ut4.04-3.storeData&pickle=true&from=1299751506&until=1299881106 HTTP/1.1" 200 3854 "-" "-"

...and on and on...

Find is a wildcard.  Render is not.  I propose render also be a
wildcard, resulting in one large pickle.  This might be a fundamental
change, not optimal for some implementations.  A config knob?  I haven't
yet looked at this part of the code to see what it'd take to handle a
multi-match pickle render request.

-- 
You received this question notification because you are a member of
graphite-dev, which is an answer contact for Graphite.