graphite-dev team mailing list archive

[Yousef Fattal <question667840@xxxxxxxxxxxxxxxxxxxxx>]

New question #667840 on Graphite:
https://answers.launchpad.net/graphite/+question/667840

Hi

I have one panel on Grafana that has 7k+ metrics,, it's a big one but there is a reason behind it.

The panel is working fine on our 0.9.13 although it taking around 17 seconds one one carbon instance [a].

updated recently to 1.1.2 on another box to use more carbon instances[a-j], using 10 now, when I am trying to have the same exact panel it's timing out with the below error message

I am using Django 1.8

When I build the query and adding each query separately i can see the data but once i reach ~3000 it starts timing out. So it's only failing when more data is added to that panel.

&#10;<center>&#10;<h2>&#10;<p>Graphite encountered an unexpected error while handling your request.</p>&#10;<p>Please contact your site administrator if the problem persists.</p>&#10;</h2>&#10;<br>&#10;<div>&#10;&#10;</div>&#10;&#10;<div>&#10;<pre>Traceback (most recent call last):&#10;  File &#34;/usr/lib64/python2.7/site-packages/django/core/handlers/base.py&#34;, line 132, in get_response&#10;    response = wrapped_callback(request, *callback_args, **callback_kwargs)&#10;  File &#34;/graphite/webapp/graphite/render/views.py&#34;, line 117, in renderView&#10;    data.extend(evaluateTarget(requestContext, targets))&#10;  File &#34;/graphite/webapp/graphite/render/evaluator.py&#34;, line 15, in evaluateTarget&#10;    prefetchData(requestContext, pathExpressions)&#10;  File &#34;/graphite/webapp/graphite/render/datalib.py&#34;, line 257, in prefetchData&#10;    for result in STORE.fetch(pathExpressions, startTime, endTime, now, requestContext):&#10;  File &#34;/graphite/webapp/graphite/storage.py&#34;, line 179, in fetch&#10;    'fetch for %s' % str(patterns))&#10;  File &#34;/graphite/webapp/graphite/storage.py&#34;, line 121, in wait_jobs&#10;    raise Exception(message)&#10;Exception: Timed out after 6.001573s for fetch for [u'xxxx.xxx.*.*.*.*.*.*xxx']&#10;&#10;</pre>&#10;</div>&#10;&#10;</center>&#10;

Had to block the actual query for sensitive data.

Any ideas ?

Thank you

-- 
You received this question notification because your team graphite-dev
is an answer contact for Graphite.