← Back to team overview

graphite-dev team mailing list archive

[Question #186498]: MemoryError when running an intensive maximumAbove

 

New question #186498 on Graphite:
https://answers.launchpad.net/graphite/+question/186498

When running a MaximumAbove over ~3k whisper files on a dedicated 16GB of DDR3 + Intel320 SSD, I'm getting this from the graphite-web:

Traceback (most recent call last):
  File "/usr/local/lib/python2.6/dist-packages/django/core/handlers/base.py", line 111, in get_response
    response = callback(request, *callback_args, **callback_kwargs)
  File "./graphite/render/views.py", line 105, in renderView
    seriesList = evaluateTarget(requestContext, target)
  File "./graphite/render/evaluator.py", line 10, in evaluateTarget
    result = evaluateTokens(requestContext, tokens)
  File "./graphite/render/evaluator.py", line 21, in evaluateTokens
    return evaluateTokens(requestContext, tokens.expression)
  File "./graphite/render/evaluator.py", line 28, in evaluateTokens
    args = [evaluateTokens(requestContext, arg) for arg in tokens.call.args]
  File "./graphite/render/evaluator.py", line 21, in evaluateTokens
    return evaluateTokens(requestContext, tokens.expression)
  File "./graphite/render/evaluator.py", line 24, in evaluateTokens
    return fetchData(requestContext, tokens.pathExpression)
  File "./graphite/render/datalib.py", line 227, in fetchData
    dbResults = dbFile.fetch( timestamp(startTime), timestamp(endTime) )
  File "./graphite/storage.py", line 295, in fetch
    (timeInfo,values) = whisper.fetch(self.fs_path, startTime, endTime)
  File "/usr/local/lib/python2.6/dist-packages/whisper.py", line 643, in fetch
    return file_fetch(fh, fromTime, untilTime)
  File "/usr/local/lib/python2.6/dist-packages/whisper.py", line 709, in file_fetch
    unpackedSeries = struct.unpack(seriesFormat, seriesString)
MemoryError

Memcached has 4G allocated, currently using 205MB. The uwsgi handling the request does not crash or harakiri itself, it just stops working after about 10'.

-- 
You received this question notification because you are a member of
graphite-dev, which is an answer contact for Graphite.