← Back to team overview

aims team mailing list archive

[Bug 1322264] Re: Munin fails to generate graph, stat should be less than end

 

@nacc: Well one of our customers had the issue that munin-graph was
producing serveral gigabytes (~3GB) of error logs within a very short
time-frame (hours).

the server & client was the latest 14.04 available munin/munin-node
package and the server was unable to poll the munin-node for several
weeks, i guess that triggered the messages.

I'm attaching a munin-graph.log snippet & the corresponding rrd file.


----------------cut-------------------
2017/03/22 09:03:32 [WARNING] Could not draw graph "/data_XXX/var_cache_munin_www/host.fqdn.domain/mongodb201.host.fqdn.domain/diskstats_utilization/vg00_var-day.png": /data_XXX/var_cache_munin_www/host.fqdn.domain/mongodb201.host.fqdn.domain/diskstats_utilization/vg00_var-day.png
2017/03/22 09:03:32 [RRD ERROR] Unable to graph /data_XXX/var_cache_munin_www/host.fqdn.domain/mongodb201.host.fqdn.domain/diskstats_utilization/vg00_var-week.png : start (1489449812) should be less than end (1489147500)
2017/03/22 09:03:32 [RRD ERROR] rrdtool 'graph' '/data_XXX/var_cache_munin_www/host.fqdn.domain/mongodb201.host.fqdn.domain/diskstats_utilization/vg00_var-week.png' \
        '--title' \
        'Disk utilization for /dev/vg00/var - by week' \
        '--start' \
        '-12000m' \
        '--base' \
        '1000' \
        '--lower-limit' \
        '0' \
        '--upper-limit' \
        '100' \
        '--rigid' \
        '--vertical-label' \
        '% busy' \
        '--slope-mode' \
        '--height' \
        '175' \
        '--width' \
        '400' \
        '--imgformat' \
        'PNG' \
        '--lazy' \
        '--units-exponent' \
        '0' \
        '--font' \
        'DEFAULT:0:DejaVuSans,DejaVu Sans,DejaVu LGC Sans,Bitstream Vera Sans' \
        '--font' \
        'LEGEND:7:DejaVuSansMono,DejaVu Sans Mono,DejaVu LGC Sans Mono,Bitstream Vera Sans Mono,monospace' \
        '--color' \
        'BACK#F0F0F0' \
        '--color' \
        'FRAME#F0F0F0' \
        '--color' \
        'CANVAS#FFFFFF' \
        '--color' \
        'FONT#666666' \
        '--color' \
        'AXIS#CFD6F8' \
        '--color' \
        'ARROW#CFD6F8' \
        '--border' \
        '0' \
        '-W' \
        'Munin 2.0.19-3' \
        'DEF:autil=/var/lib/munin/host.fqdn.domain/mongodb201.host.fqdn.domain-diskstats_utilization-vg00_var-util-g.rrd:42:MAX' \
        'DEF:iutil=/var/lib/munin/host.fqdn.domain/mongodb201.host.fqdn.domain-diskstats_utilization-vg00_var-util-g.rrd:42:MIN' \
        'DEF:gutil=/var/lib/munin/host.fqdn.domain/mongodb201.host.fqdn.domain-diskstats_utilization-vg00_var-util-g.rrd:42:AVERAGE' \
        'CDEF:cutil=gutil,POP,UNKN' \
        'COMMENT:           ' \
        'COMMENT: Cur\:' \
        'COMMENT:Min\:' \
        'COMMENT:Avg\:' \
        'COMMENT:Max\:  \j' \
        'LINE1:gutil#00CC00:Utilization ' \
        'GPRINT:cutil:LAST:%6.2lf' \
        'GPRINT:iutil:MIN:%6.2lf' \
        'GPRINT:gutil:AVERAGE:%6.2lf' \
        'GPRINT:autil:MAX:%6.2lf\j' \
        'COMMENT:Last update\: Fri Mar 10 13\:15\:11 2017\r' \
        '--end' \
        '1489147500'
2017/03/22 09:03:32 [WARNING] Could not draw graph "/data_XXX/var_cache_munin_www/host.fqdn.domain/mongodb201.host.fqdn.domain/diskstats_utilization/vg00_var-week.png": /data_XXX/var_cache_munin_www/host.fqdn.domain/mongodb201.host.fqdn.domain/diskstats_utilization/vg00_var-week.png
2017/03/22 09:03:32 [RRD ERROR] Unable to graph /data_XXX/var_cache_munin_www/host.fqdn.domain/mongodb201.host.fqdn.domain/diskstats_utilization/vg02_datadb2-day.png : start (1490049812) should be less than end (1489148100)
2017/03/22 09:03:32 [RRD ERROR] rrdtool 'graph' '/data_XXX/var_cache_munin_www/host.fqdn.domain/mongodb201.host.fqdn.domain/diskstats_utilization/vg02_datadb2-day.png' \
        '--title' \
        'Disk utilization for /dev/vg02/datadb2 - by day' \
        '--start' \
        '-2000m' \
        '--base' \
        '1000' \
        '--lower-limit' \
        '0' \
        '--upper-limit' \
        '100' \
        '--rigid' \
        '--vertical-label' \
        '% busy' \
        '--slope-mode' \
        '--height' \
        '175' \
        '--width' \
        '400' \
        '--imgformat' \
        'PNG' \
        '--lazy' \
        '--units-exponent' \
        '0' \
        '--font' \
        'DEFAULT:0:DejaVuSans,DejaVu Sans,DejaVu LGC Sans,Bitstream Vera Sans' \
        '--font' \
        'LEGEND:7:DejaVuSansMono,DejaVu Sans Mono,DejaVu LGC Sans Mono,Bitstream Vera Sans Mono,monospace' \
        '--color' \
        'BACK#F0F0F0' \
        '--color' \
        'FRAME#F0F0F0' \
        '--color' \
        'CANVAS#FFFFFF' \
        '--color' \
        'FONT#666666' \
        '--color' \
        'AXIS#CFD6F8' \
        '--color' \
        'ARROW#CFD6F8' \
        '--border' \
        '0' \
        '-W' \
        'Munin 2.0.19-3' \
        'DEF:autil=/var/lib/munin/host.fqdn.domain/mongodb201.host.fqdn.domain-diskstats_utilization-vg02_datadb2-util-g.rrd:42:MAX' \
        'DEF:iutil=/var/lib/munin/host.fqdn.domain/mongodb201.host.fqdn.domain-diskstats_utilization-vg02_datadb2-util-g.rrd:42:MIN' \
        'DEF:gutil=/var/lib/munin/host.fqdn.domain/mongodb201.host.fqdn.domain-diskstats_utilization-vg02_datadb2-util-g.rrd:42:AVERAGE' \
        'CDEF:cutil=gutil,POP,UNKN' \
        'COMMENT:           ' \
        'COMMENT: Cur\:' \
        'COMMENT:Min\:' \
        'COMMENT:Avg\:' \
        'COMMENT:Max\:  \j' \
        'LINE1:gutil#00CC00:Utilization ' \
        'GPRINT:cutil:LAST:%6.2lf' \
        'GPRINT:iutil:MIN:%6.2lf' \
        'GPRINT:gutil:AVERAGE:%6.2lf' \
        'GPRINT:autil:MAX:%6.2lf\j' \
        'COMMENT:Last update\: Fri Mar 10 13\:15\:11 2017\r' \
        '--end' \
        '1489148100'
----------------cut-------------------


** Attachment added: "mongodb201.host.fqdn.domain-diskstats_utilization-vg00_var-util-g.rrd"
   https://bugs.launchpad.net/ubuntu/+source/munin/+bug/1322264/+attachment/4847945/+files/mongodb201.host.fqdn.domain-diskstats_utilization-vg00_var-util-g.rrd

-- 
You received this bug notification because you are a member of AIMS,
which is subscribed to the bug report.
https://bugs.launchpad.net/bugs/1322264

Title:
  Munin fails to generate graph, stat should be less than end

Status in munin package in Ubuntu:
  Fix Released
Status in munin source package in Trusty:
  In Progress

Bug description:
  [Impact]

  * If rrd data is older than the graph period i.e. a week the graph
  fails to generate with error 'start should be less than end'.

  [Test Case]

  [Regression Potential]

  * This is a rather small and obvious bugfix from upstream. The only
  issue potentially is if a user manually backported the fix to their
  local code. Presuming they took the code directly from  upstream, then
  there is no problem, as the new code will be identical to their manual
  change.

  ---

  If rrd data is older than the graph period i.e. a week the graph fails
  to generate with error 'start should be less than end' issue has been
  reported and resolved upstream.

  Upstream issue http://munin-monitoring.org/ticket/1358 and upstream
  fix http://munin-
  monitoring.org/changeset/57243edbb3ce8a40a774826b37a1852530778721/munin

  The fix is minor, and effects trusty (I've not tested other versions).

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/munin/+bug/1322264/+subscriptions


Follow ups