openstack team mailing list archive

[Jasper Capel <Jasper.Capel@xxxxxxxxxxxxx>]

I've uploaded the checks we use in production here at Spil Games to https://github.com/spilgames/swift. Besides check_swift (which is a functional test) everything's meant to gather statistics from the cluster and we're looking to replace that with a Graphite-based solution to avoid having to parse access logs and having more real-time metrics available. Nothing fancy, but it may be of use to someone.

Jasper



On Feb 21, 2012, at 11:54 PM, Tim Bell wrote:

> 
> This does bring up a more generic problem of sharing the
> availability/performance code for all of the OpenStack components.
> 
> At the design summit, this was proposed as one of the example use cases of
> the OpenStack community forge (I forget the exact name) but it was intended
> as a place for sharing code/procedures which were not intended to be part of
> the core but may be of interest to others.
> 
> Was anything set up along these lines ?
> 
> A set of production quality Nagios/Ganglia sensors would be very interesting
> if someone has these....
> 
> Tim
> 
>> -----Original Message-----
>> From: openstack-bounces+tim.bell=cern.ch@xxxxxxxxxxxxxxxxxxx
>> [mailto:openstack-bounces+tim.bell=cern.ch@xxxxxxxxxxxxxxxxxxx] On Behalf
>> Of Jasper Capel
>> Sent: 21 February 2012 18:29
>> To: John Dickinson
>> Cc: openstack@xxxxxxxxxxxxxxxxxxx
>> Subject: Re: [Openstack] swprobe: swift middleware for sending metrics to
>> graphite using statsd
>> 
>> Hi John,
>> 
>> Apparently my google-fu is not up to snuff, as I wasn't aware of that
> project.
>> Had I been, I probably would've just extemded that one. :)
>> 
>> Cheers,
>> Jasper
>> 
>> ________________________________________
>> From: John Dickinson [me@xxxxxx]
>> Sent: Tuesday, February 21, 2012 5:44 PM
>> To: Jasper Capel
>> Cc: openstack@xxxxxxxxxxxxxxxxxxx
>> Subject: Re: [Openstack] swprobe: swift middleware for sending metrics to
>> graphite using statsd
>> 
>> That's great. Have you by any chance seen
>> https://github.com/pandemicsyn/swift-informant? It's something similar
>> that we've been playing with at Rackspace.
>> 
>> --John
>> 
>> 
>> On Feb 21, 2012, at 10:36 AM, Jasper Capel wrote:
>> 
>>> Hi all,
>>> 
>>> I'm announcing a piece of Swift middleware, swprobe [1], designed to
>> gather run-time metrics and ship them off to Graphite [2] for near
> real-time
>> monitoring. Currently it sends out bytes up- and downloaded per account,
>> http methods and response codes and timings in miliseconds on each call.
>>> 
>>> To be able to use this you need Graphite [2]. You also need statsd
> running,
>> preferably on the local machine since there potentially many small UDP
>> packets are being sent out. Please also note that we have not yet tested
> this
>> with production workloads.
>>> 
>>> [1] - https://github.com/spilgames/swprobe
>>> [2] - http://graphite.wikidot.com/
>>> [3] - https://github.com/etsy/statsd
>>> 
>>> Best regards,
>>> 
>>> --
>>> Jasper Capel
>>> Lead Infrastructure Engineer
>>> 
>>> W http://www.spilgames.com | S jwcapel-spil
>>> 
>>> 
>>> 
>>> _______________________________________________
>>> Mailing list: https://launchpad.net/~openstack
>>> Post to     : openstack@xxxxxxxxxxxxxxxxxxx
>>> Unsubscribe : https://launchpad.net/~openstack
>>> More help   : https://help.launchpad.net/ListHelp
>> 
>> 
>> _______________________________________________
>> Mailing list: https://launchpad.net/~openstack
>> Post to     : openstack@xxxxxxxxxxxxxxxxxxx
>> Unsubscribe : https://launchpad.net/~openstack
>> More help   : https://help.launchpad.net/ListHelp