openstack team mailing list archive

[Jesse Andrews <anotherjesse@xxxxxxxxx>]

Nice!

Jay - are you expecting folks to run this on the same server or in the
same rack as the glance server?  (eg, do you expect the transfer
between the client and glance to make an noticeable impact on
performance)

Perhaps if people are going to share these numbers they should share
benchmarks on I/O (network - nuttcp between client/server and disk -
bonnie++ on storage systems that support it)?

J

On Mon, Jan 16, 2012 at 10:30 PM, Jay Pipes <jaypipes@xxxxxxxxx> wrote:
> Hi all,
>
> If you're interested in helping me gather throughput numbers for
> various Glance installations, please contact me. I wrote a little tool
> tonight that gathers some throughput details after attempting to
> concurrently add images to a Glance server.
>
> You can see the output of the tool below:
>
> jpipes@librebox:~/repos/tempest/tempest$ ./tools/glance-perf -v
> --processes=4 --create-num=12 --create-size-min=20
> Running ./tools/glance-perf against librebox
>  PROCESSES: 4
>  WORKLOAD: Create 12 images with size between 20MB and 100MB
>  CREATING LOCAL IMAGE FILES (this may take a while)
>  Creating local image file /tmp/tmpKVyclj/0.img of size 25MB ....... OK
>  Creating local image file /tmp/tmpKVyclj/1.img of size 56MB ....... OK
>  Creating local image file /tmp/tmpKVyclj/2.img of size 54MB ....... OK
>  Creating local image file /tmp/tmpKVyclj/3.img of size 53MB ....... OK
>  Creating local image file /tmp/tmpKVyclj/4.img of size 54MB ....... OK
>  Creating local image file /tmp/tmpKVyclj/5.img of size 72MB ....... OK
>  Creating local image file /tmp/tmpKVyclj/6.img of size 20MB ....... OK
>  Creating local image file /tmp/tmpKVyclj/7.img of size 56MB ....... OK
>  Creating local image file /tmp/tmpKVyclj/8.img of size 65MB ....... OK
>  Creating local image file /tmp/tmpKVyclj/9.img of size 74MB ....... OK
>  Creating local image file /tmp/tmpKVyclj/10.img of size 80MB ....... OK
>  Creating local image file /tmp/tmpKVyclj/11.img of size 58MB ....... OK
>  DONE CREATING IMAGE FILES
>  CREATING WORKER POOL
>  CREATING IMAGES VIA WORKERS
> Total time to add images: 7.63540 sec
>              throughput: 87.35624 MB/sec
>  REMOVING LOCAL IMAGE FILES
>  REMOVING IMAGES FROM GLANCE
>
> Anyway, if you're interested, I'm looking for feedback on a number of things:
>
> a) The types of workloads to add to the tool (currently tests
> concurrent uploads of images, but obviously I want to test real-world
> read/write workloads and am interested in getting feedback on what
> kind of read/write ratios you see in production (# index vs. # add vs.
> # delete, etc)
> b) I've built the tool to create image files using output from
> /dev/urandom of a configurable size (shown above is random image size
> between 20M and 100M). I'd like to get some feedback on the size of
> real-world images in use in production systems and then see what the
> impact of image size is to throughput
> c) If you have test systems that you wouldn't mind running my little
> tool against, I'm interested in gathering feedback on the throughput
> of the various Glance backend drivers -- Swift, S3, filesystem, RADOS,
> etc
>
> Lemme know by pinging me on email.
>
> Cheers,
> -jay
>
> _______________________________________________
> Mailing list: https://launchpad.net/~openstack
> Post to     : openstack@xxxxxxxxxxxxxxxxxxx
> Unsubscribe : https://launchpad.net/~openstack
> More help   : https://help.launchpad.net/ListHelp