← Back to team overview

openstack team mailing list archive

Re: [SWIFT] Proxies Sizing for 90.000 / 200.000 RPM

 

While I can't answer your question (I've never used swift) - it's worth
mentioning many of the openstack folks are en-route/at the design summit.

Also - you might have more luck on the openstack-operators list, rather
than the general list.

Kiall
On Oct 15, 2012 2:57 PM, "Alejandro Comisario" <
alejandro.comisario@xxxxxxxxxxxxxxxx> wrote:

> Its worth to know that the objects in the cluster, are going to be from
> 200KB the biggest and 50KB the tiniest.
> Any considerations regarding this ?
>
> -----
> alejandrito
>
> On Thu, Oct 11, 2012 at 8:28 PM, Alejandro Comisario <
> alejandro.comisario@xxxxxxxxxxxxxxxx> wrote:
>
>> Hi Stackers !
>> This is the thing, today we have a 24 datanodes (3 copies, 90TB usables)
>> each datanode has 2 intel hexacores CPU with HT and 96GB of RAM, and 6
>> Proxies with the same hardware configuration, using swift 1.4.8 with
>> keystone.
>> Regarding the networking, each proxy / datanodes has a dual 1Gb nic,
>> bonded in LACP mode 4, each of the proxies are behind an F5 BigIP Load
>> Balancer ( so, no worries over there ).
>>
>> Today, we are receiving 5000 RPM ( Requests per Minute ) with 660 RPM per
>> Proxies, i know its low, but now ... with a new product migration, soon (
>> really soon ) we are expecting to receive about a total of 90.000 RPM
>> average ( 1500 req / s ) with weekly peaks of 200.000 RPM ( 3500 req / s )
>> to the swift api, witch will be 90% public gets ( no keystone auth ) and
>> 10% authorized PUTS (keystone in the middle, worth to know that we have a
>> 10 keystone vms pool, connected to a 5 nodes galera mysql cluster, so no
>> worries there either )
>>
>> So, 3500 req/s divided by 6 proxy nodes doesnt sounds too much, but well,
>> its a number that we cant ignore.
>> What do you think about this numbers? does this 6 proxies sounds good, or
>> we should double or triple the proxies ? Does anyone has this size of
>> requests and can share their configs ?
>>
>> Thanks a lot, hoping to ear from you guys !
>>
>> -----
>> alejandrito
>>
>
>
> _______________________________________________
> Mailing list: https://launchpad.net/~openstack
> Post to     : openstack@xxxxxxxxxxxxxxxxxxx
> Unsubscribe : https://launchpad.net/~openstack
> More help   : https://help.launchpad.net/ListHelp
>
>

Follow ups

References