← Back to team overview

openstack team mailing list archive

Re: [SWIFT] Proxies Sizing for 90.000 / 200.000 RPM

 

Guys ??
Anyone ??

*
*
*
*
*Alejandro Comisario
#melicloud CloudBuilders*
Arias 3751, Piso 7 (C1430CRG)
Ciudad de Buenos Aires - Argentina
Cel: +549(11) 15-3770-1857
Tel : +54(11) 4640-8443


On Mon, Oct 15, 2012 at 11:59 AM, Kiall Mac Innes <kiall@xxxxxxxxxxxx>wrote:

> While I can't answer your question (I've never used swift) - it's worth
> mentioning many of the openstack folks are en-route/at the design summit.
>
> Also - you might have more luck on the openstack-operators list, rather
> than the general list.
>
> Kiall
> On Oct 15, 2012 2:57 PM, "Alejandro Comisario" <
> alejandro.comisario@xxxxxxxxxxxxxxxx> wrote:
>
>> Its worth to know that the objects in the cluster, are going to be from
>> 200KB the biggest and 50KB the tiniest.
>> Any considerations regarding this ?
>>
>> -----
>> alejandrito
>>
>> On Thu, Oct 11, 2012 at 8:28 PM, Alejandro Comisario <
>> alejandro.comisario@xxxxxxxxxxxxxxxx> wrote:
>>
>>> Hi Stackers !
>>> This is the thing, today we have a 24 datanodes (3 copies, 90TB usables)
>>> each datanode has 2 intel hexacores CPU with HT and 96GB of RAM, and 6
>>> Proxies with the same hardware configuration, using swift 1.4.8 with
>>> keystone.
>>> Regarding the networking, each proxy / datanodes has a dual 1Gb nic,
>>> bonded in LACP mode 4, each of the proxies are behind an F5 BigIP Load
>>> Balancer ( so, no worries over there ).
>>>
>>> Today, we are receiving 5000 RPM ( Requests per Minute ) with 660 RPM
>>> per Proxies, i know its low, but now ... with a new product migration, soon
>>> ( really soon ) we are expecting to receive about a total of 90.000 RPM
>>> average ( 1500 req / s ) with weekly peaks of 200.000 RPM ( 3500 req / s )
>>> to the swift api, witch will be 90% public gets ( no keystone auth ) and
>>> 10% authorized PUTS (keystone in the middle, worth to know that we have a
>>> 10 keystone vms pool, connected to a 5 nodes galera mysql cluster, so no
>>> worries there either )
>>>
>>> So, 3500 req/s divided by 6 proxy nodes doesnt sounds too much, but
>>> well, its a number that we cant ignore.
>>> What do you think about this numbers? does this 6 proxies sounds good,
>>> or we should double or triple the proxies ? Does anyone has this size of
>>> requests and can share their configs ?
>>>
>>> Thanks a lot, hoping to ear from you guys !
>>>
>>> -----
>>> alejandrito
>>>
>>
>>
>> _______________________________________________
>> Mailing list: https://launchpad.net/~openstack
>> Post to     : openstack@xxxxxxxxxxxxxxxxxxx
>> Unsubscribe : https://launchpad.net/~openstack
>> More help   : https://help.launchpad.net/ListHelp
>>
>>

Follow ups

References