openstack team mailing list archive

[Christian Schwede <info@xxxxxxxxxxx>]

Hi Paras,

Am 08.05.13 22:02, schrieb Paras pradhan:
> Thanks Christian. How do we keep track of the usage? For example with 5
> nodes i.e 40TB. How do we know how much space has been consumed out of
> this 40TB?

well, that depends on the used authentication scheme. If you are using
swauth and don't have thousands of users, this gist might help you:

https://gist.github.com/cschwede/5559268

It reports the used bytes for every account and the total size. Please
note that the returned account list is not sorted.

On the other side you can simply monitor all of your disks, sum up all
used byte values and divide by the number of replicas (3).

You might also use account_quotas, which blocks further write requests
if the quota on an account is exceeded. It is especially useful for
smaller private storage clusters.

http://docs.openstack.org/developer/swift/misc.html#module-swift.common.middleware.account_quotas


Christian


> 
> Paras.
> 
> 
> 
> On Wed, May 8, 2013 at 2:44 PM, Christian Schwede <info@xxxxxxxxxxx
> <mailto:info@xxxxxxxxxxx>> wrote:
> 
>     Am 08.05.13 21:18, schrieb Paras pradhan:
>     > I have a three nodes swift cluster. I can see the objects being
>     > replicated to all three nodes.  Each node has 12 2TB disks. Since I
>     > have 3 replicas the usable space is only 24TB ?
> 
>     Yes, that's correct.
> 
>     > How this will scale up if we add two more storage nodes of the same
>     > capacity?
> 
>     5 * 12 * 2 / 3: ~ 40TB usable capacity.
> 
>     > Also, is there any tool to monitor the usage, health of the whole
>     > cluster?
> 
>     To detect failed drives you might have a look at
>     http://docs.openstack.org/developer/swift/admin_guide.html#detecting-failed-drives
> 
>     For Swift-related monitoring please refer to
>     http://docs.openstack.org/trunk/openstack-object-storage/admin/content/ch_introduction-to-openstack-object-storage-monitoring.html
> 
>     For general node monitoring you can use your preferred tool (Nagios,
>     Icinga, Shinken, RHQ, Hyperic...).
> 
>     _______________________________________________
>     Mailing list: https://launchpad.net/~openstack
>     Post to     : openstack@xxxxxxxxxxxxxxxxxxx
>     <mailto:openstack@xxxxxxxxxxxxxxxxxxx>
>     Unsubscribe : https://launchpad.net/~openstack
>     More help   : https://help.launchpad.net/ListHelp
> 
>