openstack team mailing list archive

[Paras pradhan <pradhanparas@xxxxxxxxx>]

Thanks Christian you have been a good help !

Paras.


On Sat, May 11, 2013 at 3:14 AM, Christian Schwede <info@xxxxxxxxxxx> wrote:

> Hi Paras,
>
> Am 08.05.13 22:02, schrieb Paras pradhan:
> > Thanks Christian. How do we keep track of the usage? For example with 5
> > nodes i.e 40TB. How do we know how much space has been consumed out of
> > this 40TB?
>
> well, that depends on the used authentication scheme. If you are using
> swauth and don't have thousands of users, this gist might help you:
>
> https://gist.github.com/cschwede/5559268
>
> It reports the used bytes for every account and the total size. Please
> note that the returned account list is not sorted.
>
> On the other side you can simply monitor all of your disks, sum up all
> used byte values and divide by the number of replicas (3).
>
> You might also use account_quotas, which blocks further write requests
> if the quota on an account is exceeded. It is especially useful for
> smaller private storage clusters.
>
>
> http://docs.openstack.org/developer/swift/misc.html#module-swift.common.middleware.account_quotas
>
>
> Christian
>
>
> >
> > Paras.
> >
> >
> >
> > On Wed, May 8, 2013 at 2:44 PM, Christian Schwede <info@xxxxxxxxxxx
> > <mailto:info@xxxxxxxxxxx>> wrote:
> >
> >     Am 08.05.13 21:18, schrieb Paras pradhan:
> >     > I have a three nodes swift cluster. I can see the objects being
> >     > replicated to all three nodes.  Each node has 12 2TB disks. Since I
> >     > have 3 replicas the usable space is only 24TB ?
> >
> >     Yes, that's correct.
> >
> >     > How this will scale up if we add two more storage nodes of the same
> >     > capacity?
> >
> >     5 * 12 * 2 / 3: ~ 40TB usable capacity.
> >
> >     > Also, is there any tool to monitor the usage, health of the whole
> >     > cluster?
> >
> >     To detect failed drives you might have a look at
> >
> http://docs.openstack.org/developer/swift/admin_guide.html#detecting-failed-drives
> >
> >     For Swift-related monitoring please refer to
> >
> http://docs.openstack.org/trunk/openstack-object-storage/admin/content/ch_introduction-to-openstack-object-storage-monitoring.html
> >
> >     For general node monitoring you can use your preferred tool (Nagios,
> >     Icinga, Shinken, RHQ, Hyperic...).
> >
> >     _______________________________________________
> >     Mailing list: https://launchpad.net/~openstack
> >     Post to     : openstack@xxxxxxxxxxxxxxxxxxx
> >     <mailto:openstack@xxxxxxxxxxxxxxxxxxx>
> >     Unsubscribe : https://launchpad.net/~openstack
> >     More help   : https://help.launchpad.net/ListHelp
> >
> >
>
>