← Back to team overview

openstack team mailing list archive

Re: [OpenStack][Swift] Fast way of uploading 200GB of 200KB files to Swift


I see. With replication switched off during upload, does inserting into
various containers speed up the process or is it irrelevant?

On Mon, Jan 14, 2013 at 1:49 PM, Robert van Leeuwen <
Robert.vanLeeuwen@xxxxxxxxxxxxx> wrote:

>  > According to the info below, i think the current size is 256 right?
> > If I format the storage partition, will that automatically clear all the
> contents from the storage or do I need to clean something else as well?
> >
> > Output from xfs_info:
> > meta-data=/dev/sda3              isize=256    agcount=4, agsize=13309312
> blks
> Yes, this is the wrong inode size.
> When you format the disk on one node it will start to sync the removed
> data back from the other nodes to this machine (as long as the
> object-replicator is running on the other nodes).
> Note that this can take a pretty long time. (our nodes with millions of
> files more then a week to sync)
> If you want to throw away everything and start with a empty cluster my
> guess is you would need to stop everything and also remove the account and
> container databases.
> I've never done this so I can't tell you for sure if that does not break
> anything or if it needs any manual intervention to re-create the databases.
> Cheers,
> Robert
> _______________________________________________
> Mailing list: https://launchpad.net/~openstack
> Post to     : openstack@xxxxxxxxxxxxxxxxxxx
> Unsubscribe : https://launchpad.net/~openstack
> More help   : https://help.launchpad.net/ListHelp

Follow ups