← Back to team overview

ubuntuone-users team mailing list archive

Re: Server Rescans Help

 

Hi Lucio

Thanks for the reply the other, I have waited paitently since the Monday and
seem the Server Database's have been worked on following the annoucement's
yesterday.

However after trying today for 6 hours, I still am not seeing any better
performance with my Server Rescan times.

Andy

On 26 April 2010 22:05, Lucio Torre <lucio.torre@xxxxxxxxxxxxx> wrote:

> On 04/26/2010 03:21 PM, Andy Rogers wrote:
>
>> etly sill after 3-4 weeks still trying to upload 6500 files to my U1
>> storage, and have been leaving my computer on for 6-12 each day.  So far
>> just under 5000 files have synced.
>>
>> I have been struggling the past week with getting more then 1 to upload at
>> a time, a Server Rescan is now taking more than an hour at the minimum to
>> complete, and once it finally does 1 file get uploaded and then the
>> following message's always then appear:-
>>
>> 2010-04-25 23:24:14,603 - ubuntuone.SyncDaemon.ActionQueue - ERROR -
>> Upload                       share:''
>> node:'91f3f378-2a00-499b-910c-9e7079bab924'   Upload(share_id="''",
>> hash="'sha1:1d79ab1f665a2d91e34fd2ca72d20fd29de3d2f2'",
>> fileobj_factory='<bound method FSKey.open_file of
>> <ubuntuone.syncdaemon.sync.FSKey object at 0xa753f04>>',
>> node_id="'91f3f378-2a00-499b-910c-9e7079bab924'", crc32='1255240749L',
>> previous_hash="''", size='3895352') failure INTERNAL_ERROR
>>
>
> Hi Andy,
>
> Sorry that this is working so slow.
>
> We are working right now on finishing the db migrations to increase our
> load capacity. I expect to see the speed of the whole system increase
> drastically during this week.
>
> We have been noticing the increasing slowness and our plan to fix this has
> two steps:
> 1- finish adding the new database hardware (currently in progress)
> 2- redesign some of the less performing parts of the protocol (eg, server
> rescan) so it goes much faster. (there are lots of tricks and stuff that we
> want to do in here also, but he havent decided on what exactly we will do.
> This is work that is scheduled for the 10.10 Maverick version)
>
> Right now, for example, if you create a file and delete it before it gets
> to the server you will have queued two actions that require server work. the
> create and the remove. We would like to add some smarts to the client so
> when it sees the delete it can just remove the create and say nothing to the
> server.
>
> This leads to the obvious recommendation: if you ask syncdaemon to do a lot
> of work and you want it to be done faster, removing files will only make the
> situation worse.
>
> Regards,
>
> Lucio.
>
> _______________________________________________
> Mailing list: https://launchpad.net/~ubuntuone-users<https://launchpad.net/%7Eubuntuone-users>
> Post to     : ubuntuone-users@xxxxxxxxxxxxxxxxxxx
> Unsubscribe : https://launchpad.net/~ubuntuone-users<https://launchpad.net/%7Eubuntuone-users>
> More help   : https://help.launchpad.net/ListHelp
>

Follow ups

References