ubuntuone-users team mailing list archive

[Lucio Torre <lucio.torre@xxxxxxxxxxxxx>]

On 04/26/2010 03:21 PM, Andy Rogers wrote:
> etly sill after 3-4 weeks still trying to upload 6500 files to my U1 
> storage, and have been leaving my computer on for 6-12 each day.  So 
> far just under 5000 files have synced.
>
> I have been struggling the past week with getting more then 1 to 
> upload at a time, a Server Rescan is now taking more than an hour at 
> the minimum to complete, and once it finally does 1 file get uploaded 
> and then the following message's always then appear:-
>
> 2010-04-25 23:24:14,603 - ubuntuone.SyncDaemon.ActionQueue - ERROR - 
> Upload                       
> share:''                                       
> node:'91f3f378-2a00-499b-910c-9e7079bab924'   Upload(share_id="''", 
> hash="'sha1:1d79ab1f665a2d91e34fd2ca72d20fd29de3d2f2'", 
> fileobj_factory='<bound method FSKey.open_file of 
> <ubuntuone.syncdaemon.sync.FSKey object at 0xa753f04>>', 
> node_id="'91f3f378-2a00-499b-910c-9e7079bab924'", crc32='1255240749L', 
> previous_hash="''", size='3895352') failure INTERNAL_ERROR

Hi Andy,

Sorry that this is working so slow.

We are working right now on finishing the db migrations to increase our 
load capacity. I expect to see the speed of the whole system increase 
drastically during this week.

We have been noticing the increasing slowness and our plan to fix this 
has two steps:
1- finish adding the new database hardware (currently in progress)
2- redesign some of the less performing parts of the protocol (eg, 
server rescan) so it goes much faster. (there are lots of tricks and 
stuff that we want to do in here also, but he havent decided on what 
exactly we will do. This is work that is scheduled for the 10.10 
Maverick version)

Right now, for example, if you create a file and delete it before it 
gets to the server you will have queued two actions that require server 
work. the create and the remove. We would like to add some smarts to the 
client so when it sees the delete it can just remove the create and say 
nothing to the server.

This leads to the obvious recommendation: if you ask syncdaemon to do a 
lot of work and you want it to be done faster, removing files will only 
make the situation worse.

Regards,

Lucio.