touch-packages team mailing list archive

[Jan Groenewald <jan.groenewald@xxxxxxxxx>]

Hi

I think this is fixed in future rsync versions. For Ubuntu 14.04, exclude
ALL compression when rsyncing, e.v. chancve -az to -a.

Regards,
Jan

On 11 January 2016 at 12:56, Tom Worley <tom@xxxxxxxxxxxx> wrote:

> I can confirm I still get this error on Ubuntu 14.04 (all up to date)
> rsync:
> Both machines: 3.1.0-2ubuntu0.1
>
>
> File is a .sql.gz file, 1.5 GB in size, as above, --skip-compress=gz
> doesn't help:
>
> .....
> dbdump.sql.gz
>               0   0%    0.00kB/s    0:00:00
> inflate returned -3 (0 bytes)
> rsync error: error in rsync protocol data stream (code 12) at token.c(557)
> [receiver=3.1.0]
> rsync: connection unexpectedly closed (4092364 bytes received so far)
> [generator]
> rsync error: error in rsync protocol data stream (code 12) at io.c(226)
> [generator=3.1.0]
>
> --
> You received this bug notification because you are subscribed to a
> duplicate bug report (1431709).
> https://bugs.launchpad.net/bugs/1384503
>
> Title:
>   rsync fails on large files with compression
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/ubuntu/+source/rsync/+bug/1384503/+subscriptions
>

-- 
You received this bug notification because you are a member of Ubuntu
Touch seeded packages, which is subscribed to rsync in Ubuntu.
https://bugs.launchpad.net/bugs/1384503

Title:
  rsync fails on large files with compression

Status in rsync package in Ubuntu:
  Fix Released
Status in rsync source package in Trusty:
  Confirmed

Bug description:
  Copying large (>10GB) files with rsync -z (compression) leads to a
  long hang and eventual error after transferring part of the file.  The
  error is consistent.  The file copies at normal speed until it reaches
  its maximum size (1.4 GB out of 20 GB for one, 6.9 GB out of 29 GB for
  another).  Then nothing happens for a while (many minutes).  Finally,
  there is an error:

  [....]
  jh/.VirtualBox/win7/win7.vbox
  jh/.VirtualBox/win7/win7.vbox-prev
  jh/.VirtualBox/win7/win7.vdi
  rsync: [sender] write error: Broken pipe (32)
  rsync error: error in rsync protocol data stream (code 12) at io.c(837) [sender=3.1.0]

  In this case, 6.9 GB of 29 GB transferred.  Without -z, it works.

  See the following upstream report, with a comment at the end from the
  rsync maintainer:

  https://bugzilla.samba.org/show_bug.cgi?id=10372

  According to this report, version 3.1.0 (included in 14.04) uses a
  different compression package from prior versions.  Prior versions did
  not have this problem for me using the same command on the same
  systems. Both hosts ran Ubuntu 11.10 at the time, and all run 14.04
  now, in each case with all updates applied, Intel hardware.  Network
  connection between them is gigabit ethernet through one switch.  A
  shell ssh between them in a terminal works and stays up during the
  failure, so it is not a network issue.  There are no relevant entries
  in syslog on either machine.  There is sufficient capacity on the
  receiving disk.  All filesystems are ext4.

  rsync command:

  /usr/bin/rsync -aHSxvz --delete --stats --exclude=lost+found
  --exclude=.gvfs --exclude=/nonlaptop /home/
  backup.host.edu:/bu/host/home/

  (yes, I changed the machine names)

  Current release (both hosts):

  Description:	Ubuntu 14.04.1 LTS
  Release:	14.04

  Current package (both hosts):

  rsync:
    Installed: 3.1.0-2ubuntu0.1
    Candidate: 3.1.0-2ubuntu0.1
    Version table:
   *** 3.1.0-2ubuntu0.1 0
          500 http://us.archive.ubuntu.com/ubuntu/ trusty-updates/main amd64 Packages
          500 http://security.ubuntu.com/ubuntu/ trusty-security/main amd64 Packages
          100 /var/lib/dpkg/status
       3.1.0-2 0
          500 http://us.archive.ubuntu.com/ubuntu/ trusty/main amd64 Packages

  Thanks,

  --jh--

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/rsync/+bug/1384503/+subscriptions