DO NOT REPLY [Bug 5801] New: Sparse (-S) option doesn't work withnew files - Tools

This is a discussion on DO NOT REPLY [Bug 5801] New: Sparse (-S) option doesn't work withnew files - Tools ; https://bugzilla.samba.org/show_bug.cgi?id=5801 Summary: Sparse (-S) option doesn't work with new files Product: rsync Version: 3.1.0 Platform: Other OS/Version: Linux Status: NEW Severity: normal Priority: P3 Component: core AssignedTo: wayned@samba.org ReportedBy: martin@scharrer-online.de QAContact: rsync-qa@samba.org Excuse me, this seems to be a known ...

+ Reply to Thread
Results 1 to 2 of 2

Thread: DO NOT REPLY [Bug 5801] New: Sparse (-S) option doesn't work withnew files

  1. DO NOT REPLY [Bug 5801] New: Sparse (-S) option doesn't work withnew files

    https://bugzilla.samba.org/show_bug.cgi?id=5801

    Summary: Sparse (-S) option doesn't work with new files
    Product: rsync
    Version: 3.1.0
    Platform: Other
    OS/Version: Linux
    Status: NEW
    Severity: normal
    Priority: P3
    Component: core
    AssignedTo: wayned@samba.org
    ReportedBy: martin@scharrer-online.de
    QAContact: rsync-qa@samba.org


    Excuse me, this seems to be a known issue, but I couldn't find any related
    existing bug for it.

    The 'handle sparse files efficiently' option (--sparse/-S) doesn't work with
    new files, i.e. files with doesn't exist on the destination. In this case all
    sparse blocks are transmitted as zero blocks which slows down the sync process
    heavily in some application.

    This issue was discussed already:
    http://lists.samba.org/archive/rsync...st/006998.html
    http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=337827



    OT:
    I detected this today when I was scripting something to sync some large video
    files in mkv format (around 1.1GB) with the last MB transfered first in order
    to watch the incomplete video while it was transfered. (BTW: An option in rsync
    for this would be awesome!!). To do this I created a sparse copy of the video
    with only the last MB holding real data using 'dd if=... of=.sparse/... count=0
    bs=1M seek=$SIZE_IN_MB_MINUS_ONE' and then rsyncing the .sparse dir first using
    -S. To my surprise this was as slow as the rsyncing of the real file.


    --
    Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
    ------- You are receiving this mail because: -------
    You are the QA contact for the bug, or are watching the QA contact.
    --
    Please use reply-all for most replies to avoid omitting the mailing list.
    To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
    Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


  2. DO NOT REPLY [Bug 5801] Speed up delta-transfer of zeros in newfiles with --sparse

    https://bugzilla.samba.org/show_bug.cgi?id=5801


    matt@mattmccutchen.net changed:

    What |Removed |Added
    ----------------------------------------------------------------------------
    Severity|normal |enhancement
    Summary|Sparse (-S) option doesn't |Speed up delta-transfer of
    |work with new files |zeros in new files with --
    | |sparse




    ------- Comment #1 from matt@mattmccutchen.net 2008-10-01 20:17 CST -------
    As currently designed, the --sparse option only affects writing of the
    destination file, not the transfer of the data, so this is an enhancement
    request. -z may help. It may be worth adding a special case for zero blocks
    to the delta-transfer algorithm, as suggested in the Debian bug report, to
    improve the behavior for sparse files without the full CPU-time penalty of
    compression.


    --
    Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
    ------- You are receiving this mail because: -------
    You are the QA contact for the bug, or are watching the QA contact.
    --
    Please use reply-all for most replies to avoid omitting the mailing list.
    To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
    Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


+ Reply to Thread