gnome-split-team team mailing list archive

Thread
Date
[Bug 2093022] [NEW] Add the fourmilab-ch SPLITS algorithm and the openhjsplit algorithm to GNOME Split and add INFOs in Help dialog

To: gnome-split-team@xxxxxxxxxxxxxxxxxxx
From: I2K <2093022@xxxxxxxxxxxxxxxxxx>
Date: Sun, 05 Jan 2025 14:50:25 -0000
Reply-to: Bug 2093022 <2093022@xxxxxxxxxxxxxxxxxx>
Sender: noreply@xxxxxxxxxxxxx
Public bug reported:

Add the fourmilab-ch SPLITS algorithm and the openhjsplit algorithm to
GNOME Split and add INFOs in Help dialog


I. Add the fourmilab-ch SPLITS algorithm and the openhjsplit algorithm
to GNOME Split

https://fourmilab.ch/splits/
https://github.com/marcomg/openhjsplit

NOTE: You may also need a file-archiver/file-compression and file-archive unpacking GUI/CLI app BEFORE splitting and/or merging a file or files, e.g.
https://p7zip.sourceforge.net/
https://peazip.github.io/peazip-portable.html
https://wiki.gnome.org/Apps/FileRoller
peazip
p7zip-full
7zip
xarchiver
zchunk
zutils
fsarchiver


II. Include the following example tutorial in the app's Help -> Simple
guide to split and merger under Windows OSs

The 1st option, most common and compatible with older Windows OSs:

Using Windows OS's 'Run...' -> cmd.exe :

copy /b example1.filetype + example2.filetype example.filetype

(NOTE: '.filetype' means the file extension of a file, followed by a '.' (dot) ASCII character; See also "MIME-types" app:
https://docs.xfce.org/xfce/xfce4-settings/4.18/preferred-apps
)

The 2nd option:

set n=2
for /l %i in (1,1,%n%) do type file%i.ext >> file.out

(Works on both text & binary files. Tested on Windows 10 OS's CMD.)


SOURCE:
https://superuser.com/questions/240086/how-can-i-combine-linux-split-files-on-windows


*** AND add INFOs in Help dialog (II. and III.) ***


III. Include the following example tutorial in the app's Help -> Simple
guide to split and merger under LINUX OSs

````

Terminal app -> bash (or zsh) ->
$ man split
$ man cat
or
$ info split
$ info cat
https://www.gnu.org/software/coreutils/manual/html_node/split-invocation.html#split-invocation


See also:
- clones of the ' $ cat ' command with additional features:

https://github.com/sharkdp/bat/
https://github.com/sharkdp/bat/releases/tag/v0.24.0
https://github.com/codenoid/bettercat/releases/tag/0.1.2
https://github.com/fjpereny/rust-cat
https://old.reddit.com/r/rust/comments/8g1saj/bat_a_cat1_clone_with_syntax_highlighting_and_git/
https://github.com/sunilhari/gat/tags
https://github.com/sunilhari/gat
https://github.com/danlynn/bat


* * *

Split and merge large files on Linux
Last update on 25.09.2012.	

Simple trick of how to split and merge back large files on Linux using
split and cat commands. split and cat commands belong to the GNU core
utilities which are expected to exist on every Linux operating system.
Means, every Linux distro is already prepared for split/merge files and
you only need to know how.

In my scenario, I wanted to copy virtual machine with 8GB disk image to the USB stick. USB stick has contained enough space but copying process stopped at 2GB with output message File too large. Here is report of file system disk space usage:
$ df -Th
Filesystem    Type    Size  Used Avail Use% Mounted on
/dev/sda1     ext2    7.9G  409M  7.1G   6% /
tmpfs        tmpfs    996M  552K  996M   1% /dev/shm
/dev/sdb5     ext4    204G   53G  141G  28% /home
/dev/sdb3     ext4    4.0G  140M  3.7G   4% /tmp
/dev/sda2     ext2     22G  5.8G   15G  29% /usr
/dev/sdb1     ext4     20G   13G  6.4G  66% /var
/dev/sdg1     vfat     16G  5.8G  9.5G  38% /media/CORSAIR

“T” switch of df command prints file system type. As you can see, CORSAIR USB stick has VFAT (FAT32) file system. FAT32 has 4GB file-size limit but it’s signed (for +/- seeking within a file), so the limit is 1/2 the range, hence 2GB total. The only workaround was to split large file into pieces. With split command, 8GB file was sliced to four 2GB files (before start split process, be sure to have enough free space on disk):
# split [option] [input [prefix]]
 
$ split --bytes=2048m WinXP.img WinXP_img_

After several minutes, four files (2GB each) appeared in the same directory:
WinXP_img_aa
WinXP_img_ab
WinXP_img_ac
WinXP_img_ad

Now copying sliced parts to the USB stick had been without problems. After files were copied to the new Linux host, four pieces should be returned to the original form. cat command can concatenate files and here is how:
# cat [option] [file]...
 
$ cat WinXP_img_* > WinXP.img

Hope this simple scenario will help you to split/merge large files on Linux.
````
SOURCE:
https://www.redips.net/linux/split-merge-large-files/


IV. You may also wish to make a Linux .sh script that semi-automates the use of ' $ split ' (and ' $ splits ), ' $ cat ', and any CLI version/usage of 'GNOME-Split', with optional confirmation question&answer for some of its CLI arguments/'--flag's, etc.
You may use find apps like 'clipman' and 'gclipboard', https://old.reddit.com/r/androidapps/comments/1bxd043/i_need_a_cross_platform_clipboard_manager_app/ , https://1clipboard.io/ (windows7/10 & macOS ONLY), https://ditto-cp.sourceforge.io/ (for Windows OSs), https://zapier.com/blog/best-clipboard-managers/ , etc. - useful for multiple clipboards, and also see file-chat apps like 'hexchat' and related xdcc/dcc for p2p-filesharing, and also see linux-dcpp, qbittorrent, rtorrent, and also see file-sharing protocols like ftp/sftp (via filezilla, gftp, lightftpd, ssh, openSSL), and see also CLI file downloader/uploader apps - curl, wget, wget2, lftp, aria2c, and see also p2p-filesharing apps like https://fex.belwue.de/ , https://github.com/schollz/croc/releases/tag/v10.1.0 , https://file.pizza/ , https://toffeeshare.com/ , https://fex.belwue.de/linuxtools/index.html , https://fex.belwue.de/fstools/ , https://fex.belwue.de/linuxtools/ddss.html , https://fex.belwue.de/linuxtools/linuxclone.html , https://fex.belwue.de/linuxtools/index.html , https://fex.belwue.de/linuxtools/bin/amount , https://fex.belwue.de/linuxtools/tmpmount.html ,  , https://www.google.com/search?client=firefox-b-d&q=g+clipboard+app+with+online+filesync+capabilities+for+file+sharing , and 'WiFi+USB file-sharing of files' apps for Google Android OS devices, etc.


Bug (more like a feature request...) submitted by sahwar (ve4ernik AT
gmail DOT com)

** Affects: gnome-split
     Importance: Undecided
         Status: New


** Tags: openhjsplit p7zip-full peazip splits zchunk

-- 
You received this bug notification because you are a member of GNOME
Split developers, which is subscribed to GNOME Split.
https://bugs.launchpad.net/bugs/2093022

Title:
  Add the fourmilab-ch SPLITS algorithm and the openhjsplit algorithm to
  GNOME Split and add INFOs in Help dialog

Status in GNOME Split:
  New

Bug description:
  Add the fourmilab-ch SPLITS algorithm and the openhjsplit algorithm to
  GNOME Split and add INFOs in Help dialog


  I. Add the fourmilab-ch SPLITS algorithm and the openhjsplit algorithm
  to GNOME Split

  https://fourmilab.ch/splits/
  https://github.com/marcomg/openhjsplit

  NOTE: You may also need a file-archiver/file-compression and file-archive unpacking GUI/CLI app BEFORE splitting and/or merging a file or files, e.g.
  https://p7zip.sourceforge.net/
  https://peazip.github.io/peazip-portable.html
  https://wiki.gnome.org/Apps/FileRoller
  peazip
  p7zip-full
  7zip
  xarchiver
  zchunk
  zutils
  fsarchiver


  II. Include the following example tutorial in the app's Help -> Simple
  guide to split and merger under Windows OSs

  The 1st option, most common and compatible with older Windows OSs:

  Using Windows OS's 'Run...' -> cmd.exe :

  copy /b example1.filetype + example2.filetype example.filetype

  (NOTE: '.filetype' means the file extension of a file, followed by a '.' (dot) ASCII character; See also "MIME-types" app:
  https://docs.xfce.org/xfce/xfce4-settings/4.18/preferred-apps
  )

  The 2nd option:

  set n=2
  for /l %i in (1,1,%n%) do type file%i.ext >> file.out

  (Works on both text & binary files. Tested on Windows 10 OS's CMD.)

  
  SOURCE:
  https://superuser.com/questions/240086/how-can-i-combine-linux-split-files-on-windows


  *** AND add INFOs in Help dialog (II. and III.) ***


  III. Include the following example tutorial in the app's Help ->
  Simple guide to split and merger under LINUX OSs

  ````

  Terminal app -> bash (or zsh) ->
  $ man split
  $ man cat
  or
  $ info split
  $ info cat
  https://www.gnu.org/software/coreutils/manual/html_node/split-invocation.html#split-invocation


  See also:
  - clones of the ' $ cat ' command with additional features:

  https://github.com/sharkdp/bat/
  https://github.com/sharkdp/bat/releases/tag/v0.24.0
  https://github.com/codenoid/bettercat/releases/tag/0.1.2
  https://github.com/fjpereny/rust-cat
  https://old.reddit.com/r/rust/comments/8g1saj/bat_a_cat1_clone_with_syntax_highlighting_and_git/
  https://github.com/sunilhari/gat/tags
  https://github.com/sunilhari/gat
  https://github.com/danlynn/bat

  
  * * *

  Split and merge large files on Linux
  Last update on 25.09.2012.	

  Simple trick of how to split and merge back large files on Linux using
  split and cat commands. split and cat commands belong to the GNU core
  utilities which are expected to exist on every Linux operating system.
  Means, every Linux distro is already prepared for split/merge files
  and you only need to know how.

  In my scenario, I wanted to copy virtual machine with 8GB disk image to the USB stick. USB stick has contained enough space but copying process stopped at 2GB with output message File too large. Here is report of file system disk space usage:
  $ df -Th
  Filesystem    Type    Size  Used Avail Use% Mounted on
  /dev/sda1     ext2    7.9G  409M  7.1G   6% /
  tmpfs        tmpfs    996M  552K  996M   1% /dev/shm
  /dev/sdb5     ext4    204G   53G  141G  28% /home
  /dev/sdb3     ext4    4.0G  140M  3.7G   4% /tmp
  /dev/sda2     ext2     22G  5.8G   15G  29% /usr
  /dev/sdb1     ext4     20G   13G  6.4G  66% /var
  /dev/sdg1     vfat     16G  5.8G  9.5G  38% /media/CORSAIR

  “T” switch of df command prints file system type. As you can see, CORSAIR USB stick has VFAT (FAT32) file system. FAT32 has 4GB file-size limit but it’s signed (for +/- seeking within a file), so the limit is 1/2 the range, hence 2GB total. The only workaround was to split large file into pieces. With split command, 8GB file was sliced to four 2GB files (before start split process, be sure to have enough free space on disk):
  # split [option] [input [prefix]]
   
  $ split --bytes=2048m WinXP.img WinXP_img_

  After several minutes, four files (2GB each) appeared in the same directory:
  WinXP_img_aa
  WinXP_img_ab
  WinXP_img_ac
  WinXP_img_ad

  Now copying sliced parts to the USB stick had been without problems. After files were copied to the new Linux host, four pieces should be returned to the original form. cat command can concatenate files and here is how:
  # cat [option] [file]...
   
  $ cat WinXP_img_* > WinXP.img

  Hope this simple scenario will help you to split/merge large files on Linux.
  ````
  SOURCE:
  https://www.redips.net/linux/split-merge-large-files/


  IV. You may also wish to make a Linux .sh script that semi-automates the use of ' $ split ' (and ' $ splits ), ' $ cat ', and any CLI version/usage of 'GNOME-Split', with optional confirmation question&answer for some of its CLI arguments/'--flag's, etc.
  You may use find apps like 'clipman' and 'gclipboard', https://old.reddit.com/r/androidapps/comments/1bxd043/i_need_a_cross_platform_clipboard_manager_app/ , https://1clipboard.io/ (windows7/10 & macOS ONLY), https://ditto-cp.sourceforge.io/ (for Windows OSs), https://zapier.com/blog/best-clipboard-managers/ , etc. - useful for multiple clipboards, and also see file-chat apps like 'hexchat' and related xdcc/dcc for p2p-filesharing, and also see linux-dcpp, qbittorrent, rtorrent, and also see file-sharing protocols like ftp/sftp (via filezilla, gftp, lightftpd, ssh, openSSL), and see also CLI file downloader/uploader apps - curl, wget, wget2, lftp, aria2c, and see also p2p-filesharing apps like https://fex.belwue.de/ , https://github.com/schollz/croc/releases/tag/v10.1.0 , https://file.pizza/ , https://toffeeshare.com/ , https://fex.belwue.de/linuxtools/index.html , https://fex.belwue.de/fstools/ , https://fex.belwue.de/linuxtools/ddss.html , https://fex.belwue.de/linuxtools/linuxclone.html , https://fex.belwue.de/linuxtools/index.html , https://fex.belwue.de/linuxtools/bin/amount , https://fex.belwue.de/linuxtools/tmpmount.html ,  , https://www.google.com/search?client=firefox-b-d&q=g+clipboard+app+with+online+filesync+capabilities+for+file+sharing , and 'WiFi+USB file-sharing of files' apps for Google Android OS devices, etc.


  Bug (more like a feature request...) submitted by sahwar (ve4ernik AT
  gmail DOT com)

To manage notifications about this bug go to:
https://bugs.launchpad.net/gnome-split/+bug/2093022/+subscriptions