I am trying to ethernet clone an uEFI systemd-boot (f.k.a. gummiboot) Arch Linux installation on a USB thumb drive to a new computer its NVMe drive. That NVMe drive already contains some partitions from an earlier cone attempt. Both source and destination drives are GPT partitioned. The partitions contain both FAT32 and btrfs file system. I have created 2 new USB sticks with archlinux-2018.07.01-x86_64.iso. First the source system is uEFI booted into that Arch Linux live OS. And Clonezilla expert selections were made like: "/usr/bin/ocs-onthefly -iefi -fsck -pa choose -a -f sdb". That source doesn't signal any error.
Then the destination system was booted, clonezilla started and remote-dest chosen. The output is like below:
# clonezilla
Clonezilla mode is remote-dest
Setting the TERM as xterm-color
Starting /usr/bin/ocs-onthefly at 2018-07-28 18:41:12 UTC...
/usr/share/drbl/sbin/ocs-functions: line 2794: service: command not found
Network is already configured! Available IP address on this machine: 192.168.7.3
Device cloning server is: 192.168.7.2
Excluding busy partition or disk...
Disk number: 1
Selected device [nvme0n1] found!
The selected devices: nvme0n1
Source machine: 192.168.7.2
Destination device on this machine: nvme0n1
Press "Enter" to continue......
*****************************************************.
My IP address in DRBL env: 192.168.7.3
GNU netcat 0.7.1, a rewrite of the famous networking tool.
Basic usages:
connect to somewhere: nc [options] hostname port [port] ...
listen for inbound: nc -l -p port [options] [hostname] [port] ...
tunnel to somewhere: nc -L hostname:port -p port [options]
Mandatory arguments to long options are mandatory for short options too.
Options:
-c, --close close connection on EOF from stdin
-e, --exec=PROGRAM program to exec after connect
-g, --gateway=LIST source-routing hop point[s], up to 8
-G, --pointer=NUM source-routing pointer: 4, 8, 12, ...
-h, --help display this help and exit
-i, --interval=SECS delay interval for lines sent, ports scanned
-l, --listen listen mode, for inbound connects
-L, --tunnel=ADDRESS:PORT forward local port to remote address
-n, --dont-resolve numeric-only IP addresses, no DNS
-o, --output=FILE output hexdump traffic to FILE (implies -x)
-p, --local-port=NUM local port number
-r, --randomize randomize local and remote ports
-s, --source=ADDRESS local source address (ip or hostname)
-t, --tcp TCP mode (default)
-T, --telnet answer using TELNET negotiation
-u, --udp UDP mode
-v, --verbose verbose (use twice to be more verbose)
-V, --version output version information and exit
-x, --hexdump hexdump incoming and outgoing traffic
-w, --wait=SECS timeout for connects and final net reads
-z, --zero zero-I/O mode (used for scanning)
Remote port number can also be specified as range. Example: '1-1024'
Using "-l port" when it's netcat listen mode.
///WARNING/// filesystem.squashfs not found! No idea where is LIVE MEDIA!!! Assume this is running in DRBL client.
Terminate partimage and nc processs if they exist...
pkill -u root partclone
pkill -u root partimage
pkill -u root ntfsclone
pkill -u root dd
pkill -u root nc
*****************************************************.
setterm: terminal xterm-color does not support --blank
*****************************************************.
Searching for data partition(s)...
Excluding busy partition or disk...
Unmounted partitions (including extended or swap): nvme0n1p1 nvme0n1p2 nvme0n1p3
Collecting info.... done!
Getting /dev/nvme0n1p1 info...
Getting /dev/nvme0n1p2 info...
Getting /dev/nvme0n1p3 info...
WARNING!!! WARNING!!! WARNING!!!
WARNING! THE EXISTING DATA IN THIS HARDDISK/PARTITION(S) WILL BE OVERWRITTEN! ALL EXISTING DATA WILL BE LOST: nvme0n1
*****************************************************.
Machine: Unknown product name
nvme0n1 (256GB_INTEL_SSDPEKKW256G7__INTEL_SSDPEKKW256G7_BTPY63510P43256D)
nvme0n1p1 (1G_vfat_NO_NAME(In_INTEL_SSDPEKKW256G7_)_INTEL_SSDPEKKW256G7_BTPY63510P43256D)
nvme0n1p2 (161G_btrfs(In_INTEL_SSDPEKKW256G7_)_INTEL_SSDPEKKW256G7_BTPY63510P43256D)
nvme0n1p3 (76.5G_btrfs(In_INTEL_SSDPEKKW256G7_)_INTEL_SSDPEKKW256G7_BTPY63510P43256D)
*****************************************************.
Are you sure you want to continue? (y/n) y
OK, let's do it!!
*****************************************************.
Let me ask you again.
WARNING!!! WARNING!!! WARNING!!!
WARNING! THE EXISTING DATA IN THIS HARDDISK/PARTITION(S) WILL BE OVERWRITTEN! ALL EXISTING DATA WILL BE LOST: nvme0n1
Are you sure you want to continue? (y/n) y
OK, let's do it!!
This is for target machine
gzip: stdin: unexpected end of file
tar: Child returned status 1
tar: Error is not recoverable: exiting now
/usr/bin/ocs-onthefly: line 1109: /tmp/ocs_onthefly_tgt.GCToQK/advanced_param.conf: No such file or directory
cp: cannot stat '/tmp/ocs_onthefly_tgt.GCToQK//tmp/ocs_onthefly_tgt.GCToQK/swappt-*.info': No such file or directory
/usr/bin/ocs-onthefly: line 2843: /tmp/ocs_onthefly_tgt.GCToQK/src_partition.info: No such file or directory
*****************************************************.
Will create the partition on the target machine...
Failed to create the partition table on the target device: /dev/nvme0n1
Program terminated!
Press "Enter" to continue......
clonezilla 7.81s user 3.00s system 26% cpu 40.775 total
The issue seems to be the source, that pauses after "Collecting info... done!" and line "**." Sending a break (Ctrl+c) outputs: No file system was found in /dev/1! Skip fsck.
When removed fsck, like "/usr/bin/ocs-onthefly -iefi -pa choose -a -f sdb" the commands runs without a pause up to "Waiting for the target machine to connect..."
The result when including option flag -fsck:
# /usr/bin/ocs-onthefly -iefi -fsck -pa choose -a -f sdb :(
Setting the TERM as xterm-color
Starting /usr/bin/ocs-onthefly at 2018-07-28 19:12:08 UTC...
/usr/share/drbl/sbin/ocs-functions: line 2794: service: command not found
Shutting down the Logical Volume Manager
Finished Shutting down the Logical Volume Manager
*****************************************************.
My IP address in DRBL env: 192.168.7.2
GNU netcat 0.7.1, a rewrite of the famous networking tool.
Basic usages:
connect to somewhere: nc [options] hostname port [port] ...
listen for inbound: nc -l -p port [options] [hostname] [port] ...
tunnel to somewhere: nc -L hostname:port -p port [options]
Mandatory arguments to long options are mandatory for short options too.
Options:
-c, --close close connection on EOF from stdin
-e, --exec=PROGRAM program to exec after connect
-g, --gateway=LIST source-routing hop point[s], up to 8
-G, --pointer=NUM source-routing pointer: 4, 8, 12, ...
-h, --help display this help and exit
-i, --interval=SECS delay interval for lines sent, ports scanned
-l, --listen listen mode, for inbound connects
-L, --tunnel=ADDRESS:PORT forward local port to remote address
-n, --dont-resolve numeric-only IP addresses, no DNS
-o, --output=FILE output hexdump traffic to FILE (implies -x)
-p, --local-port=NUM local port number
-r, --randomize randomize local and remote ports
-s, --source=ADDRESS local source address (ip or hostname)
-t, --tcp TCP mode (default)
-T, --telnet answer using TELNET negotiation
-u, --udp UDP mode
-v, --verbose verbose (use twice to be more verbose)
-V, --version output version information and exit
-x, --hexdump hexdump incoming and outgoing traffic
-w, --wait=SECS timeout for connects and final net reads
-z, --zero zero-I/O mode (used for scanning)
Remote port number can also be specified as range. Example: '1-1024'
Using "-l port" when it's netcat listen mode.
///WARNING/// filesystem.squashfs not found! No idea where is LIVE MEDIA!!! Assume this is running in DRBL client.
Terminate partimage and nc processs if they exist...
pkill -u root partclone
pkill -u root partimage
pkill -u root ntfsclone
pkill -u root dd
pkill -u root nc
*****************************************************.
setterm: terminal xterm-color does not support --blank
*****************************************************.
This is for source machine.
Saving the GPT of /dev/sdb as /tmp/ocs_onthefly_src.IOOB5N/src-gpt.gdisk by sgdisk...
The operation has completed successfully.
Saving the primary GPT of /dev/sdb as /tmp/ocs_onthefly_src.IOOB5N/src-gpt-1st.img by dd...
34+0 records in
34+0 records out
17408 bytes (17 kB, 17 KiB) copied, 0.00100174 s, 17.4 MB/s
Saving the secondary GPT of /dev/sdb as /tmp/ocs_onthefly_src.IOOB5N/src-gpt-2nd.img by dd...
32+0 records in
32+0 records out
16384 bytes (16 kB, 16 KiB) copied, 0.000516999 s, 31.7 MB/s
*****************************************************.
Collecting partition /dev/sdb1 info...
Collecting partition /dev/sdb2 info...
Collecting partition /dev/sdb3 info...
Setting up the Logical Volume Manager
Parsing LVM layout...
Shutting down the Logical Volume Manager
Finished Shutting down the Logical Volume Manager
*****************************************************.
Searching for data partition(s) in source disk: sdb ...
Excluding busy partition or disk...
Unmounted partitions (including extended or swap): sdb1 sdb2 sdb3
Collecting info.... done!
*****************************************************.
Seems that the fsck logic is somewhat off.
Additionally when skipping fsck and ocs-on-the-fly comes to "Waiting for the target machine to connect..." that still fails the remote-dest from restoring:
# clonezilla
Clonezilla mode is remote-dest
Setting the TERM as xterm-color
Starting /usr/bin/ocs-onthefly at 2018-07-28 19:09:20 UTC...
/usr/share/drbl/sbin/ocs-functions: line 2794: service: command not found
Network is already configured! Available IP address on this machine: 192.168.7.3
Device cloning server is: 192.168.7.2
Excluding busy partition or disk...
Disk number: 1
Selected device [nvme0n1] found!
The selected devices: nvme0n1
Source machine: 192.168.7.2
Destination device on this machine: nvme0n1
Press "Enter" to continue......
*****************************************************.
My IP address in DRBL env: 192.168.7.3
GNU netcat 0.7.1, a rewrite of the famous networking tool.
Basic usages:
connect to somewhere: nc [options] hostname port [port] ...
listen for inbound: nc -l -p port [options] [hostname] [port] ...
tunnel to somewhere: nc -L hostname:port -p port [options]
Mandatory arguments to long options are mandatory for short options too.
Options:
-c, --close close connection on EOF from stdin
-e, --exec=PROGRAM program to exec after connect
-g, --gateway=LIST source-routing hop point[s], up to 8
-G, --pointer=NUM source-routing pointer: 4, 8, 12, ...
-h, --help display this help and exit
-i, --interval=SECS delay interval for lines sent, ports scanned
-l, --listen listen mode, for inbound connects
-L, --tunnel=ADDRESS:PORT forward local port to remote address
-n, --dont-resolve numeric-only IP addresses, no DNS
-o, --output=FILE output hexdump traffic to FILE (implies -x)
-p, --local-port=NUM local port number
-r, --randomize randomize local and remote ports
-s, --source=ADDRESS local source address (ip or hostname)
-t, --tcp TCP mode (default)
-T, --telnet answer using TELNET negotiation
-u, --udp UDP mode
-v, --verbose verbose (use twice to be more verbose)
-V, --version output version information and exit
-x, --hexdump hexdump incoming and outgoing traffic
-w, --wait=SECS timeout for connects and final net reads
-z, --zero zero-I/O mode (used for scanning)
Remote port number can also be specified as range. Example: '1-1024'
Using "-l port" when it's netcat listen mode.
///WARNING/// filesystem.squashfs not found! No idea where is LIVE MEDIA!!! Assume this is running in DRBL client.
Terminate partimage and nc processs if they exist...
pkill -u root partclone
pkill -u root partimage
pkill -u root ntfsclone
pkill -u root dd
pkill -u root nc
*****************************************************.
setterm: terminal xterm-color does not support --blank
*****************************************************.
Searching for data partition(s)...
Excluding busy partition or disk...
Unmounted partitions (including extended or swap): nvme0n1p1 nvme0n1p2 nvme0n1p3
Collecting info.... done!
Getting /dev/nvme0n1p1 info...
Getting /dev/nvme0n1p2 info...
Getting /dev/nvme0n1p3 info...
WARNING!!! WARNING!!! WARNING!!!
WARNING! THE EXISTING DATA IN THIS HARDDISK/PARTITION(S) WILL BE OVERWRITTEN! ALL EXISTING DATA WILL BE LOST: nvme0n1
*****************************************************.
Machine: Unknown product name
nvme0n1 (256GB_INTEL_SSDPEKKW256G7__INTEL_SSDPEKKW256G7_BTPY63510P43256D)
nvme0n1p1 (1G_vfat_NO_NAME(In_INTEL_SSDPEKKW256G7_)_INTEL_SSDPEKKW256G7_BTPY63510P43256D)
nvme0n1p2 (161G_btrfs(In_INTEL_SSDPEKKW256G7_)_INTEL_SSDPEKKW256G7_BTPY63510P43256D)
nvme0n1p3 (76.5G_btrfs(In_INTEL_SSDPEKKW256G7_)_INTEL_SSDPEKKW256G7_BTPY63510P43256D)
*****************************************************.
Are you sure you want to continue? (y/n) y
OK, let's do it!!
*****************************************************.
Let me ask you again.
WARNING!!! WARNING!!! WARNING!!!
WARNING! THE EXISTING DATA IN THIS HARDDISK/PARTITION(S) WILL BE OVERWRITTEN! ALL EXISTING DATA WILL BE LOST: nvme0n1
Are you sure you want to continue? (y/n) y
OK, let's do it!!
This is for target machine
gzip: stdin: unexpected end of file
tar: Child returned status 1
tar: Error is not recoverable: exiting now
/usr/bin/ocs-onthefly: line 1109: /tmp/ocs_onthefly_tgt.VGfBmf/advanced_param.conf: No such file or directory
cp: cannot stat '/tmp/ocs_onthefly_tgt.VGfBmf//tmp/ocs_onthefly_tgt.VGfBmf/swappt-*.info': No such file or directory
/usr/bin/ocs-onthefly: line 2843: /tmp/ocs_onthefly_tgt.VGfBmf/src_partition.info: No such file or directory
*****************************************************.
Will create the partition on the target machine...
Failed to create the partition table on the target device: /dev/nvme0n1
Program terminated!
Press "Enter" to continue......
clonezilla 7.87s user 3.07s system 22% cpu 47.617 total
I have no clue why this happens.
PS I am going to try from remote to local cloning.
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
... (76.5G_btrfs(In_INTEL_SSDPEKKW256G7_)_INTEL_SSDPEKKW256G7_BTPY63510P43256D)
*****************************************************.
Are you sure you want to continue? (y/n) y
OK, let's do it!!
*****************************************************.
Let me ask you again.
WARNING!!! WARNING!!! WARNING!!!
WARNING! THE EXISTING DATA IN THIS HARDDISK/PARTITION(S) WILL BE OVERWRITTEN! ALL EXISTING DATA WILL BE LOST: nvme0n1
Are you sure you want to continue? (y/n) y
OK, let's do it!!
This is for target machine
gzip: stdin: unexpected end of file
tar: Child returned status 1
tar: Error is not recoverable: exiting now
/usr/bin/ocs-onthefly: line 1109: /tmp/ocs_onthefly_tgt.VGfBmf/advanced_param.conf: No such file or directory
cp: cannot stat '/tmp/ocs_onthefly_tgt.VGfBmf//tmp/ocs_onthefly_tgt.VGfBmf/swappt-*.info': No such file or directory
/usr/bin/ocs-onthefly: line 2843: /tmp/ocs_onthefly_tgt.VGfBmf/src_partition.info: No such file or directory
*****************************************************.
Will create the partition on the target machine...
Failed to create the partition table on the target device: /dev/nvme0n1
Program terminated!
Press "Enter" to continue......
clonezilla 7.87s user 3.07s system 22% cpu 47.617 total
1 root@archiso ~ # ls :(
install.txt
root@archiso ~ # lsblk
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
loop0 7:0 0 463M 1 loop /run/archiso/sfs/airootfs
sdb 8:16 1 29.9G 0 disk
├─sdb1 8:17 1 1G 0 part
├─sdb2 8:18 1 19.5G 0 part
└─sdb3 8:19 1 9.3G 0 part
sdc 8:32 1 28.9G 0 disk
├─sdc1 8:33 1 574M 0 part
└─sdc2 8:34 1 64M 0 part
nvme0n1 259:0 0 238.5G 0 disk
├─nvme0n1p1 259:1 0 1G 0 part
├─nvme0n1p2 259:2 0 161G 0 part
└─nvme0n1p3 259:3 0 76.5G 0 part
root@archiso ~ # clonezilla
Clonezilla mode is device-device
Setting the TERM as xterm-color
Starting /usr/bin/ocs-onthefly at 2018-07-28 19:16:25 UTC...
/usr/share/drbl/sbin/ocs-functions: line 2794: service: command not found
Excluding busy partition or disk...
Disk number: 3
Excluding busy partition or disk...
Disk number: 2
PS. Next time you can run this command directly:
/usr/bin/ocs-onthefly -iefi -v -sfsck -pa choose -f sdb -t nvme0n1
This command is also saved as this file name for later use if necessary: /tmp/ocs-onthefly-2018-07-28-19-17
*****************************************************.
Press "Enter" to continue...
*****************************************************.
///WARNING/// filesystem.squashfs not found! No idea where is LIVE MEDIA!!! Assume this is running in DRBL client.
*****************************************************.
setterm: terminal xterm-color does not support --blank
*****************************************************.
Searching for data partition(s)...
Excluding busy partition or disk...
Unmounted partitions (including extended or swap): nvme0n1p1 nvme0n1p2 nvme0n1p3
Collecting info.... done!
Getting /dev/nvme0n1p1 info...
Getting /dev/nvme0n1p2 info...
Getting /dev/nvme0n1p3 info...
WARNING!!! WARNING!!! WARNING!!!
WARNING! THE EXISTING DATA IN THIS HARDDISK/PARTITION(S) WILL BE OVERWRITTEN! ALL EXISTING DATA WILL BE LOST: nvme0n1
*****************************************************.
Machine: Unknown product name
nvme0n1 (256GB_INTEL_SSDPEKKW256G7__INTEL_SSDPEKKW256G7_BTPY63510P43256D)
nvme0n1p1 (1G_vfat_NO_NAME(In_INTEL_SSDPEKKW256G7_)_INTEL_SSDPEKKW256G7_BTPY63510P43256D)
nvme0n1p2 (161G_btrfs(In_INTEL_SSDPEKKW256G7_)_INTEL_SSDPEKKW256G7_BTPY63510P43256D)
nvme0n1p3 (76.5G_btrfs(In_INTEL_SSDPEKKW256G7_)_INTEL_SSDPEKKW256G7_BTPY63510P43256D)
*****************************************************.
Are you sure you want to continue? (y/n) y
OK, let's do it!!
*****************************************************.
Let me ask you again.
WARNING!!! WARNING!!! WARNING!!!
WARNING! THE EXISTING DATA IN THIS HARDDISK/PARTITION(S) WILL BE OVERWRITTEN! ALL EXISTING DATA WILL BE LOST: nvme0n1
Are you sure you want to continue? (y/n) y
OK, let's do it!!
*****************************************************.
Saving the GPT of /dev/sdb as /tmp/ocs_onthefly_local.Jmh26h/src-gpt.gdisk by sgdisk...
/usr/bin/ocs-onthefly: line 679: /usr/bin/sgdisk: Input/output error
Saving the primary GPT of /dev/sdb as /tmp/ocs_onthefly_local.Jmh26h/src-gpt-1st.img by dd...
34+0 records in
34+0 records out
17408 bytes (17 kB, 17 KiB) copied, 0.0002033 s, 85.6 MB/s
Saving the secondary GPT of /dev/sdb as /tmp/ocs_onthefly_local.Jmh26h/src-gpt-2nd.img by dd...
32+0 records in
32+0 records out
16384 bytes (16 kB, 16 KiB) copied, 0.0102705 s, 1.6 MB/s
*****************************************************.
Collecting partition /dev/sdb1 info...
Collecting partition /dev/sdb2 info...
Collecting partition /dev/sdb3 info...
PARTIMAGE_RESTORE_OPT:
PARTIMAGE_SAVE_OPT:
PARTCLONE_RESTORE_ONTHEFLY_OPT: -z 10485760 -N
SOURCE: sdb
TARGET: nvme0n1
PORT for netcat:
*****************************************************.
Will create the partition on the target machine...
/usr/bin/ocs-onthefly: line 328: /usr/bin/dirname: Input/output error
grep: /tgt-pt.parted: No such file or directory
/usr/share/drbl/sbin/ocs-functions: line 11332: /usr/bin/bc: Input/output error
/usr/share/drbl/sbin/ocs-functions: line 11334: /usr/bin/bc: Input/output error
Disk () size from image NOT found.
Program terminated!!
What am I doing wrong?
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
If I remember correctly, ocs-onthefly does not support multipath device, like /dev/cciss/c0d0.
Newer Linux kernel seems to use /dev/sda for /dev/cciss/c0d0, so maybe you can give Clonezilla live 2.5.6-22 or 20180812-bionic a try: https://clonezilla.org/downloads.php
Steven
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
I am trying to ethernet clone an uEFI systemd-boot (f.k.a. gummiboot) Arch Linux installation on a USB thumb drive to a new computer its NVMe drive. That NVMe drive already contains some partitions from an earlier cone attempt. Both source and destination drives are GPT partitioned. The partitions contain both FAT32 and btrfs file system. I have created 2 new USB sticks with archlinux-2018.07.01-x86_64.iso. First the source system is uEFI booted into that Arch Linux live OS. And Clonezilla expert selections were made like: "
/usr/bin/ocs-onthefly -iefi -fsck -pa choose -a -f sdb
". That source doesn't signal any error.Then the destination system was booted, clonezilla started and
remote-dest
chosen. The output is like below:The issue seems to be the source, that pauses after "Collecting info... done!" and line "**." Sending a break (Ctrl+c) outputs:
No file system was found in /dev/1! Skip fsck.
When removed fsck, like "/usr/bin/ocs-onthefly -iefi -pa choose -a -f sdb" the commands runs without a pause up to "Waiting for the target machine to connect..."
The result when including option flag -fsck:
Seems that the fsck logic is somewhat off.
Additionally when skipping fsck and ocs-on-the-fly comes to "Waiting for the target machine to connect..." that still fails the remote-dest from restoring:
I have no clue why this happens.
PS I am going to try from remote to local cloning.
device-device also fails:
What am I doing wrong?
If I remember correctly, ocs-onthefly does not support multipath device, like /dev/cciss/c0d0.
Newer Linux kernel seems to use /dev/sda for /dev/cciss/c0d0, so maybe you can give Clonezilla live 2.5.6-22 or 20180812-bionic a try:
https://clonezilla.org/downloads.php
Steven