I am trying to ethernet clone an uEFI systemd-boot (f.k.a. gummiboot) Arch Linux installation on a USB thumb drive to a new computer its NVMe drive. That NVMe drive already contains some partitions from an earlier cone attempt. Both source and destination drives are GPT partitioned. The partitions contain both FAT32 and btrfs file system. I have created 2 new USB sticks with archlinux-2018.07.01-x86_64.iso. First the source system is uEFI booted into that Arch Linux live OS. And Clonezilla expert selections were made like: "/usr/bin/ocs-onthefly -iefi -fsck -pa choose -a -f sdb". That source doesn't signal any error.
Then the destination system was booted, clonezilla started and remote-dest chosen. The output is like below:
#clonezillaClonezillamodeisremote-destSettingtheTERMasxterm-colorStarting/usr/bin/ocs-ontheflyat2018-07-2818:41:12UTC.../usr/share/drbl/sbin/ocs-functions:line2794:service:commandnotfoundNetworkisalreadyconfigured!AvailableIPaddressonthismachine:192.168.7.3Devicecloningserveris:192.168.7.2Excludingbusypartitionordisk...Disknumber:1Selecteddevice[nvme0n1]found!Theselecteddevices:nvme0n1Sourcemachine:192.168.7.2Destinationdeviceonthismachine:nvme0n1Press"Enter"tocontinue......*****************************************************.MyIPaddressinDRBLenv:192.168.7.3GNUnetcat0.7.1,arewriteofthefamousnetworkingtool.Basicusages:connecttosomewhere:nc[options]hostnameport[port]...listenforinbound:nc-l-pport[options][hostname][port]...tunneltosomewhere:nc-Lhostname:port-pport[options]Mandatoryargumentstolongoptionsaremandatoryforshortoptionstoo.Options:-c,--close close connection on EOF from stdin-e,--exec=PROGRAM program to exec after connect-g,--gateway=LIST source-routing hop point[s], up to 8-G,--pointer=NUM source-routing pointer: 4, 8, 12, ...-h,--help display this help and exit-i,--interval=SECS delay interval for lines sent, ports scanned-l,--listen listen mode, for inbound connects-L,--tunnel=ADDRESS:PORT forward local port to remote address-n,--dont-resolve numeric-only IP addresses, no DNS-o,--output=FILE output hexdump traffic to FILE (implies -x)-p,--local-port=NUM local port number-r,--randomize randomize local and remote ports-s,--source=ADDRESS local source address (ip or hostname)-t,--tcp TCP mode (default)-T,--telnet answer using TELNET negotiation-u,--udp UDP mode-v,--verbose verbose (use twice to be more verbose)-V,--version output version information and exit-x,--hexdump hexdump incoming and outgoing traffic-w,--wait=SECS timeout for connects and final net reads-z,--zero zero-I/O mode (used for scanning)Remoteportnumbercanalsobespecifiedasrange.Example:'1-1024'Using"-l port"whenit's netcat listen mode.///WARNING/// filesystem.squashfs not found! No idea where is LIVE MEDIA!!! Assume this is running in DRBL client.Terminate partimage and nc processs if they exist...pkill -u root partclonepkill -u root partimagepkill -u root ntfsclonepkill -u root ddpkill -u root nc*****************************************************.setterm: terminal xterm-color does not support --blank*****************************************************.Searching for data partition(s)...Excluding busy partition or disk...Unmounted partitions (including extended or swap): nvme0n1p1 nvme0n1p2 nvme0n1p3Collecting info.... done!Getting /dev/nvme0n1p1 info...Getting /dev/nvme0n1p2 info...Getting /dev/nvme0n1p3 info...WARNING!!! WARNING!!! WARNING!!!WARNING! THE EXISTING DATA IN THIS HARDDISK/PARTITION(S) WILL BE OVERWRITTEN! ALL EXISTING DATA WILL BE LOST: nvme0n1*****************************************************.Machine: Unknown product namenvme0n1 (256GB_INTEL_SSDPEKKW256G7__INTEL_SSDPEKKW256G7_BTPY63510P43256D)nvme0n1p1 (1G_vfat_NO_NAME(In_INTEL_SSDPEKKW256G7_)_INTEL_SSDPEKKW256G7_BTPY63510P43256D)nvme0n1p2 (161G_btrfs(In_INTEL_SSDPEKKW256G7_)_INTEL_SSDPEKKW256G7_BTPY63510P43256D)nvme0n1p3 (76.5G_btrfs(In_INTEL_SSDPEKKW256G7_)_INTEL_SSDPEKKW256G7_BTPY63510P43256D)*****************************************************.Are you sure you want to continue? (y/n) yOK, let'sdoit!!*****************************************************.Letmeaskyouagain.WARNING!!!WARNING!!!WARNING!!!WARNING!THEEXISTINGDATAINTHISHARDDISK/PARTITION(S)WILLBEOVERWRITTEN!ALLEXISTINGDATAWILLBELOST:nvme0n1Areyousureyouwanttocontinue?(y/n)yOK,let's do it!!This is for target machinegzip: stdin: unexpected end of filetar: Child returned status 1tar: Error is not recoverable: exiting now/usr/bin/ocs-onthefly: line 1109: /tmp/ocs_onthefly_tgt.GCToQK/advanced_param.conf: No such file or directorycp: cannot stat '/tmp/ocs_onthefly_tgt.GCToQK//tmp/ocs_onthefly_tgt.GCToQK/swappt-*.info':Nosuchfileordirectory/usr/bin/ocs-onthefly:line2843:/tmp/ocs_onthefly_tgt.GCToQK/src_partition.info:Nosuchfileordirectory*****************************************************.Willcreatethepartitiononthetargetmachine...Failedtocreatethepartitiontableonthetargetdevice:/dev/nvme0n1Programterminated!Press"Enter"tocontinue......clonezilla7.81suser3.00ssystem26%cpu40.775total
The issue seems to be the source, that pauses after "Collecting info... done!" and line "**." Sending a break (Ctrl+c) outputs: No file system was found in /dev/1! Skip fsck.
When removed fsck, like "/usr/bin/ocs-onthefly -iefi -pa choose -a -f sdb" the commands runs without a pause up to "Waiting for the target machine to connect..."
The result when including option flag -fsck:
#/usr/bin/ocs-onthefly-iefi-fsck-pachoose-a-fsdb:(SettingtheTERMasxterm-colorStarting/usr/bin/ocs-ontheflyat2018-07-2819:12:08UTC.../usr/share/drbl/sbin/ocs-functions:line2794:service:commandnotfoundShuttingdowntheLogicalVolumeManagerFinishedShuttingdowntheLogicalVolumeManager*****************************************************.MyIPaddressinDRBLenv:192.168.7.2GNUnetcat0.7.1,arewriteofthefamousnetworkingtool.Basicusages:connecttosomewhere:nc[options]hostnameport[port]...listenforinbound:nc-l-pport[options][hostname][port]...tunneltosomewhere:nc-Lhostname:port-pport[options]Mandatoryargumentstolongoptionsaremandatoryforshortoptionstoo.Options:-c,--close close connection on EOF from stdin-e,--exec=PROGRAM program to exec after connect-g,--gateway=LIST source-routing hop point[s], up to 8-G,--pointer=NUM source-routing pointer: 4, 8, 12, ...-h,--help display this help and exit-i,--interval=SECS delay interval for lines sent, ports scanned-l,--listen listen mode, for inbound connects-L,--tunnel=ADDRESS:PORT forward local port to remote address-n,--dont-resolve numeric-only IP addresses, no DNS-o,--output=FILE output hexdump traffic to FILE (implies -x)-p,--local-port=NUM local port number-r,--randomize randomize local and remote ports-s,--source=ADDRESS local source address (ip or hostname)-t,--tcp TCP mode (default)-T,--telnet answer using TELNET negotiation-u,--udp UDP mode-v,--verbose verbose (use twice to be more verbose)-V,--version output version information and exit-x,--hexdump hexdump incoming and outgoing traffic-w,--wait=SECS timeout for connects and final net reads-z,--zero zero-I/O mode (used for scanning)Remoteportnumbercanalsobespecifiedasrange.Example:'1-1024'Using"-l port"whenit'snetcatlistenmode.///WARNING///filesystem.squashfsnotfound!NoideawhereisLIVEMEDIA!!!AssumethisisrunninginDRBLclient.Terminatepartimageandncprocesssiftheyexist...pkill-urootpartclonepkill-urootpartimagepkill-urootntfsclonepkill-urootddpkill-urootnc*****************************************************.setterm:terminalxterm-colordoesnotsupport--blank*****************************************************.Thisisforsourcemachine.SavingtheGPTof/dev/sdbas/tmp/ocs_onthefly_src.IOOB5N/src-gpt.gdiskbysgdisk...Theoperationhascompletedsuccessfully.SavingtheprimaryGPTof/dev/sdbas/tmp/ocs_onthefly_src.IOOB5N/src-gpt-1st.imgbydd...34+0recordsin34+0recordsout17408bytes(17kB,17KiB)copied,0.00100174s,17.4MB/sSavingthesecondaryGPTof/dev/sdbas/tmp/ocs_onthefly_src.IOOB5N/src-gpt-2nd.imgbydd...32+0recordsin32+0recordsout16384bytes(16kB,16KiB)copied,0.000516999s,31.7MB/s*****************************************************.Collectingpartition/dev/sdb1info...Collectingpartition/dev/sdb2info...Collectingpartition/dev/sdb3info...SettinguptheLogicalVolumeManagerParsingLVMlayout...ShuttingdowntheLogicalVolumeManagerFinishedShuttingdowntheLogicalVolumeManager*****************************************************.Searchingfordatapartition(s)insourcedisk:sdb...Excludingbusypartitionordisk...Unmountedpartitions(includingextendedorswap):sdb1sdb2sdb3Collectinginfo....done!*****************************************************.
Seems that the fsck logic is somewhat off.
Additionally when skipping fsck and ocs-on-the-fly comes to "Waiting for the target machine to connect..." that still fails the remote-dest from restoring:
#clonezillaClonezillamodeisremote-destSettingtheTERMasxterm-colorStarting/usr/bin/ocs-ontheflyat2018-07-2819:09:20UTC.../usr/share/drbl/sbin/ocs-functions:line2794:service:commandnotfoundNetworkisalreadyconfigured!AvailableIPaddressonthismachine:192.168.7.3Devicecloningserveris:192.168.7.2Excludingbusypartitionordisk...Disknumber:1Selecteddevice[nvme0n1]found!Theselecteddevices:nvme0n1Sourcemachine:192.168.7.2Destinationdeviceonthismachine:nvme0n1Press"Enter"tocontinue......*****************************************************.MyIPaddressinDRBLenv:192.168.7.3GNUnetcat0.7.1,arewriteofthefamousnetworkingtool.Basicusages:connecttosomewhere:nc[options]hostnameport[port]...listenforinbound:nc-l-pport[options][hostname][port]...tunneltosomewhere:nc-Lhostname:port-pport[options]Mandatoryargumentstolongoptionsaremandatoryforshortoptionstoo.Options:-c,--close close connection on EOF from stdin-e,--exec=PROGRAM program to exec after connect-g,--gateway=LIST source-routing hop point[s], up to 8-G,--pointer=NUM source-routing pointer: 4, 8, 12, ...-h,--help display this help and exit-i,--interval=SECS delay interval for lines sent, ports scanned-l,--listen listen mode, for inbound connects-L,--tunnel=ADDRESS:PORT forward local port to remote address-n,--dont-resolve numeric-only IP addresses, no DNS-o,--output=FILE output hexdump traffic to FILE (implies -x)-p,--local-port=NUM local port number-r,--randomize randomize local and remote ports-s,--source=ADDRESS local source address (ip or hostname)-t,--tcp TCP mode (default)-T,--telnet answer using TELNET negotiation-u,--udp UDP mode-v,--verbose verbose (use twice to be more verbose)-V,--version output version information and exit-x,--hexdump hexdump incoming and outgoing traffic-w,--wait=SECS timeout for connects and final net reads-z,--zero zero-I/O mode (used for scanning)Remoteportnumbercanalsobespecifiedasrange.Example:'1-1024'Using"-l port"whenit's netcat listen mode.///WARNING/// filesystem.squashfs not found! No idea where is LIVE MEDIA!!! Assume this is running in DRBL client.Terminate partimage and nc processs if they exist...pkill -u root partclonepkill -u root partimagepkill -u root ntfsclonepkill -u root ddpkill -u root nc*****************************************************.setterm: terminal xterm-color does not support --blank*****************************************************.Searching for data partition(s)...Excluding busy partition or disk...Unmounted partitions (including extended or swap): nvme0n1p1 nvme0n1p2 nvme0n1p3Collecting info.... done!Getting /dev/nvme0n1p1 info...Getting /dev/nvme0n1p2 info...Getting /dev/nvme0n1p3 info...WARNING!!! WARNING!!! WARNING!!!WARNING! THE EXISTING DATA IN THIS HARDDISK/PARTITION(S) WILL BE OVERWRITTEN! ALL EXISTING DATA WILL BE LOST: nvme0n1*****************************************************.Machine: Unknown product namenvme0n1 (256GB_INTEL_SSDPEKKW256G7__INTEL_SSDPEKKW256G7_BTPY63510P43256D)nvme0n1p1 (1G_vfat_NO_NAME(In_INTEL_SSDPEKKW256G7_)_INTEL_SSDPEKKW256G7_BTPY63510P43256D)nvme0n1p2 (161G_btrfs(In_INTEL_SSDPEKKW256G7_)_INTEL_SSDPEKKW256G7_BTPY63510P43256D)nvme0n1p3 (76.5G_btrfs(In_INTEL_SSDPEKKW256G7_)_INTEL_SSDPEKKW256G7_BTPY63510P43256D)*****************************************************.Are you sure you want to continue? (y/n) yOK, let'sdoit!!*****************************************************.Letmeaskyouagain.WARNING!!!WARNING!!!WARNING!!!WARNING!THEEXISTINGDATAINTHISHARDDISK/PARTITION(S)WILLBEOVERWRITTEN!ALLEXISTINGDATAWILLBELOST:nvme0n1Areyousureyouwanttocontinue?(y/n)yOK,let's do it!!This is for target machinegzip: stdin: unexpected end of filetar: Child returned status 1tar: Error is not recoverable: exiting now/usr/bin/ocs-onthefly: line 1109: /tmp/ocs_onthefly_tgt.VGfBmf/advanced_param.conf: No such file or directorycp: cannot stat '/tmp/ocs_onthefly_tgt.VGfBmf//tmp/ocs_onthefly_tgt.VGfBmf/swappt-*.info':Nosuchfileordirectory/usr/bin/ocs-onthefly:line2843:/tmp/ocs_onthefly_tgt.VGfBmf/src_partition.info:Nosuchfileordirectory*****************************************************.Willcreatethepartitiononthetargetmachine...Failedtocreatethepartitiontableonthetargetdevice:/dev/nvme0n1Programterminated!Press"Enter"tocontinue......clonezilla7.87suser3.07ssystem22%cpu47.617total
I have no clue why this happens.
PS I am going to try from remote to local cloning.
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
...(76.5G_btrfs(In_INTEL_SSDPEKKW256G7_)_INTEL_SSDPEKKW256G7_BTPY63510P43256D)*****************************************************.Areyousureyouwanttocontinue?(y/n)yOK,let's do it!!*****************************************************.Let me ask you again.WARNING!!! WARNING!!! WARNING!!!WARNING! THE EXISTING DATA IN THIS HARDDISK/PARTITION(S) WILL BE OVERWRITTEN! ALL EXISTING DATA WILL BE LOST: nvme0n1Are you sure you want to continue? (y/n) yOK, let'sdoit!!Thisisfortargetmachinegzip:stdin:unexpectedendoffiletar:Childreturnedstatus1tar:Errorisnotrecoverable:exitingnow/usr/bin/ocs-onthefly:line1109:/tmp/ocs_onthefly_tgt.VGfBmf/advanced_param.conf:Nosuchfileordirectorycp:cannotstat'/tmp/ocs_onthefly_tgt.VGfBmf//tmp/ocs_onthefly_tgt.VGfBmf/swappt-*.info':Nosuchfileordirectory/usr/bin/ocs-onthefly:line2843:/tmp/ocs_onthefly_tgt.VGfBmf/src_partition.info:Nosuchfileordirectory*****************************************************.Willcreatethepartitiononthetargetmachine...Failedtocreatethepartitiontableonthetargetdevice:/dev/nvme0n1Programterminated!Press"Enter"tocontinue......clonezilla7.87suser3.07ssystem22%cpu47.617total1root@archiso~#ls:(install.txtroot@archiso~#lsblkNAMEMAJ:MINRMSIZEROTYPEMOUNTPOINTloop07:00463M1loop/run/archiso/sfs/airootfssdb8:16129.9G0disk├─sdb18:1711G0part├─sdb28:18119.5G0part└─sdb38:1919.3G0partsdc8:32128.9G0disk├─sdc18:331574M0part└─sdc28:34164M0partnvme0n1259:00238.5G0disk├─nvme0n1p1259:101G0part├─nvme0n1p2259:20161G0part└─nvme0n1p3259:3076.5G0partroot@archiso~#clonezillaClonezillamodeisdevice-deviceSettingtheTERMasxterm-colorStarting/usr/bin/ocs-ontheflyat2018-07-2819:16:25UTC.../usr/share/drbl/sbin/ocs-functions:line2794:service:commandnotfoundExcludingbusypartitionordisk...Disknumber:3Excludingbusypartitionordisk...Disknumber:2PS.Nexttimeyoucanrunthiscommanddirectly:/usr/bin/ocs-onthefly-iefi-v-sfsck-pachoose-fsdb-tnvme0n1Thiscommandisalsosavedasthisfilenameforlateruseifnecessary:/tmp/ocs-onthefly-2018-07-28-19-17*****************************************************.Press"Enter"tocontinue...*****************************************************.///WARNING///filesystem.squashfsnotfound!NoideawhereisLIVEMEDIA!!!AssumethisisrunninginDRBLclient.*****************************************************.setterm:terminalxterm-colordoesnotsupport--blank*****************************************************.Searchingfordatapartition(s)...Excludingbusypartitionordisk...Unmountedpartitions(includingextendedorswap):nvme0n1p1nvme0n1p2nvme0n1p3Collectinginfo....done!Getting/dev/nvme0n1p1info...Getting/dev/nvme0n1p2info...Getting/dev/nvme0n1p3info...WARNING!!!WARNING!!!WARNING!!!WARNING!THEEXISTINGDATAINTHISHARDDISK/PARTITION(S)WILLBEOVERWRITTEN!ALLEXISTINGDATAWILLBELOST:nvme0n1*****************************************************.Machine:Unknownproductnamenvme0n1(256GB_INTEL_SSDPEKKW256G7__INTEL_SSDPEKKW256G7_BTPY63510P43256D)nvme0n1p1(1G_vfat_NO_NAME(In_INTEL_SSDPEKKW256G7_)_INTEL_SSDPEKKW256G7_BTPY63510P43256D)nvme0n1p2(161G_btrfs(In_INTEL_SSDPEKKW256G7_)_INTEL_SSDPEKKW256G7_BTPY63510P43256D)nvme0n1p3(76.5G_btrfs(In_INTEL_SSDPEKKW256G7_)_INTEL_SSDPEKKW256G7_BTPY63510P43256D)*****************************************************.Areyousureyouwanttocontinue?(y/n)yOK,let's do it!!*****************************************************.Let me ask you again.WARNING!!! WARNING!!! WARNING!!!WARNING! THE EXISTING DATA IN THIS HARDDISK/PARTITION(S) WILL BE OVERWRITTEN! ALL EXISTING DATA WILL BE LOST: nvme0n1Are you sure you want to continue? (y/n) yOK, let'sdoit!!*****************************************************.SavingtheGPTof/dev/sdbas/tmp/ocs_onthefly_local.Jmh26h/src-gpt.gdiskbysgdisk.../usr/bin/ocs-onthefly:line679:/usr/bin/sgdisk:Input/outputerrorSavingtheprimaryGPTof/dev/sdbas/tmp/ocs_onthefly_local.Jmh26h/src-gpt-1st.imgbydd...34+0recordsin34+0recordsout17408bytes(17kB,17KiB)copied,0.0002033s,85.6MB/sSavingthesecondaryGPTof/dev/sdbas/tmp/ocs_onthefly_local.Jmh26h/src-gpt-2nd.imgbydd...32+0recordsin32+0recordsout16384bytes(16kB,16KiB)copied,0.0102705s,1.6MB/s*****************************************************.Collectingpartition/dev/sdb1info...Collectingpartition/dev/sdb2info...Collectingpartition/dev/sdb3info...PARTIMAGE_RESTORE_OPT:PARTIMAGE_SAVE_OPT:PARTCLONE_RESTORE_ONTHEFLY_OPT:-z10485760-NSOURCE:sdbTARGET:nvme0n1PORTfornetcat:*****************************************************.Willcreatethepartitiononthetargetmachine.../usr/bin/ocs-onthefly:line328:/usr/bin/dirname:Input/outputerrorgrep:/tgt-pt.parted:Nosuchfileordirectory/usr/share/drbl/sbin/ocs-functions:line11332:/usr/bin/bc:Input/outputerror/usr/share/drbl/sbin/ocs-functions:line11334:/usr/bin/bc:Input/outputerrorDisk()sizefromimageNOTfound.Programterminated!!
What am I doing wrong?
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
If I remember correctly, ocs-onthefly does not support multipath device, like /dev/cciss/c0d0.
Newer Linux kernel seems to use /dev/sda for /dev/cciss/c0d0, so maybe you can give Clonezilla live 2.5.6-22 or 20180812-bionic a try: https://clonezilla.org/downloads.php
Steven
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
I am trying to ethernet clone an uEFI systemd-boot (f.k.a. gummiboot) Arch Linux installation on a USB thumb drive to a new computer its NVMe drive. That NVMe drive already contains some partitions from an earlier cone attempt. Both source and destination drives are GPT partitioned. The partitions contain both FAT32 and btrfs file system. I have created 2 new USB sticks with archlinux-2018.07.01-x86_64.iso. First the source system is uEFI booted into that Arch Linux live OS. And Clonezilla expert selections were made like: "
/usr/bin/ocs-onthefly -iefi -fsck -pa choose -a -f sdb". That source doesn't signal any error.Then the destination system was booted, clonezilla started and
remote-destchosen. The output is like below:The issue seems to be the source, that pauses after "Collecting info... done!" and line "**." Sending a break (Ctrl+c) outputs:
No file system was found in /dev/1! Skip fsck.When removed fsck, like "/usr/bin/ocs-onthefly -iefi -pa choose -a -f sdb" the commands runs without a pause up to "Waiting for the target machine to connect..."
The result when including option flag -fsck:
Seems that the fsck logic is somewhat off.
Additionally when skipping fsck and ocs-on-the-fly comes to "Waiting for the target machine to connect..." that still fails the remote-dest from restoring:
I have no clue why this happens.
PS I am going to try from remote to local cloning.
device-device also fails:
What am I doing wrong?
If I remember correctly, ocs-onthefly does not support multipath device, like /dev/cciss/c0d0.
Newer Linux kernel seems to use /dev/sda for /dev/cciss/c0d0, so maybe you can give Clonezilla live 2.5.6-22 or 20180812-bionic a try:
https://clonezilla.org/downloads.php
Steven