Clonezilla / Bugs / #327 btrfs clone failure

Steven Shiau - 2019-07-21

So are you sure it's unmounted cleanly? If you are not sure, please run fsck to check its integrity first?
If the issue still remains, please let us know how you create that file system (the version for mkfs.btrfs, the OS you have installed...).
Thanks.
Steven

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Daniel Pätzold - 2019-10-16

had the same behaviour here backing up opensuse 15.1.
mkfs.btrfs, part of btrfs-progs v4.19.1

fdisk -l
Einheiten: Sektoren von 1 * 512 = 512 Bytes
Sektorgröße (logisch/physikalisch): 512 Bytes / 512 Bytes
E/A-Größe (minimal/optimal): 512 Bytes / 512 Bytes
Festplattenbezeichnungstyp: gpt
Festplattenbezeichner: 046E236D-3078-4C72-A17E-C0F12A946E4B

Gerät Anfang Ende Sektoren Größe Typ
/dev/sda1 2048 18431 16384 8M BIOS boot
/dev/sda2 18432 83904511 83886080 40G Linux-Dateisystem
/dev/sda3 83904512 460865535 376961024 179,8G Linux-Dateisystem
/dev/sda4 460865536 468862094 7996559 3,8G Linux Swap

mounted as follows:
/dev/sda2 on / type btrfs (rw,relatime,ssd,space_cache,subvolid=533,subvol=/@/.snapshots/203/snapshot)
/dev/sda2 on /boot/grub2/i386-pc type btrfs (rw,relatime,ssd,space_cache,subvolid=265,subvol=/@/boot/grub2/i386-pc)
/dev/sda2 on /boot/grub2/x86_64-efi type btrfs (rw,relatime,ssd,space_cache,subvolid=264,subvol=/@/boot/grub2/x86_64-efi)
/dev/sda2 on /opt type btrfs (rw,relatime,ssd,space_cache,subvolid=263,subvol=/@/opt)
/dev/sda2 on /.snapshots type btrfs (rw,relatime,ssd,space_cache,subvolid=266,subvol=/@/.snapshots)
/dev/sda2 on /srv type btrfs (rw,relatime,ssd,space_cache,subvolid=261,subvol=/@/srv)
/dev/sda2 on /tmp type btrfs (rw,relatime,ssd,space_cache,subvolid=260,subvol=/@/tmp)
/dev/sda2 on /usr/local type btrfs (rw,relatime,ssd,space_cache,subvolid=259,subvol=/@/usr/local)
/dev/sda2 on /root type btrfs (rw,relatime,ssd,space_cache,subvolid=262,subvol=/@/root)
/dev/sda2 on /var type btrfs (rw,relatime,ssd,space_cache,subvolid=258,subvol=/@/var)
/dev/sda3 on /home type xfs (rw,relatime,attr2,inode64,noquota)

sda1 and sda3 are working as expected, sda2 containing btrfs not.

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Steven Shiau - 2019-10-16

assigned_to: Thomas
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

I installed OpenSUSE 15.1 on VMWare WS 15.5, with this partitions layout:
root@eoan:~# parted -s /dev/sda print
Model: VMware, VMware Virtual S (scsi)
Disk /dev/sda: 21.5GB
Sector size (logical/physical): 512B/512B
Partition Table: gpt
Disk Flags: pmbr_boot

Number Start End Size File system Name Flags
1 1049kB 9437kB 8389kB bios_grub
2 9437kB 20.0GB 20.0GB btrfs legacy_boot
3 20.0GB 21.5GB 1473MB linux-swap(v1)

After booting Clonezilla live 20191024-eoan amd64, mount the image repository on NFS server,then run the following as root:
/usr/sbin/ocs-sr -nogui -q2 -c -j2 -z1p -i 4096 -sfsck -senc -p choose savedisk opensuse15.1-btrfs-20191025 sda

The following is the output, and it looks normal. It seems I can not reproduce this issue:

Setting the TERM as linux
Starting /usr/sbin/ocs-sr at 2019-10-25 00:17:56 UTC...
*****************************************************.
Clonezilla image dir: /home/partimag
*****************************************************.
Shutting down the Logical Volume Manager
Finished Shutting down the Logical Volume Manager
Selected device [sda] found!
The selected devices: sda
*****************************************************.
Activating the partition info in /proc... done!
Selected device [sda] found!
The selected devices: sda
Searching for data/swap/extended partition(s)...
Excluding busy partition or disk...
Unmounted partitions (including extended or swap): sda1 sda2 sda3
Collecting info.... done!
The data partition to be saved: sda1 sda2
The swap partition to be saved: sda3
Activating the partition info in /proc... done!
Selected device [sda1] found!
Selected device [sda2] found!
The selected devices: sda1 sda2
Getting /dev/sda1 info...
Getting /dev/sda2 info...
*****************************************************.
The following step is to save the hard disk/partition(s) on this machine as an image:
*****************************************************.
Machine: VMware Virtual Platform
sda (21.5GB_VMware_Virtual_S_No_disk_serial_no)
sda1 (8M_bios_grub(In_VMware_Virtual_S)_No_disk_serial_no)
sda2 (18.6G_btrfs(In_VMware_Virtual_S)_No_disk_serial_no)
*****************************************************.
-> "/home/partimag/opensuse15.1-btrfs-20191025".
Are you sure you want to continue? (y/n) y
OK, let's do it!!
Shutting down the Logical Volume Manager
Finished Shutting down the Logical Volume Manager
Saving block devices info in /home/partimag/opensuse15.1-btrfs-20191025/blkdev.list...
Saving block devices attributes in /home/partimag/opensuse15.1-btrfs-20191025/blkid.list...
Checking the integrity of partition table in the disk /dev/sda...
Reading the partition table for /dev/sda...RETVAL=0
*****************************************************.
Saving the primary GPT of sda as /home/partimag/opensuse15.1-btrfs-20191025/sda-gpt-1st by dd...
34+0 records in
34+0 records out
17408 bytes (17 kB, 17 KiB) copied, 0.0335439 s, 519 kB/s
*****************************************************.
Saving the secondary GPT of sda as /home/partimag/opensuse15.1-btrfs-20191025/sda-gpt-2nd by dd...
32+0 records in
32+0 records out
16384 bytes (16 kB, 16 KiB) copied, 0.0337123 s, 486 kB/s
*****************************************************.
Saving the GPT of sda as /home/partimag/opensuse15.1-btrfs-20191025/sda-gpt.gdisk by gdisk...
The operation has completed successfully.
*****************************************************.
done!
Saving the MBR data for sda...
1+0 records in
1+0 records out
512 bytes copied, 0.0336411 s, 15.2 kB/s
*****************************************************.
*****************************************************.
Starting saving /dev/sda1 as /home/partimag/opensuse15.1-btrfs-20191025/sda1.XXX...
/dev/sda1 filesystem: bios_grub.
*****************************************************.
Checking the disk space...
*****************************************************.
Use partclone with pigz to save the image.
Image file will be split with size limit 4096 MB.
*****************************************************.
If this action fails or hangs, check:
* Is the disk full ?
*****************************************************.
Run partclone: partclone.dd -z 10485760 -L /var/log/partclone.log -s /dev/sda1 --output - | pigz -c --fast -b 1024 --rsyncable | split -a 2 -b 4096MB - /home/partimag/opensuse15.1-btrfs-20191025/sda1.dd-ptcl-img.gz. 2> /tmp/split_error.SR1VJa
Partclone v0.3.13 http://partclone.org
Starting to clone/restore (/dev/sda1) to (-) with dd mode
Calculating bitmap... Please wait... done!
File system:  raw
Device size:    8.4 MB = 16384 Blocks
Space in use:   8.4 MB = 16384 Blocks
Free Space:     0 Byte = 0 Blocks
Block size:   512 Byte
Elapsed: 00:00:02, Remaining: 00:00:00, Completed: 100.00%, Rate: 251.66MB/min,
current block:      16384, total block:      16384, Complete: 100.00%
Total Time: 00:00:02, Ave. Rate:  251.7MB/min, 100.00% completed!
Syncing... OK!
Cloned successfully.
Checking the disk space...
>>> Time elapsed: 2.11 secs (~ .035 mins)
Change mode to 600 for these files: /home/partimag/opensuse15.1-btrfs-20191025/sda1.dd-ptcl-img.gz*
*****************************************************.
Finished saving /dev/sda1 as /home/partimag/opensuse15.1-btrfs-20191025/sda1.dd-ptcl-img.gz
*****************************************************.
*****************************************************.
*****************************************************.
Starting saving /dev/sda2 as /home/partimag/opensuse15.1-btrfs-20191025/sda2.XXX...
/dev/sda2 filesystem: btrfs.
*****************************************************.
Checking the disk space...
*****************************************************.
Use partclone with pigz to save the image.
Image file will be split with size limit 4096 MB.
*****************************************************.
If this action fails or hangs, check:
* Is the disk full ?
*****************************************************.
Run partclone: partclone.btrfs -z 10485760 -L /var/log/partclone.log -c -s /dev/sda2 --output - | pigz -c --fast -b 1024 --rsyncable | split -a 2 -b 4096MB - /home/partimag/opensuse15.1-btrfs-20191025/sda2.btrfs-ptcl-img.gz. 2> /tmp/split_error.S0lMMT
Partclone v0.3.13 http://partclone.org
Starting to clone device (/dev/sda2) to image (-)
Reading Super Block
Calculating bitmap... Please wait...
done!
File system:  BTRFS
Device size:   20.0 GB = 1220224 Blocks
Space in use:   2.4 GB = 146776 Blocks
Free Space:    17.6 GB = 1073448 Blocks
Block size:   16384 Byte
Elapsed: 00:00:40, Remaining: 00:00:00, Completed: 100.00%, Rate:   5.27GB/min,
current block:     283183, total block:    1220224, Complete: 100.00%
Total Time: 00:00:40, Ave. Rate:    5.3GB/min, 100.00% completed!
Syncing... OK!
Partclone successfully cloned the device (/dev/sda2) to the image (-)
Cloned successfully.
Checking the disk space...
>>> Time elapsed: 41.81 secs (~ .696 mins)
Change mode to 600 for these files: /home/partimag/opensuse15.1-btrfs-20191025/sda2.btrfs-ptcl-img.gz*
*****************************************************.
Finished saving /dev/sda2 as /home/partimag/opensuse15.1-btrfs-20191025/sda2.btrfs-ptcl-img.gz
*****************************************************.
Saving hardware info by lshw...
Saving DMI info...
Saving PCI info...
Saving package info...
End of saveparts job for image /home/partimag/opensuse15.1-btrfs-20191025.
*****************************************************.
Saving swap partition sda3 info in /home/partimag/opensuse15.1-btrfs-20191025/swappt-sda3.info if it exists...
Saving swap /dev/sda3 info in /home/partimag/opensuse15.1-btrfs-20191025/swappt-sda3.info...
*****************************************************.
*****************************************************.
This image was saved successfully: opensuse15.1-btrfs-20191025
End of savedisk job for image opensuse15.1-btrfs-20191025.
Start checking the saved image opensuse15.1-btrfs-20191025 if restorable...
Setting the TERM as linux
The image to be checked: opensuse15.1-btrfs-20191025
This is a whole disk image, saved from harddrive: sda
The partition to be checked: sda1 sda2
*****************************************************.
Checking the partition table in the image "opensuse15.1-btrfs-20191025"...
GPT 1st partition table file found!
GPT 2nd partition table file found!
GPT partition table file for this disk saved by gdisk was found: sda
*****************************************************.
Checking the swap partition info in the image "opensuse15.1-btrfs-20191025"...
Finding swap partition(s) in GPT table /home/partimag/opensuse15.1-btrfs-20191025/sda-pt.parted...
Checking swap partition sda3...
UUID="880eb333-1cfa-499d-a791-e2206250ba12"
LABEL=""
Swap partition info file found!
*****************************************************.
Checking the MBR in the image "opensuse15.1-btrfs-20191025"...
MBR file for this disk was found: sda
*****************************************************.
Checking the partition sda1 in the image "opensuse15.1-btrfs-20191025"...
Image was saved by dd or partclone.dd. No need or no way to check the file system integrity: sda1
The image of this partition is restorable: sda1
*****************************************************.
Checking the partition sda2 in the image "opensuse15.1-btrfs-20191025"...
*****************************************************.
Partclone v0.3.13 http://partclone.org
Starting to check image (-)
Calculating bitmap... Please wait...
done!
File system:  BTRFS
Device size:   20.0 GB = 1220224 Blocks
Space in use:   2.4 GB = 146776 Blocks
Free Space:    17.6 GB = 1073448 Blocks
Block size:   16384 Byte
Elapsed: 00:00:24, Remaining: 00:00:00, Completed: 100.00%, Rate:   8.79GB/min,
current block:     283183, total block:    1220224, Complete: 100.00%
Total Time: 00:00:24, Ave. Rate:    8.8GB/min, 100.00% completed!
Partclone successfully checked the image (-)
Checked successfully.
The image of this partition is restorable: sda2
*****************************************************.
All the images of partition or LV devices in this image were checked and they are restorable: opensuse15.1-btrfs-20191025
Summary of image checking:
==========================
GPT 1st partition table file found!
GPT 2nd partition table file found!
GPT partition table file for this disk saved by gdisk was found: sda
MBR file for this disk was found: sda
Image was saved by dd or partclone.dd. No need or no way to check the file system integrity: sda1
The image of this partition is restorable: sda1
The image of this partition is restorable: sda2
All the images of partition or LV devices in this image were checked and they are restorable: opensuse15.1-btrfs-20191025
==========================
*****************************************************
*****************************************************
Checking if udevd rules have to be restored...
This program is not started by Clonezilla server, so skip notifying it the job is done.
Finished!
Generating a tag file for this image...
Now syncing - flush filesystem buffers...
Now you can choose to:
(0) Poweroff
(1) Reboot
(2) Enter command line prompt
[2]

Ending /usr/sbin/ocs-sr at 2019-10-25 00:29:01 UTC...

I also have the same problem with a btrfs filesystem on Arch Linux. I get the exact same error message on screen and unresponsive behaviour trying to hit Enter. Hitting Ctrl-Alt-Del seems to skip the btrfs partition and maybe finish the last partition but I'm not sure because it doesn't return to prompt like I set in the options.

Output of /var/log/clonezilla.log below.

Start saving /dev/nvme0n1p2 as /home/partimage/<filename>/nvme0n1p2.XXX.
/dev/nvme0n1p2 filesystem: btrfs.
***********************************
Use partclone with pigz to save the image.
Image file will be split with size limit 4096 MB.
***********************************
If this action fails or hangs, check:
* Is the disk full?
***********************************
Run partclone: partclone.btrfs -z 10485760 -N -L /var/log/partclone.log -c -s /dev/nvme0n1p2 --output - | pigz -c --fast -b 1024 --rsyncable | split -a 2 -b 4096MB - /home/partimage/<filename>/nvme0n1p2.btrfs-ptcl-img.gz. 2> /tmp/split_error.h4siWO
Partclone v0.3.13 http://partclone.org
Starting to clone device (/dev/nvme0n1p2) to image (-)
Reading Super Block

btrfsclone.c: btrfs library version = Btrfs v4.2.2
block_size = 16384
usedblock = 734218
device_block = 34359738368
totalblock = 2097152
btrfsclone.c: fs_close
memory needed: 21233668 bytes
bitmap 262144 bytes, blocks 2*10485760 bytes, checksum 4 bytes
Calculating bitmap... Please wait...

btrfsclone.c: btrfs library version = Btrfs v4.2.2
Failed to use partclone program to save or restone an image!

I have used clonezilla to back up these partitions before without issue. Also, this image was successfully restored recently and now has the issue of not being able to be backed up. Not certain if it is useful information, but the filesystem was originally created on a different nvme drive and restored to a new one. It booted fine without issue after the restore.

I am using clonezilla-live-2.6.4-10-amd64.iso on a usb. I was trying to do a disk-image with save disk as image in beginner mode.

I tried a full rebalance as the user in this thread did but it did not succeed in fixing this issue.
https://sourceforge.net/p/clonezilla/discussion/Clonezilla_live/thread/d622f01a/#3672

The problem is with partition nvme0n1p2 as boot is vfat and home is ext4. No issues there.
My partitions were created as follows:

gdisk /dev/nvme0n1
/boot    550MB   nvme0n1p1  +550M EF00
/        32GB    nvme0n1p2  +32G  Linux Filesystem (8300)
swap     8GB     nvme0n1p3  +8G   Linux Filesystem (8300)
/home    954G    nvme0n1p4        Linux Filesystem (8300)

Subvolumes created as such:

mount /dev/nvme0n1p2 /mnt
btrfs subvolume create /mnt/@
btrfs subvolume create /mnt/@log
btrfs subvolume create /mnt/@pkg
btrfs subvolume create /mnt/@snapshots

Subvolumes mounted as such:

mount -o relatime,space_cache=v2,ssd,compress=lzo,subvol=@ /dev/nvme0n1p2 /mnt
mkdir -p /mnt/{boot,home,var/log,var/cache/pacman/pkg,btrfs}
mount -o relatime,space_cache=v2,ssd,compress=lzo,subvol=@log /dev/nvme0n1p2 /mnt/var/log
mount -o relatime,space_cache=v2,ssd,compress=lzo,subvol=@pkg /dev/nvme0n1p2 /mnt/var/cache/pacman/pkg
mount -o relatime,space_cache=v2,ssd,compress=lzo,subvolid=5 /dev/nvme0n1p2 /mnt/btrfs

James P - 2020-07-04

I have been expereincing this issue on Kubuntu(Currently 20.04) and Clonezilla version 28042020 stable.
I have a dual boot setup on a GPT disk. The two small disk system partitions and the Windows10 partition (ntfs) backup as expected however, when Clonezilla tries to calculate the bitmap of the first btrfs partition which is mounted to / it fails with the error message described here.
Each of my btrfs partitions had one subvolume snapshot present.
I deleted these snapshots, did a balance and scrub on both partitions and tried the backup again.
This time it was successful therefore this is somehting to do with the snapshots?
Is clonezilla looking at the snapshots as a duplicate of the data and running out of available space on the backup drive as a result?
Can I provide any more information to assist with diagnosing this issue?

Thanks.

James

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Steven Shiau - 2020-07-14

@James,
If will be easier for us the reproduce this issue if you could :
1. Describe the steps you save the snapshot
2. Provide the error messages
Thanks.

Steven

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
- James P - 2020-07-15
  
  Hi Steven,
  My situation is exactly as the original poster says.
  I have two btrfs partitions, one for my root and one for my home partitions.
  I can back them both up with Clonezilla IF I have no snapshots created but, if I create a snapshot on either of them the backup fails with the message:
  
  *Checking disk space... Failed to use partclone program to save or restore an image! Press "Enter" to continue....
  
  which is actually printed over the top of everything else on the screen and very badly formatted :)
  
  *I use clonezilla mostly in "other modes" and "load to RAM" but, as an experiment, I used the default settings and had the same result.
  
  I'm pretty sure that clonezilla is looking at the drive as if the snapshot is actually another copy of the entire data contents.
  
  So, to summarise, I boot from the clonezilla USB.
  I select default mode.
  I set a local drive as the home drive for backups
  I choose "backup partitions"
  I select the relevant partitions form the list
  and I click on backup.
  The program manages to backup my Windws 10 NTFS partition and the GPT system partitions and then fails on attempting to start on the first btrfs partition with the afore mentioned message.
  
  If there is anything else you would like me to do to help diagnose this then just let me know.
  
  James
  
  Last edit: Steven Shiau 2020-07-27
  
  alternate
  
  If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Steven Shiau - 2020-07-27

OK, we will check that. Thomas Tsai is very busy, and I hope he can find some time to update the codes about btrfs in Partclone recently.

Steven

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
- James P - 2020-07-27
  
  Hi steven,
  Thanks for that, I appreciate that everyone is very busy and would appreciate it if this could be sorted.
  For now I just delete my btrfs snapshots, clean up the filesystem with a scrub and balance the partitions before making an image which is time consuming but effective :)
  Also has the effect of increasing my confidence in the use of btrfs in general so all good :)
  
  How will I keep updated on progress with this please? Is there an open bug report?
  
  James
  
  Last edit: Steven Shiau 2020-07-27
  
  alternate
  
  If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Steven Shiau - 2020-07-27

If we update Partclone about btrfs, we will post here to ask you to test again.
Thanks.

Steven

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

James P - 2020-08-30

I don't know if this has been fixed or not but, on the latest available version of Clonezilla:
clonezilla-live-20200818-focal-amd64
I have been able to backup all my btrfs partitions with one snapshot on each.
Can anyone confirm if steps have been taken to mitigate this issue?

Thanks.

James

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Steven Shiau - 2020-08-31

Although Partclone was updated from 0.3.13 to 0.3.14 in clonezilla-live-20200818-focal-amd64, the code about btrfs was not actually updated. The major change about Partclone 0.3.13 to 0.3.14 is to make it work for GCC10. Maybe that's a side effect... a good thing... :)

Steven

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Regel Paulsen - 2020-10-06

I too had this error two times in the last years with different Partclone versions.
No errors were reported during BTRFS checks.
I also managed to fix the issue by balance, scrub and quota rescan (I don't know which one was the decicive factor, will proof it next time).

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Steven Shiau - 2020-10-11

I think we have to wait for Thomas Tsai to update the btrfs-related codes in Partclone.

Steven

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
- James P - 2020-10-11
  
  This is odd because, it's now working for me with two btrfs partitions,
  both with snapshots created? This is the kind of thing that makes a
  developers job so difficult :)
  
  James
  
  On 11/10/2020 04:05, Steven Shiau wrote:
  
  I think we have to wait for Thomas Tsai to update the btrfs-related
  codes in Partclone.
  
  Steven
  
  [bugs:#327] https://sourceforge.net/p/clonezilla/bugs/327/ btrfs
  clone failure
  
  Status: open
  Group: testing_clonezilla
  Labels: btrfs
  Created: Sat Jul 20, 2019 05:21 PM UTC by Marcus Taylor Hallett
  Last Updated: Tue Oct 06, 2020 06:57 PM UTC
  Owner: Thomas
  Attachments:
  
  1 - partition choice.jpg
  https://sourceforge.net/p/clonezilla/bugs/327/attachment/1%20-%20partition%20choice.jpg
  (440.5 kB; image/jpeg)
  
  2 - command.jpg
  https://sourceforge.net/p/clonezilla/bugs/327/attachment/2%20-%20command.jpg
  (83.2 kB; image/jpeg)
  
  3 - error.jpg
  https://sourceforge.net/p/clonezilla/bugs/327/attachment/3%20-%20error.jpg
  (155.8 kB; image/jpeg)
  
  Expected Behavior
  
  Successfully create an image of a disk which contains a partition
  formated with the btrfs filesystem.
  Successfully create an image of a partition formated with the btrfs
  filesystem.
  
  Actual Behavior
  
  As partclone attempts the Calculating bitmap step it fails on checking
  disk space.
  It generates this error message:
  
  Checking disk space...
  Failed to use partclone program to save or restore an image!
  Press "Enter" to continue......
  
  Striking |Enter| does nothing. The system must be rebooted
  (|Ctrl|+|Alt|+|Delete|, etc.).
  Using the default |-q2| parameter (I used both the beginnner mode and
  the expert mode to use this), I would expect Clonezilla to proceed to
  partimage and dd upon failure. As I indicated, this does not occur. I
  know that dd can successfully create an image (I tested this on the
  partition alone), though I would imagine that partclone should be able
  to create the image itself.
  
  Steps to Reproduce the Problem
  
  A disk with a number of partitions, among which is a btrfs formatted
  partition.
  - disk-image mode
  - savedisk or saveparts on the disk containing the btrfs partition or
  the btrfs partition
  
  Version
  
  Tested on clonezilla-live-2.6.2-15-amd64 and
  clonezilla-live-20190420-disco-amd64.
  
  Additional Query
  
  Is there any workaround that could possibly solve the problem?
  Ideally, I want to be able to use the restoredisk to restore all of
  the partitions at once.
  
  Sent from sourceforge.net because you indicated interest in
  https://sourceforge.net/p/clonezilla/bugs/327/
  
  To unsubscribe from further messages, please visit
  https://sourceforge.net/auth/subscriptions/
  
  --
  James K. Pirie
  
  Please note -
  This email and any attachment it may contain is for the individual to
  which it was originally addressed.
  If you are not the original intended recipient, you are notified that
  any disclosure, copying, alteration, distribution,
  publication or the taking of action in reliance on the contents is
  prohibited and may be an offence.
  
  jkp@bronyaur.co.uk jkp@bronyaur.co.uk
  jpirie@fastmail.com jpirie@fastmail.com
  
  Related
  
  Bugs: ~~#327~~
  
  If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Thomas Kupper - 2020-10-25

Hi,

I stumbled onto the exact same error while trying to backup my Intel NUC. On the NVME SSD it got 11 partitions for EFI, Windows, 2x Linux Mint, 1x Fedora, a docker partition, swap and Haiku R1/beta2. Of these partitions the two Linux Mint are btrfs. It fails with the first one but not with the second. The partition table is GPT.

Versions 20200703-focal and 20201022-focal did show the same result, as did disk or partition backup.

After that I tried using only partclone and got the following error on the first btrfs partition (see screenshot)
set block 8276672 out of boundary (8276672)"

The same error was thrown in 3.1.3 on Linux Mint 20 and 3.1.5 with 20201022-focal.

partclone was called:

sudo partclone.btrfs -o <output-img-file>-L <log-file> -s /dev/nvme0n1p6 -c -N

The log file:

Partclone v0.3.14 http://partclone.org Starting to clone device (/dev/nvme0n1p6) to image (/mnt/clonezilla/again-btrfs-p6.img) Reading Super Block btrfsclone.c: btrfs library version = Btrfs v4.2.2 block_size = 16384 usedblock = 4771911 device_size = 135604994048 totalblock = 8276672 btrfsclone.c: fs_close memory needed: 3131740 bytes bitmap 1034584 bytes, blocks 2*1048576 bytes, checksum 4 bytes Calculating bitmap... Please wait... btrfsclone.c: btrfs library version = Btrfs v4.2.2

Maybe these infos can help in debugging the issue. What other information would be helpful?

/Thomas

nvme0n1p6-btrfs-filessystem-df.txt

nvme0n1p6-btrfs-filessystem-show.txt

nvme0n1p6-btrfs-filessystem-subvolume-list.txt

nvme0n1p6-btrfs-filessystem-usage.txt

partclone-v3.1.4-btrfs-error.jpg
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Thomas Kupper - 2020-10-25

Hi,

It's me again: I did some further digging and found something which I find strange - but maybe it's just not-knowing:

Running sudo btrfs inspect-internal dump-super /dev/nvme0n1p6 showed the following values:

... chunk_root 152594022400 ... total_bytes 135598702592

chunk_root value is greater than total_bytes, is that to be expected?

Can someone who got the same error run inspect-internal dump-super and check if they got a similar situation?

/Thomas
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Thomas Kupper - 2020-10-26

Hello Again,

Last update, I swear :)

Updating the btrfs-progs component of partclone to v5.4.1 did not solve this issue.

That let me to believe that it got to be an issue with internals of that specifiy btrfs partition than a bug in partclone.

I created a backup of the complete NUC using clonezilla (using nfsclone > partimage > dd). After restoring that backup to a virtual machine I shrank the 125GB partition by 20GB but still no success.

Expanding the partition back to is original size did solve it for me. partclone.btrfs did run successfully after that. Then I did the same on the Intel NUC and it solved my issue there too.

The chunk_root vs total_bytes values haven't changed but the tools seem not to mind - so neither do I.

/Thomas K.

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

James P - 2020-10-26

Hi Thomas,
I've been watching your progress and am delighted to hear you see to have solved your own problem :)
Well done for perseverence. However, we are still no closer to finding out what causes this :)
My issues cleared when I updated to the newest clonezilla distribtion (I see there is a new Groovy-Gorilla one now though so...dare I try and update ;)
Amyway, just thought I would say that we are watching...just have no helpful input (some of us)

All the best and well done again.
James

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
- Thomas Kupper - 2020-10-26
  
  Hey James,
  
  :) all good, kind of you to give feedback.
  
  I broke the promise and kept on it a bit and now have it down to the one file that is the culprit. There is only the file 'system.img' (installed by Android Studio) left on the btrfs volume. And partclone.btrfs still fails.
  
  How would one proceed from that? Would inspect-internal dump-tree help?
  
  /Thomas K.
  
  If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

James P - 2020-10-29

Ahhh Thomas, you are mistaking me for someone who knows what they are doing :) I'm sorry to disappoint but I only get by with the Internet as my teacher/knowledgebase>
I'm afraind I have no idea what that command you printed ther is for? Is that a btrfs thing?
I've only just started using btrfs and am still at the level of being able to make subvolumes, take snapshots (and delete them) and do balances and scrubs. As to how it all works and how I can get myself out of any difficulties I expereince...it's all a mystery sadly :)
But, I do take regular backups with clonezilla and was so glad when my system started to work again with that program.
As I said earlier, after i updated to the next version of Clonezilla my issues went away and I can now backup btrfs partitions without issue.
Really sorry not to be able to help but I may nip off and try that command out just to see what happens ;)
Good luck, I'm sure you'll get through this :)

J

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Steven Shiau - 2020-10-30

We have uploaded Clonezilla live 2.7.0-9 and 20201029-*:
https://clonezilla.org/downloads.php

It includes Partclone 0.3.17, which has updated BTRFS 5.4 by Thomas Kupper and merged by Thomas Tsai.
Please test it for BTRFS and maybe the results will be different.
Thanks.

Steven

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Romain B - 2020-10-30

It works !
Thanks

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Steven Shiau - 2020-10-30

Great! Thanks for your report.

Steven

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

btrfs clone failure

A partition and disk imaging/cloning program

Group

Searches

Help

#327 btrfs clone failure

Expected Behavior

Actual Behavior

Steps to Reproduce the Problem

Version

Additional Query

Related

Discussion

Related