|
From: G.W. H. <ba...@ju...> - 2025-10-07 13:32:25
|
Hi there, On Tue, 7 Oct 2025, Jamie Burchell wrote: > Out of the blue on the 24th September, my log showed: > ... > ... > 2025-09-24 01:02:30 admin1 : BackupPC_refCountUpdate: missing pool file > ee88a6fce8449682d6b4465f89b447ec count 19 > > 2025-09-24 01:03:26 admin1 : BackupPC_refCountUpdate total errors: 9 > ... > Logs prior to this show no missing pool files and logs after this show a > decreasing number of missing files. Only one has remained: > ... > a06340ddb577fd02a04bda2998a8d246 > ... > Curious which backup this pertains to, I found and run the script mentioned > ... > No log file is created and I cannot find a file named poolCnt.1.9f: > > $ ls /var/lib/BackupPC/pc/*/*/refCnt/poolCnt > > $ ls: cannot access '/var/lib/BackupPC/pc/*/*/refCnt/poolCnt': No such file > or directory > ... Even if there were such files, your ls command wouldn't list them because it looks for files named 'poolCnt' not 'poolCnt*'. :( I recommend getting the hang of the 'find' utility, but be warned that in my experience it's an acquired taste. You could always pipe the output of ls -lR into a pager (or grep) but the right utility will be more efficient. > I also can?t see what caused this to happen in the first place. ... > Can anyone give any insight in to what is going on here ... Did a machine experience a power failure, crash, or something like that? Perhaps someone restarted BackupPC at an inconvenient time? Did you experiment with compression? Manually fiddle with the pool? > ... how I might be able to find out which file is missing? BackupPC_poolCntPrint may give some useful information, see e.g. https://sourceforge.net/p/backuppc/mailman/message/36379446/ The syntax isn't always obvious so here's an example using BackupPC_ls much as Craig suggests in his post linked above, to list md5sums on a box backed up here: backuppc@server:$ /usr/local/BackupPC/bin/BackupPC_ls -R -h host44 -n 2072 -s Config / | head /: -rw------- 0/0 0 2013-06-27 13:09:27 /.pwd.lock (d41d8cd98f00b204e9800998ecf8427e) drwxr-xr-x 0/0 0 2021-09-03 14:52:44 /ConsoleKit/ -rw-r--r-- 0/0 1467 2019-01-18 15:26:02 /GeoIP.conf (fe5e3fdcd6ad284bb57e63fe41f4e553) drwxr-xr-x 0/0 0 2015-05-03 19:19:43 /ImageMagick/ drwxr-xr-x 0/0 0 2024-03-20 07:44:44 /ImageMagick-6/ -rw-r--r-- 0/0 4954 2021-01-25 18:10:07 /Muttrc (6793ae4ed35d7fa37a57e2b1fd1507e8) [very big snip] You'd grep your output for a06340ddb577fd02a04bda2998a8d246. There might be more scripts kicking around on the mailing list to do things like this, I can't recall, but sometimes random scripts need bringing up to date. So unless you like puzzles I'd recommend using the tools provided before going off the reservation. -- 73, Ged. |
|
From: G.W. H. <ba...@ju...> - 2025-10-08 12:58:34
|
Hi there, On Wed, 8 Oct 2025, Jamie Burchell wrote: > Found it with: > ... > find . -name "poolCnt.1.a0" -exec sh -c ... Neat. :) Did it shed any light on the cause? -- 73, Ged. |
|
From: Jamie B. <ja...@ib...> - 2025-10-08 13:55:39
|
Hi! > Did it shed any light on the cause? Absolutely none 😊 -----Original Message----- From: G.W. Haywood <ba...@ju...> Sent: 08 October 2025 13:58 To: bac...@li... Subject: Re: [BackupPC-users] Missing pool files Hi there, On Wed, 8 Oct 2025, Jamie Burchell wrote: > Found it with: > ... > find . -name "poolCnt.1.a0" -exec sh -c ... Neat. :) Did it shed any light on the cause? -- 73, Ged. _______________________________________________ BackupPC-users mailing list Bac...@li... List: https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki: https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/ |
|
From: Jamie B. <ja...@ib...> - 2025-10-07 13:55:21
|
Hi Ged > Even if there were such files, your ls command wouldn't list them > because it looks for files named 'poolCnt' not 'poolCnt*'. :( Yes, apologies I pasted the wrong command in to my email - I did actually try to find with the wildcard version (unsuccessfully). > Did a machine experience a power failure, crash, or something like > that? Perhaps someone restarted BackupPC at an inconvenient time? > Did you experiment with compression? Manually fiddle with the pool? Certainly not changed any settings or fiddled with the pool in any way. It's possible that the server (cloud based VM) ran in to an issue but I'm not aware of it. > backuppc@server:$ /usr/local/BackupPC/bin/BackupPC_ls -R -h host44 -n > 2072 -s Config / | head Hmm, but I would need to manually run this for every host (50 of them) and every backup? Thanks Jamie |
|
From: G.W. H. <ba...@ju...> - 2025-10-07 13:57:55
|
Hi there, On Tue, 7 Oct 2025, G.W. Haywood wrote: > On Tue, 7 Oct 2025, Jamie Burchell wrote: > > Out of the blue on the 24th September, my log showed: > ... > > > [snip] Oh, I almost forgot: https://github.com/backuppc/backuppc/wiki/How-to-find-which-backups-reference-a-particular-pool-file :) -- 73, Ged. |
|
From: Jamie B. <ja...@ib...> - 2025-10-07 14:08:59
|
Thanks Ged, but the pool file is missing, so I don't think any of this helps? Certainly there is no file with the name a06340ddb577fd02a04bda2998a8d246 anywhere in the pool. -----Original Message----- From: G.W. Haywood <ba...@ju...> Sent: 07 October 2025 14:58 To: bac...@li... Subject: Re: [BackupPC-users] Missing pool files Hi there, On Tue, 7 Oct 2025, G.W. Haywood wrote: > On Tue, 7 Oct 2025, Jamie Burchell wrote: > > Out of the blue on the 24th September, my log showed: > ... > > > [snip] Oh, I almost forgot: https://github.com/backuppc/backuppc/wiki/How-to-find-which-backups-reference-a-particular-pool-file :) -- 73, Ged. _______________________________________________ BackupPC-users mailing list Bac...@li... List: https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki: https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/ |
|
From: Jamie B. <ja...@ib...> - 2025-10-07 16:26:22
|
Found it with:
# a0 is the first two letters of the hash of the file we are looking for:
a06340ddb577fd02a04bda2998a8d246
find . -name "poolCnt.1.a0" -exec sh -c 'for f; do
/usr/share/BackupPC/bin/BackupPC_poolCntPrint "$f" | grep -q
"a06340ddb577fd02a04bda2998a8d246" && echo "Match: $f"; done' sh {} +
Thanks for the pointers!
--
-----Original Message-----
From: G.W. Haywood <ba...@ju...>
Sent: 07 October 2025 14:58
To: bac...@li...
Subject: Re: [BackupPC-users] Missing pool files
Hi there,
On Tue, 7 Oct 2025, G.W. Haywood wrote:
> On Tue, 7 Oct 2025, Jamie Burchell wrote:
>
> Out of the blue on the 24th September, my log showed:
> ...
>
> > [snip]
Oh, I almost forgot:
https://github.com/backuppc/backuppc/wiki/How-to-find-which-backups-reference-a-particular-pool-file
:)
--
73,
Ged.
_______________________________________________
BackupPC-users mailing list
Bac...@li...
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/
|
|
From: Jamie B. <ja...@ib...> - 2025-10-07 17:29:30
|
> Found it with:
> # a0 is the first two letters of the hash of the file we are looking for:
> a06340ddb577fd02a04bda2998a8d246
> $ find . -name "poolCnt.1.a0" -exec sh -c 'for f; do
> /usr/share/BackupPC/bin/BackupPC_poolCntPrint "$f" | grep -q
> "a06340ddb577fd02a04bda2998a8d246" && echo "Match: $f"; done' sh {} +
Well having apparently found the backup that this file relates to:
sudo -ubackuppc ./BackupPC_ls -R -h myhost -n 1437 -s /var/www / | egrep
a06340ddb577fd02a04bda2998a8d246
... returns no results. No results in any share of that backup.
-----Original Message-----
From: Jamie Burchell <ja...@ib...>
Sent: 07 October 2025 17:26
To: General list for user discussion, questions and support
<bac...@li...>
Subject: RE: [BackupPC-users] Missing pool files
Found it with:
# a0 is the first two letters of the hash of the file we are looking for:
a06340ddb577fd02a04bda2998a8d246
find . -name "poolCnt.1.a0" -exec sh -c 'for f; do
/usr/share/BackupPC/bin/BackupPC_poolCntPrint "$f" | grep -q
"a06340ddb577fd02a04bda2998a8d246" && echo "Match: $f"; done' sh {} +
Thanks for the pointers!
--
-----Original Message-----
From: G.W. Haywood <ba...@ju...>
Sent: 07 October 2025 14:58
To: bac...@li...
Subject: Re: [BackupPC-users] Missing pool files
Hi there,
On Tue, 7 Oct 2025, G.W. Haywood wrote:
> On Tue, 7 Oct 2025, Jamie Burchell wrote:
>
> Out of the blue on the 24th September, my log showed:
> ...
>
> > [snip]
Oh, I almost forgot:
https://github.com/backuppc/backuppc/wiki/How-to-find-which-backups-reference-a-particular-pool-file
:)
--
73,
Ged.
_______________________________________________
BackupPC-users mailing list
Bac...@li...
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/
|
|
From: Jamie B. <ja...@ib...> - 2025-10-07 17:35:10
|
Well, removing the backup has somehow now revealed the file in question:
2025-10-07 18:30:10 BackupPC_backupDelete: removing #1437
2025-10-07 18:30:10 BackupPC_backupDelete: Merge into backup 1436
2025-10-07 18:30:10 Can't read attribute file
/var/lib/BackupPC//pc/myhost/1436/f%2fvar%2fwww/freleases/f220/fweb/fapp/flanguages/fplugins/attrib_a06340ddb577fd02a04bda2998a8d246
2025-10-07 18:30:20 bpc_attrib_dirRead: can't open
/var/lib/BackupPC//cpool/a0/62/a06340ddb577fd02a04bda2998a8d246
2025-10-07 18:30:22 bpc_attrib_dirRead: can't open
/var/lib/BackupPC//cpool/a0/62/a06340ddb577fd02a04bda2998a8d246
2025-10-07 18:30:22 bpc_path_refCountAll: can't read attrib file
/var/lib/BackupPC//pc/myhost/1436/f%2fvar%2fwww/freleases/f220/fweb/fapp/flanguages/fplugins/attrib_a06340ddb577fd02a04bda2998a8d246
2025-10-07 18:30:28 BackupPC_refCountUpdate: host dmtt_web got 1 errors
(took 7 secs)
2025-10-07 18:30:28 BackupPC_refCountUpdate total errors: 1
2025-10-07 18:30:28 BackupPC_backupDelete: got 2 errors
-----Original Message-----
From: Jamie Burchell <ja...@ib...>
Sent: 07 October 2025 18:29
To: General list for user discussion, questions and support
<bac...@li...>
Subject: RE: [BackupPC-users] Missing pool files
> Found it with:
> # a0 is the first two letters of the hash of the file we are looking for:
> a06340ddb577fd02a04bda2998a8d246
> $ find . -name "poolCnt.1.a0" -exec sh -c 'for f; do
> /usr/share/BackupPC/bin/BackupPC_poolCntPrint "$f" | grep -q
> "a06340ddb577fd02a04bda2998a8d246" && echo "Match: $f"; done' sh {} +
Well having apparently found the backup that this file relates to:
sudo -ubackuppc ./BackupPC_ls -R -h myhost -n 1437 -s /var/www / | egrep
a06340ddb577fd02a04bda2998a8d246
... returns no results. No results in any share of that backup.
-----Original Message-----
From: Jamie Burchell <ja...@ib...>
Sent: 07 October 2025 17:26
To: General list for user discussion, questions and support
<bac...@li...>
Subject: RE: [BackupPC-users] Missing pool files
Found it with:
# a0 is the first two letters of the hash of the file we are looking for:
a06340ddb577fd02a04bda2998a8d246
find . -name "poolCnt.1.a0" -exec sh -c 'for f; do
/usr/share/BackupPC/bin/BackupPC_poolCntPrint "$f" | grep -q
"a06340ddb577fd02a04bda2998a8d246" && echo "Match: $f"; done' sh {} +
Thanks for the pointers!
--
-----Original Message-----
From: G.W. Haywood <ba...@ju...>
Sent: 07 October 2025 14:58
To: bac...@li...
Subject: Re: [BackupPC-users] Missing pool files
Hi there,
On Tue, 7 Oct 2025, G.W. Haywood wrote:
> On Tue, 7 Oct 2025, Jamie Burchell wrote:
>
> Out of the blue on the 24th September, my log showed:
> ...
>
> > [snip]
Oh, I almost forgot:
https://github.com/backuppc/backuppc/wiki/How-to-find-which-backups-reference-a-particular-pool-file
:)
--
73,
Ged.
_______________________________________________
BackupPC-users mailing list
Bac...@li...
List: https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki: https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/
|