Rsyncrypto errors during restore.

[Edwin S. <po...@Ed...>]

Dear  rsy...@li...,

I'm still strubling with the rsyncrypto utility, maybe a debian/fedora
difference...

This is how far I have come today, encrypting works :)
# Create x509 private key:
openssl req -x509 -newkey rsa:1024 -keyout key.pem -out req.pem
# Encrypt source directory to dest directory, save keys in keydir using
req.pem as private key:
rsyncrypto -r -v /var/backup/source/ /var/backup/dest /var/backup/keydir
/root/req.pem

Now to difficult part, decrypting. I seem to get errors, but not for all
to decrypt files. I also get errors for files that have been restored jus=
t
fine... I use the following command:
rsyncrypto -r -d -v /var/backup/dest /var/backup/restore
/var/backup/keydir /root/req.pem

Below my command output for the routine encrypt and decrypt. After this I
ls the restore directory to see that not all files have been restored.
During decrypting I see that README has errors, but doing an md5sum it
looks OK...

Any ideas?

Regards,
Edwin Schouten.


[root@p3151447 root]# rsyncrypto -r -vvv --trim=3D3 --delete
/var/backup/source /var/backup/dest/ /var/backup/keydir /root/req.pem
Encrypting /var/backup/source/autommap.h
Encrypting /var/backup/source/redir.h
Encrypting /var/backup/source/NEWS
Encrypting /var/backup/source/README
Encrypting /var/backup/source/aes_crypt.h
Encrypting /var/backup/source/file.cpp
Encrypting /var/backup/source/stamp-h1
Encrypting /var/backup/source/blocksizes.cpp
Encrypting /var/backup/source/config.h
Encrypting /var/backup/source/configure.ac
Encrypting /var/backup/source/main.o
Rotated 13751
Rotated 23384
Rotated 16151
Rotated 14609
Rotated 11105
Rotated 11600
Encrypting /var/backup/source/filemap.o
Rotated 11718
Rotated 19219
Rotated 15520
Rotated 14237
Rotated 14330
Rotated 37885
Rotated 8369
Encrypting /var/backup/source/config.guess
Encrypting /var/backup/source/backup.key
Encrypting /var/backup/source/crypt_key.cpp
Encrypting /var/backup/source/process.o
Rotated 13595
Rotated 10148
Rotated 12477
Rotated 16267
Rotated 11727
Rotated 14396
Encrypting /var/backup/source/main.cpp
Encrypting /var/backup/source/Makefile.in
Encrypting /var/backup/source/.deps/main.Po
Encrypting /var/backup/source/.deps/aes_crypt.Po
Encrypting /var/backup/source/.deps/blocksizes.Po
Encrypting /var/backup/source/.deps/process.Po
Encrypting /var/backup/source/.deps/filemap.Po
Encrypting /var/backup/source/.deps/crypto.Po
Encrypting /var/backup/source/.deps/crypt_key.Po
Encrypting /var/backup/source/.deps/file.Po
Encrypting /var/backup/source/.deps/redir.Po
Encrypting /var/backup/source/aes_crypt.o
Rotated 11518
Rotated 13106
Rotated 10484
Rotated 10102
Rotated 13420
Rotated 16292
Encrypting /var/backup/source/rsyncrypto.man
Encrypting /var/backup/source/mkinstalldirs
Encrypting /var/backup/source/crypt_key.h
Encrypting /var/backup/source/config.h.in
Encrypting /var/backup/source/rsyncrypto.h
Encrypting /var/backup/source/COPYING
Encrypting /var/backup/source/rsyncrypto.mak
Encrypting /var/backup/source/INSTALL
Encrypting /var/backup/source/redir.o
Rotated 12024
Rotated 9231
Rotated 12036
Rotated 13311
Rotated 16153
Rotated 11964
Encrypting /var/backup/source/install-sh
Encrypting /var/backup/source/blocksizes.o
Rotated 10245
Rotated 8381
Rotated 8655
Rotated 8548
Rotated 17706
Rotated 15609
Encrypting /var/backup/source/file.h
Encrypting /var/backup/source/config.log
Encrypting /var/backup/source/file.o
Rotated 10766
Rotated 12152
Rotated 27136
Rotated 10300
Rotated 26582
Rotated 23576
Encrypting /var/backup/source/rsyncrypto.dsw
Encrypting /var/backup/source/contrib/gzip-rsyncable.diff
Encrypting /var/backup/source/crypt_key.o
Rotated 20260
Rotated 8631
Rotated 13979
Rotated 32170
Encrypting /var/backup/source/depcomp
Encrypting /var/backup/source/stamp-h.in
Encrypting /var/backup/source/filemap.h
Encrypting /var/backup/source/aclocal.m4
Encrypting /var/backup/source/config.sub
Encrypting /var/backup/source/Makefile
Encrypting /var/backup/source/crypto.o
Rotated 17018
Rotated 31272
Rotated 14379
Rotated 12409
Rotated 11278
Encrypting /var/backup/source/redir.cpp
Encrypting /var/backup/source/Makefile.am
Encrypting /var/backup/source/filemap.cpp
Encrypting /var/backup/source/process.h
Encrypting /var/backup/source/crypto.cpp
Encrypting /var/backup/source/.cvsignore
Encrypting /var/backup/source/ChangeLog
Encrypting /var/backup/source/autodir.h
Encrypting /var/backup/source/autoarray.h
Encrypting /var/backup/source/blocksizes
Rotated 11360
Rotated 17067
Rotated 13173
Rotated 17786
Rotated 31634
Rotated 24225
Rotated 24256
Rotated 8624
Encrypting /var/backup/source/crypto.h
Encrypting /var/backup/source/rsyncrypto
Rotated 8690
Rotated 9032
Rotated 37687
Rotated 25920
Rotated 8976
Rotated 15333
Rotated 10147
Rotated 13898
Rotated 12574
Rotated 22469
Rotated 16241
Rotated 10659
Rotated 8439
Rotated 13443
Rotated 10564
Rotated 38189
Rotated 17032
Rotated 37981
Rotated 13537
Rotated 17739
Rotated 8225
Rotated 14752
Rotated 43157
Rotated 13923
Rotated 11856
Rotated 17053
Rotated 18225
Rotated 16040
Encrypting /var/backup/source/autofd.h
Encrypting /var/backup/source/autom4te.cache/requests
Encrypting /var/backup/source/autom4te.cache/output.0
Rotated 14003
Rotated 19199
Encrypting /var/backup/source/autom4te.cache/traces.0
Encrypting /var/backup/source/backup.nopass.key
Encrypting /var/backup/source/docs/filelist.txt
Encrypting /var/backup/source/docs/.cvsignore
Encrypting /var/backup/source/autopipe.h
Encrypting /var/backup/source/random.h
Encrypting /var/backup/source/aes_crypt.cpp
Encrypting /var/backup/source/process.cpp
Encrypting /var/backup/source/missing
Encrypting /var/backup/source/AUTHORS
Encrypting /var/backup/source/config.status
Encrypting /var/backup/source/rsyncrypto.dsp
Encrypting /var/backup/source/configure
Rotated 9287
Encrypting /var/backup/source/win32/resource.h
Encrypting /var/backup/source/win32/autommap.h
Encrypting /var/backup/source/win32/rsyncrypto.rc
Encrypting /var/backup/source/win32/win32glue.cpp
Encrypting /var/backup/source/win32/win32redir.h
Encrypting /var/backup/source/win32/types.h
Encrypting /var/backup/source/win32/nullgzip.cpp
Encrypting /var/backup/source/win32/redir.cpp
Encrypting /var/backup/source/win32/nullgzip.mak
Encrypting /var/backup/source/win32/autohandle.h
Encrypting /var/backup/source/win32/process.h
Encrypting /var/backup/source/win32/nullgzip.dsp
Encrypting /var/backup/source/win32/.cvsignore
Encrypting /var/backup/source/win32/autodir.h
Encrypting /var/backup/source/win32/stdafx.cpp
Encrypting /var/backup/source/win32/autofd.h
Encrypting /var/backup/source/win32/autopipe.h
Encrypting /var/backup/source/win32/process.cpp
[root@p3151447 root]# ll dest/
total 1884
-rw-r--r--  1 root root   8980 Nov 28 17:02 aclocal.m4
-rw-r--r--  1 root root    900 Nov 28 17:02 aes_crypt.cpp
-rw-r--r--  1 root root    756 Nov 28 17:02 aes_crypt.h
-rw-r--r--  1 root root  84756 Nov 28 17:02 aes_crypt.o
-rw-r--r--  1 root root    356 Nov 28 17:02 AUTHORS
-rw-r--r--  1 root root   1844 Nov 28 17:02 autoarray.h
-rw-r--r--  1 root root    612 Nov 28 17:02 autodir.h
-rw-r--r--  1 root root   2180 Nov 28 17:02 autofd.h
drwxr-xr-x  2 root root   4096 Nov 28 17:03 autom4te.cache
-rw-r--r--  1 root root   1300 Nov 28 17:02 autommap.h
-rw-r--r--  1 root root    660 Nov 28 17:02 autopipe.h
-rw-r--r--  1 root root    628 Nov 28 17:02 backup.key
-rw-r--r--  1 root root    564 Nov 28 17:02 backup.nopass.key
-rw-r--r--  1 root root 177524 Nov 28 17:02 blocksizes
-rw-r--r--  1 root root   1380 Nov 28 17:02 blocksizes.cpp
-rw-r--r--  1 root root  82964 Nov 28 17:02 blocksizes.o
-rw-r--r--  1 root root   1796 Nov 28 17:02 ChangeLog
-rw-r--r--  1 root root  13556 Nov 28 17:02 config.guess
-rw-r--r--  1 root root    916 Nov 28 17:02 config.h
-rw-r--r--  1 root root    852 Nov 28 17:02 config.h.in
-rw-r--r--  1 root root   4676 Nov 28 17:02 config.log
-rw-r--r--  1 root root  10196 Nov 28 17:02 config.status
-rw-r--r--  1 root root   9652 Nov 28 17:02 config.sub
-rw-r--r--  1 root root  36372 Nov 28 17:02 configure
-rw-r--r--  1 root root   1604 Nov 28 17:02 configure.ac
drwxr-xr-x  2 root root   4096 Nov 28 17:03 contrib
-rw-r--r--  1 root root   7780 Nov 28 17:02 COPYING
-rw-r--r--  1 root root   1092 Nov 28 17:02 crypt_key.cpp
-rw-r--r--  1 root root   1124 Nov 28 17:02 crypt_key.h
-rw-r--r--  1 root root  84372 Nov 28 17:02 crypt_key.o
-rw-r--r--  1 root root   3860 Nov 28 17:02 crypto.cpp
-rw-r--r--  1 root root   1252 Nov 28 17:02 crypto.h
-rw-r--r--  1 root root  98548 Nov 28 17:02 crypto.o
-rw-r--r--  1 root root   4836 Nov 28 17:02 depcomp
drwxr-xr-x  2 root root   4096 Nov 28 17:03 docs
-rw-r--r--  1 root root   4100 Nov 28 17:02 file.cpp
-rw-r--r--  1 root root    500 Nov 28 17:02 file.h
-rw-r--r--  1 root root   4036 Nov 28 17:02 filemap.cpp
-rw-r--r--  1 root root    756 Nov 28 17:02 filemap.h
-rw-r--r--  1 root root 129380 Nov 28 17:02 filemap.o
-rw-r--r--  1 root root 111492 Nov 28 17:02 file.o
-rw-r--r--  1 root root   3236 Nov 28 17:02 INSTALL
-rw-r--r--  1 root root   3188 Nov 28 17:02 install-sh
-rw-r--r--  1 root root   2228 Nov 28 17:02 main.cpp
-rw-r--r--  1 root root  92628 Nov 28 17:02 main.o
-rw-r--r--  1 root root   5428 Nov 28 17:02 Makefile
-rw-r--r--  1 root root    308 Nov 28 17:02 Makefile.am
-rw-r--r--  1 root root   5508 Nov 28 17:02 Makefile.in
-rw-r--r--  1 root root   3236 Nov 28 17:02 missing
-rw-r--r--  1 root root    948 Nov 28 17:02 mkinstalldirs
-rw-r--r--  1 root root    500 Nov 28 17:02 NEWS
-rw-r--r--  1 root root   1444 Nov 28 17:02 process.cpp
-rw-r--r--  1 root root    404 Nov 28 17:02 process.h
-rw-r--r--  1 root root  80484 Nov 28 17:02 process.o
-rw-r--r--  1 root root    404 Nov 28 17:02 random.h
-rw-r--r--  1 root root    644 Nov 28 17:02 README
-rw-r--r--  1 root root   1220 Nov 28 17:02 redir.cpp
-rw-r--r--  1 root root    612 Nov 28 17:02 redir.h
-rw-r--r--  1 root root  81652 Nov 28 17:02 redir.o
-rw-r--r--  1 root root 505108 Nov 28 17:02 rsyncrypto
-rw-r--r--  1 root root   1556 Nov 28 17:02 rsyncrypto.dsp
-rw-r--r--  1 root root    436 Nov 28 17:02 rsyncrypto.dsw
-rw-r--r--  1 root root   2484 Nov 28 17:02 rsyncrypto.h
-rw-r--r--  1 root root   1876 Nov 28 17:02 rsyncrypto.mak
-rw-r--r--  1 root root   4436 Nov 28 17:02 rsyncrypto.man
-rw-r--r--  1 root root    196 Nov 28 17:02 stamp-h1
-rw-r--r--  1 root root    180 Nov 28 17:02 stamp-h.in
drwxr-xr-x  2 root root   4096 Nov 28 17:03 win32
[root@p3151447 root]# rsyncrypto -r -d -vvv --trim=3D3 /var/backup/dest/
/var/backup/restore/ /var/backup/keydir /root/req.pem
Decrypting /var/backup/dest/autommap.h
Decrypting /var/backup/restore/autommap.h error: Error in encrypted strea=
m
(trailer):
Decrypting /var/backup/dest/redir.h
Decrypting /var/backup/restore/redir.h error: Error in encrypted stream
(trailer):
Decrypting /var/backup/dest/NEWS
Decrypting /var/backup/restore/NEWS error: Error in encrypted stream
(trailer):
Decrypting /var/backup/dest/README
Decrypting /var/backup/restore/README error: Error in encrypted stream
(trailer):
Decrypting /var/backup/dest/aes_crypt.h

gzip: stdin: unexpected end of file

gzip: stdin: unexpected end of file

gzip: stdin: unexpected end of file
Decrypting /var/backup/restore/aes_crypt.h error: Error in encrypted
stream (trailer):
Decrypting /var/backup/dest/file.cpp
Decrypting /var/backup/restore/file.cpp error: Error in encrypted stream
(trailer):
Decrypting /var/backup/dest/stamp-h1
Decrypting /var/backup/restore/stamp-h1 error: Error in encrypted stream
(trailer):
Decrypting /var/backup/dest/blocksizes.cpp
Decrypting /var/backup/restore/blocksizes.cpp error: Error in encrypted
stream (trailer):
Decrypting /var/backup/dest/config.h
Decrypting /var/backup/restore/config.h error: Error in encrypted stream
(trailer):
Decrypting /var/backup/dest/
gzip: stdin: unexpected end of file

gzip: stdin: unexpected end of file

gzip: stdin: unexpected end of file

gzip: stdin: unexpected end of file

gzip: stdin: unexpected end of file

gzip: stdin: unexpected end of file
configure.ac
Decrypting /var/backup/restore/configure.ac error: Error in encrypted
stream (trailer):
Decrypting /var/backup/dest/main.o

gzip: stdin: unexpected end of file
Rotated 42077
Decrypting /var/backup/restore/main.o error: Error in encrypted stream:
Decrypting /var/backup/dest/filemap.o

gzip: stdin: unexpected end of file
Rotated 46480
Rotated 15263
Decrypting /var/backup/restore/filemap.o error: Error in encrypted stream=
:
Decrypting /var/backup/dest/config.guess

gzip: stdin: unexpected end of file
Decrypting /var/backup/restore/config.guess error: Error in encrypted
stream (trailer):
Decrypting /var/backup/dest/backup.key
Decrypting /var/backup/restore/backup.key error: Error in encrypted strea=
m
(trailer):
Decrypting /var/backup/dest/crypt_key.cpp
Decrypting /var/backup/restore/crypt_key.cpp error: Error in encrypted
stream (trailer):
Decrypting /var/backup/dest/process.o

gzip:
gzip: stdin: unexpected end of file
stdin: unexpected end of file

gzip: stdin: unexpected end of file
Rotated 14363
Decrypting /var/backup/restore/process.o error: Error in encrypted stream=
:
Decrypting /var/backup/dest/main.cpp

gzip: stdin: unexpected end of file

gzip: stdin: unexpected end of file
Decrypting /var/backup/restore/main.cpp error: Error in encrypted stream
(trailer):
Decrypting /var/backup/dest/Makefile.in
Decrypting /var/backup/restore/Makefile.in error: Error in encrypted
stream (trailer):
Decrypting /var/backup/dest/.deps/main.Po
Decrypting /var/backup/restore/.deps/main.Po error: Error in encrypted
stream (trailer):
Decrypting /var/backup/dest/.deps/aes_crypt.Po
Decrypting /var/backup/restore/.deps/aes_crypt.Po error: Error in
encrypted stream (trailer):
Decrypting /var/backup/dest/.deps/blocksizes.Po
Decrypting /var/backup/restore/.deps/blocksizes.Po error: Error in
encrypted stream (trailer):
Decrypting /var/backup/dest/.deps/process.Po

gzip: stdin: unexpected end of file

gzip:
gzip:
gzip: stdin: unexpected end of file
stdin: unexpected end of file
stdin: unexpected end of file
Decrypting /var/backup/restore/.deps/process.Po error: Error in encrypted
stream (trailer):
Decrypting /var/backup/dest/.deps/filemap.Po
Decrypting /var/backup/restore/.deps/filemap.Po error: Error in encrypted
stream (trailer):
Decrypting /var/backup/dest/.deps/crypto.Po
Decrypting /var/backup/restore/.deps/crypto.Po error: Error in encrypted
stream (trailer):
Decrypting /var/backup/dest/.deps/crypt_key.Po
Decrypting /var/backup/restore/.deps/crypt_key.Po error: Error in
encrypted stream (trailer):
Decrypting /var/backup/dest/.deps/file.Po
Decrypting /var/backup/restore/.deps/file.Po error: Error in encrypted
stream (trailer):
Decrypting /var/backup/dest/.deps/redir.Po
Decrypting /var/backup/restore/.deps/redir.Po error: Error in encrypted
stream (trailer):
Decrypting /var/backup/dest/aes_crypt.o

gzip: stdin: unexpected end of file

gzip: stdin: unexpected end of file

gzip: stdin: unexpected end of file

gzip: stdin: unexpected end of file

gzip: stdin: unexpected end of file

gzip: stdin: unexpected end of file
Decrypting /var/backup/restore/aes_crypt.o error: Error in encrypted
stream (trailer):
Decrypting /var/backup/dest/rsyncrypto.man

gzip: stdin: unexpected end of file
Decrypting /var/backup/restore/rsyncrypto.man error: Error in encrypted
stream (trailer):
Decrypting /var/backup/dest/mkinstalldirs
Decrypting /var/backup/restore/mkinstalldirs error: Error in encrypted
stream (trailer):
Decrypting /var/backup/dest/crypt_key.h
Decrypting /var/backup/restore/crypt_key.h error: Error in encrypted
stream (trailer):
Decrypting /var/backup/dest/config.h.in
Decrypting /var/backup/restore/config.h.in error: Error in encrypted
stream (trailer):
Decrypting /var/backup/dest/rsyncrypto.h

gzip: stdin: unexpected end of file

gzip:
gzip: stdin: unexpected end of file

gzip: stdin: unexpected end of file
stdin: unexpected end of file
Decrypting /var/backup/restore/rsyncrypto.h error: Error in encrypted
stream (trailer):
Decrypting /var/backup/dest/COPYING
Decrypting /var/backup/restore/COPYING error: Error in encrypted stream
(trailer):
Decrypting /var/backup/dest/rsyncrypto.mak
Decrypting /var/backup/restore/rsyncrypto.mak error: Error in encrypted
stream (trailer):
Decrypting /var/backup/dest/INSTALL
Decrypting /var/backup/restore/INSTALL error: Error in encrypted stream
(trailer):
Decrypting /var/backup/dest/redir.o

gzip:
gzip: stdin: unexpected end of file
stdin: unexpected end of file

gzip: stdin: unexpected end of file
Rotated 16760
Decrypting /var/backup/restore/redir.o error: Error in encrypted stream:
Decrypting /var/backup/dest/install-sh

gzip: stdin: unexpected end of file

gzip: stdin: unexpected end of file
Decrypting /var/backup/restore/install-sh error: Error in encrypted strea=
m
(trailer):
Decrypting /var/backup/dest/blocksizes.o

gzip: stdin: unexpected end of file
Rotated 22332
Decrypting /var/backup/restore/blocksizes.o error: Error in encrypted str=
eam:
Decrypting /var/backup/dest/file.h
Decrypting /var/backup/restore/file.h error: Error in encrypted stream
(trailer):
Decrypting /var/backup/dest/config.log

gzip:
gzip: stdin: unexpected end of file
stdin: unexpected end of file
Decrypting /var/backup/restore/config.log error: Error in encrypted strea=
m
(trailer):
Decrypting /var/backup/dest/file.o

gzip: stdin: unexpected end of file
Rotated 50064

gzip: stdin: invalid compressed data--format violated
Broken pipe
[root@p3151447 root]# ll restore/
total 868
-rw-r--r--  1 root root   1508 Nov 28 17:04 aes_crypt.h
-rw-r--r--  1 root root 233475 Nov 28 17:04 aes_crypt.o
-rw-r--r--  1 root root   2640 Nov 28 17:04 autommap.h
-rw-r--r--  1 root root      0 Nov 28 17:04 backup.key
-rw-r--r--  1 root root      0 Nov 28 17:04 blocksizes.cpp
-rw-r--r--  1 root root  37587 Nov 28 17:04 blocksizes.o
-rw-r--r--  1 root root  41853 Nov 28 17:04 config.guess
-rw-r--r--  1 root root   2544 Nov 28 17:04 config.h
-rw-r--r--  1 root root      0 Nov 28 17:04 config.h.in
-rw-r--r--  1 root root  21644 Nov 28 17:04 config.log
-rw-r--r--  1 root root      0 Nov 28 17:04 configure.ac
-rw-r--r--  1 root root   4099 Nov 28 17:04 COPYING
-rw-r--r--  1 root root   2787 Nov 28 17:04 crypt_key.cpp
-rw-r--r--  1 root root      0 Nov 28 17:04 crypt_key.h
-rw-r--r--  1 root root  13115 Nov 28 17:04 file.cpp
-rw-r--r--  1 root root      0 Nov 28 17:04 file.h
-rw-r--r--  1 root root 131072 Nov 28 17:04 filemap.o
-rw-r--r--  1 root root 131072 Nov 28 17:04 file.o
-rw-r--r--  1 root root   7831 Nov 28 17:04 INSTALL
-rw-r--r--  1 root root   7122 Nov 28 17:04 install-sh
-rw-r--r--  1 root root   5411 Nov 28 17:04 main.cpp
-rw-r--r--  1 root root  83973 Nov 28 17:04 main.o
-rw-r--r--  1 root root  19549 Nov 28 17:04 Makefile.in
-rw-r--r--  1 root root      0 Nov 28 17:04 mkinstalldirs
-rw-r--r--  1 root root    579 Nov 28 17:04 NEWS
-rw-r--r--  1 root root  27236 Nov 28 17:04 process.o
-rw-r--r--  1 root root    829 Nov 28 17:04 README
-rw-r--r--  1 root root   1533 Nov 28 17:04 redir.h
-rw-r--r--  1 root root  26551 Nov 28 17:04 redir.o
-rw-r--r--  1 root root   6239 Nov 28 17:04 rsyncrypto.h
-rw-r--r--  1 root root  10032 Nov 28 17:04 rsyncrypto.mak
-rw-r--r--  1 root root      0 Nov 28 17:04 rsyncrypto.man
-rw-r--r--  1 root root      0 Nov 28 17:04 stamp-h1
[root@p3151447 backup]# md5sum source/README
8b6361d63172bc752d7299057f6ee39b  source/README
[root@p3151447 backup]# md5sum restore/README
8b6361d63172bc752d7299057f6ee39b  restore/README