Hi,
I ran “–full-remote-verification” and it identified a number of files with problems:
duplicati-iaab1f1a308db42be8c76bd3e500abcef.dindex.zip.aes: 511 errors
Extra: +5hEkBSbXo9047dV5Et4OAHU4TgAepcREpYogXZXZII=
Extra: +AuIw2Cj5tRAjOUk9dZSeXCg1RNSW9af92pOKjezDoQ=
Extra: +B4sEGi7FqZLbzDQUv0w97dij+vckoyEI3FNAeMxJl0=
Extra: +DdSF1S9xDBOJtaq9ghJrdR6FmIeEA0zqhmuA2n737g=
Extra: +HIdamXrLCpLWCNGU6SHG+fepomfIj6LlXURwuIN9lo=
Extra: +K/wER6prxJs3D+TmfXpS/6OZPRga8ywQUbfo11B3io=
Extra: +MEoosrKehxKRWPXlfftG6JUhu01TiavRdTy3fFLHk0=
Extra: +MKuG+BIMXL9v5NkfH66+Za7QIK1kWmXEx454C+aq2g=
Extra: +Rc4UoVkKNaJS1laM+DICv1sSP14TspVPsf+0Nbu70M=
Extra: +dRZSt5OxMI3Ln+KSp5LKoXDgtSpN0Ba521CeByZrHQ=
… and 501 moreduplicati-i300c206ba95c41e3888e343a8e70a491.dindex.zip.aes: 523 errors
Extra: +CoFOArfGAsQfVj7Lz8zrN8swrhGoCozKmEAuhUBYRU=
Extra: +hs0Evdd0XkKzTrgnP26whWKtSaTuxoMKooagdN3u6s=
Extra: +j5GRtoEMqGiSEcNdMUxTD5oIp735B+rwk05Jbgt34s=
Extra: +mtu22OOLFeretBdU889FLM31LjPlFKPXH6BBMXECds=
Extra: +pevjaPc6QgeUQZf1JDGLtn0pM6n0V73YucTqMAb+ps=
Extra: +qKUrKJZWwmcyyd1NB4m8NKjZSxzFtuW8i5SV6ITrD8=
Extra: +sSSFWhKZW9NLGHQ/kA0vOF5cR3TKSc2BPUa2Go8FJI=
Extra: /84IA35N8jT6eq1/O4WizL7E2T1rCWVtc8WYXrYj020=
Extra: /BDPGlkq3tjc7tMaoYfa/8DGVEG7GS6Gi3pFM/9iKpE=
Extra: /XeOYMcHphIM057HyngnG0Qh9tyBTYxrjr6o3RfiHDM=
… and 513 moreduplicati-be1f2d6dea6344a28812780718f544db5.dblock.zip.aes: 523 errors
Extra: +CoFOArfGAsQfVj7Lz8zrN8swrhGoCozKmEAuhUBYRU=
Extra: +hs0Evdd0XkKzTrgnP26whWKtSaTuxoMKooagdN3u6s=
Extra: +j5GRtoEMqGiSEcNdMUxTD5oIp735B+rwk05Jbgt34s=
Extra: +mtu22OOLFeretBdU889FLM31LjPlFKPXH6BBMXECds=
Extra: +pevjaPc6QgeUQZf1JDGLtn0pM6n0V73YucTqMAb+ps=
Extra: +qKUrKJZWwmcyyd1NB4m8NKjZSxzFtuW8i5SV6ITrD8=
Extra: +sSSFWhKZW9NLGHQ/kA0vOF5cR3TKSc2BPUa2Go8FJI=
Extra: /84IA35N8jT6eq1/O4WizL7E2T1rCWVtc8WYXrYj020=
Extra: /BDPGlkq3tjc7tMaoYfa/8DGVEG7GS6Gi3pFM/9iKpE=
Extra: /XeOYMcHphIM057HyngnG0Qh9tyBTYxrjr6o3RfiHDM=
… and 513 moreduplicati-be85b7e54e15a4627839019f164b24c44.dblock.zip.aes: 1 errors
Error: Data Error
I copied the database, removed them from the server and ran “purge broken”
After that, everything seems OK (I.E. I believe that it put all of the files that were removed from the back end by deleting the zips back onto the backend)
I used “>” redirector to write out the list of “broken” files, or so I thought. I got an empty file for some reason. So now, more out of curiosity than anything else, can I find out which files are in the bad zips?
I took my copy of the database and tried:
select
count (*)
from
Blockset bs
left join file f on
f.BlocksetID = bs.ID
left join block b on
b.Hash = bs.FullHash
left join Remotevolume rv on
b.VolumeID = rv.ID
where
coalesce(
f.ID,
f.Path,
f.BlocksetID,
f.MetadataID
) is not null
and rv.Name in(
'duplicati-iaab1f1a308db42be8c76bd3e500abcef.dindex.zip.aes',
'duplicati-i300c206ba95c41e3888e343a8e70a491.dindex.zip.aes',
'duplicati-be1f2d6dea6344a28812780718f544db5.dblock.zip.aes',
'duplicati-be85b7e54e15a4627839019f164b24c44.dblock.zip.aes'
);
which yields only 118. (Unsure of the significance of the 5 rows where the blockset table has an entry but no corresponding entry exists in the file table however all have the rv.name of ‘duplicati-be85b7e54e15a4627839019f164b24c44.dblock.zip.aes’, the one that the verification identified as “data error”
This seems low given that the verification reports > 500 errors per file.
The example blocks with errors do not seem to point to files:
select
f.Path,
b.Hash as 'b.hash',
rv.Name,
rv.Hash as 'rv.hash'
from
block b
left join Remotevolume rv on
b.VolumeID = rv.ID
left join blockset bs on
b.Hash = bs.FullHash
left join file f on
f.BlocksetID = bs.id
where
b.hash in(
'+5hEkBSbXo9047dV5Et4OAHU4TgAepcREpYogXZXZII=',
'+AuIw2Cj5tRAjOUk9dZSeXCg1RNSW9af92pOKjezDoQ=',
'+B4sEGi7FqZLbzDQUv0w97dij+vckoyEI3FNAeMxJl0=',
'+DdSF1S9xDBOJtaq9ghJrdR6FmIeEA0zqhmuA2n737g=',
'+HIdamXrLCpLWCNGU6SHG+fepomfIj6LlXURwuIN9lo=',
'+K/wER6prxJs3D+TmfXpS/6OZPRga8ywQUbfo11B3io=',
'+MEoosrKehxKRWPXlfftG6JUhu01TiavRdTy3fFLHk0=',
'+MKuG+BIMXL9v5NkfH66+Za7QIK1kWmXEx454C+aq2g=',
'+Rc4UoVkKNaJS1laM+DICv1sSP14TspVPsf+0Nbu70M=',
'+dRZSt5OxMI3Ln+KSp5LKoXDgtSpN0Ba521CeByZrHQ='
);
Path |b.hash |Name |rv.hash |
-----|---------------------------------------------|-----------------------------------------------------------|---------------------------------------------|
|+5hEkBSbXo9047dV5Et4OAHU4TgAepcREpYogXZXZII= |duplicati-b6547415e432d488cbd9f86fbd0495633.dblock.zip.aes |xyjP2Vn4cvBwoeNSdtnYxQ9e1RsWWy45ZsrqtfQRYoI= |
|+AuIw2Cj5tRAjOUk9dZSeXCg1RNSW9af92pOKjezDoQ= |duplicati-b6547415e432d488cbd9f86fbd0495633.dblock.zip.aes |xyjP2Vn4cvBwoeNSdtnYxQ9e1RsWWy45ZsrqtfQRYoI= |
|+B4sEGi7FqZLbzDQUv0w97dij+vckoyEI3FNAeMxJl0= |duplicati-b6547415e432d488cbd9f86fbd0495633.dblock.zip.aes |xyjP2Vn4cvBwoeNSdtnYxQ9e1RsWWy45ZsrqtfQRYoI= |
|+DdSF1S9xDBOJtaq9ghJrdR6FmIeEA0zqhmuA2n737g= |duplicati-b6547415e432d488cbd9f86fbd0495633.dblock.zip.aes |xyjP2Vn4cvBwoeNSdtnYxQ9e1RsWWy45ZsrqtfQRYoI= |
|+HIdamXrLCpLWCNGU6SHG+fepomfIj6LlXURwuIN9lo= |duplicati-b6547415e432d488cbd9f86fbd0495633.dblock.zip.aes |xyjP2Vn4cvBwoeNSdtnYxQ9e1RsWWy45ZsrqtfQRYoI= |
|+K/wER6prxJs3D+TmfXpS/6OZPRga8ywQUbfo11B3io= |duplicati-b6547415e432d488cbd9f86fbd0495633.dblock.zip.aes |xyjP2Vn4cvBwoeNSdtnYxQ9e1RsWWy45ZsrqtfQRYoI= |
|+MEoosrKehxKRWPXlfftG6JUhu01TiavRdTy3fFLHk0= |duplicati-b6547415e432d488cbd9f86fbd0495633.dblock.zip.aes |xyjP2Vn4cvBwoeNSdtnYxQ9e1RsWWy45ZsrqtfQRYoI= |
|+MKuG+BIMXL9v5NkfH66+Za7QIK1kWmXEx454C+aq2g= |duplicati-b6547415e432d488cbd9f86fbd0495633.dblock.zip.aes |xyjP2Vn4cvBwoeNSdtnYxQ9e1RsWWy45ZsrqtfQRYoI= |
|+Rc4UoVkKNaJS1laM+DICv1sSP14TspVPsf+0Nbu70M= |duplicati-b6547415e432d488cbd9f86fbd0495633.dblock.zip.aes |xyjP2Vn4cvBwoeNSdtnYxQ9e1RsWWy45ZsrqtfQRYoI= |
|+dRZSt5OxMI3Ln+KSp5LKoXDgtSpN0Ba521CeByZrHQ= |duplicati-b6547415e432d488cbd9f86fbd0495633.dblock.zip.aes |xyjP2Vn4cvBwoeNSdtnYxQ9e1RsWWy45ZsrqtfQRYoI= |