Error while running Synology backup

[ts678]

@dr8876

Type it in by hand. Manually created.

Does that mean created by remote file tool? I’m still hoping you can try remote admin to try SFTP. Meanwhile, we can keep finding out what WebDAV can and can’t do.

@dr8876

the part that has to do with the folder.

You can’t just tack the folder onto the end. The old folder was CAN_Share/Storj backups, right?
If you stayed there, you’d need double quotes around the whole URL because of the space there.
For the new folder, replace the old folder, and you can decide if you need quotes. They won’t hurt.

[dr8876]

@ts678

If you stayed there

What do you mean? I am trying to test something on the backend, per your advice. Do I want to test this folder, the destination folder?

[ts678]

@dr8876

Do I want to test this folder, the destination folder?

No. The BackendTester writes to its folder, and it would be a bad idea for it to write over your backup.

@ts678

Remember that, either way, you should edit it to an empty Synology folder, otherwise it won’t test it.

[dr8876]

I’m sorry for not understanding, I really am. What do I need to do in order for the command to work? Do I need to create a new folder for this test?

EDIT: A new folder on the Synology NAS?

[ts678]

@dr8876

Do I need to create a new folder for this test?

I think so, and you said you did, but you also need to edit the URL to use it, and not the regular folder.

[dr8876]

@ts678

and you said you did,

I didn’t create a new one. But I will do that now. Stand by.

[ts678]

I’m basing answer on a test below, using rclone to do WebDAV on this PC. I hadn’t tried that before.

Duplicati.CommandLine.BackendTester webdav://username:password@localhost:8080/tester
Starting run no 0
Unittest failed: Duplicati.Library.Interface.FolderMissingException: The folder /tester/ was not found, message: The remote server returned an error: (404) Not Found. ---> System.Net.WebException: The remote server returned an error: (404) Not Found.

Other reasons for test were to prepare for possible TLS 1.3 issue, which we didn’t hit. Knowing you’re using unencrypted credentials then made me wonder if they’re exposed, and I’m thinking probably so. These can be changed easily on the Synology, I assume (if you can admin it). A Duplicati passphrase change (meaning its encryption passphrase) can unfortunately only be done by having a fresh backup.

[dr8876]

It’s running now. Hold on.

EDIT: Downloading and uploading.

EDIT 2: How long does this typically take?

[ts678]

It will probably take some tens of minutes at default settings. Note that it notes some “expected” errors, however if it starts giving errors it doesn’t say are expected (especially on big files), that’s of concern…

EDIT:

Use one or more of the following command line options:

    --reruns
    Value: Integer
    The number of test runs to perform.
    A number that describes how many times the test is performed.
    Default value: 5

on the help link to the manual will let you guess how much time to go.
I was sort of hoping it would fail on its first run, thus showing an issue.
If it manages all 5, then maybe a different test strategy will be needed.

[dr8876]

@ts678

A Duplicati passphrase change (meaning its encryption passphrase) can unfortunately only be done by having a fresh backup.

That’s fine. As long as I figure out where the error is coming from.

[dr8876]

Starting run no 0
Generating file 0 (43.20 MB)
Generating file 1 (39.12 MB)
Generating file 2 (13.40 MB)
Generating file 3 (20.85 MB)
Generating file 4 (33.36 MB)
Generating file 5 (15.47 MB)
Generating file 6 (25.42 MB)
Generating file 7 (2.09 MB)
Generating file 8 (49.51 MB)
Generating file 9 (26.62 MB)
Uploading wrong files …
Generating file 10 (1.32 KB)
Uploading file 0, 1.32 KB … done!
Uploading file 0, 1.32 KB … done!
Uploading file 9, 1.32 KB … done!
Uploading files …
Uploading file 0, 43.20 MB … done!
Uploading file 1, 39.12 MB … done!
Uploading file 2, 13.40 MB … done!
Uploading file 3, 20.85 MB … done!
Uploading file 4, 33.36 MB … done!
Uploading file 5, 15.47 MB … done!
Uploading file 6, 25.42 MB … done!
Uploading file 7, 2.09 MB … done!
Uploading file 8, 49.51 MB … done!
Uploading file 9, 26.62 MB … done!
Verifying file list …
Downloading files
Downloading file 0 … done
Checking hash … failed
*** Downloaded file was corrupt
Downloading file 1 … done
Checking hash … failed
*** Downloaded file was corrupt
Downloading file 2 … done
Checking hash … done
Downloading file 3 … done
Checking hash … failed
*** Downloaded file was corrupt
Downloading file 4 … done
Checking hash … failed
*** Downloaded file was corrupt
Downloading file 5 … done
Checking hash … done
Downloading file 6 … done
Checking hash … failed
*** Downloaded file was corrupt
Downloading file 7 … done
Checking hash … failed
*** Downloaded file was corrupt
Downloading file 8 … done
Checking hash … failed
*** Downloaded file was corrupt
Downloading file 9 … done
Checking hash … failed
*** Downloaded file was corrupt
Deleting files…
Checking retrieval of non-existent file…
*** Retrieval of non-existent file failed: System.Net.WebException: The remote server returned an error: (404) Not Found.
at Duplicati.Library.Utility.AsyncHttpRequest.AsyncWrapper.GetResponseOrStream()
at Duplicati.Library.Utility.AsyncHttpRequest.GetResponse()
at Duplicati.Library.Backend.WEBDAV.Get(String remotename, Stream stream)
at Duplicati.Library.Backend.WEBDAV.Get(String remotename, String filename)
at Duplicati.CommandLine.BackendTester.Program.Run(List1 args, Dictionary2 options, Boolean first)
*** Retrieval of non-existent file should have failed with FileMissingException
Checking DNS names used by this backend…
christalliance.synology.me
Starting run no 1
Generating file 0 (27.08 MB)
Generating file 1 (12.23 MB)
Generating file 2 (15.03 MB)
Generating file 3 (8.18 MB)
Generating file 4 (43.81 MB)
Generating file 5 (35.72 MB)
Generating file 6 (25.25 MB)
Generating file 7 (39.61 MB)
Generating file 8 (33.44 MB)
Generating file 9 (36.07 MB)
Uploading wrong files …
Generating file 10 (1.94 KB)
Uploading file 0, 1.94 KB … done!
Uploading file 0, 1.94 KB … done!
Uploading file 9, 1.94 KB … done!
Uploading files …
Uploading file 0, 27.08 MB … done!
Uploading file 1, 12.23 MB … done!
Uploading file 2, 15.03 MB … done!
Uploading file 3, 8.18 MB … done!
Uploading file 4, 43.81 MB … done!
Uploading file 5, 35.72 MB … done!
Uploading file 6, 25.25 MB … done!
Uploading file 7, 39.61 MB … done!
Uploading file 8, 33.44 MB … done!
Uploading file 9, 36.07 MB … done!
Verifying file list …
Downloading files
Downloading file 0 … done
Checking hash … failed
*** Downloaded file was corrupt
Downloading file 1 … done
Checking hash … failed
*** Downloaded file was corrupt
Downloading file 2 … done
Checking hash … failed
*** Downloaded file was corrupt
Downloading file 3 … done
Checking hash … done
Downloading file 4 … done
Checking hash … failed
*** Downloaded file was corrupt
Downloading file 5 … done
Checking hash … failed
*** Downloaded file was corrupt
Downloading file 6 … done
Checking hash … failed
*** Downloaded file was corrupt
Downloading file 7 … done
Checking hash … failed
*** Downloaded file was corrupt
Downloading file 8 … done
Checking hash … failed
*** Downloaded file was corrupt
Downloading file 9 … done
Checking hash … failed
*** Downloaded file was corrupt
Deleting files…
Checking retrieval of non-existent file…
*** Retrieval of non-existent file failed: System.Net.WebException: The remote server returned an error: (404) Not Found.
at Duplicati.Library.Utility.AsyncHttpRequest.AsyncWrapper.GetResponseOrStream()
at Duplicati.Library.Utility.AsyncHttpRequest.GetResponse()
at Duplicati.Library.Backend.WEBDAV.Get(String remotename, Stream stream)
at Duplicati.Library.Backend.WEBDAV.Get(String remotename, String filename)
at Duplicati.CommandLine.BackendTester.Program.Run(List1 args, Dictionary2 options, Boolean first)
*** Retrieval of non-existent file should have failed with FileMissingException
Checking DNS names used by this backend…
christalliance.synology.me
Starting run no 2
Generating file 0 (1.04 MB)
Generating file 1 (13.44 MB)
Generating file 2 (14.93 MB)
Generating file 3 (40.97 MB)
Generating file 4 (15.48 MB)
Generating file 5 (5.25 MB)
Generating file 6 (5.71 MB)
Generating file 7 (32.12 MB)
Generating file 8 (24.84 MB)
Generating file 9 (12.80 MB)
Uploading wrong files …
Generating file 10 (1.83 KB)
Uploading file 0, 1.83 KB … done!
Uploading file 0, 1.83 KB … done!
Uploading file 9, 1.83 KB … done!
Uploading files …
Uploading file 0, 1.04 MB … done!
Uploading file 1, 13.44 MB … done!
Uploading file 2, 14.93 MB … done!
Uploading file 3, 40.97 MB … done!
Uploading file 4, 15.48 MB … done!
Uploading file 5, 5.25 MB … done!
Uploading file 6, 5.71 MB … done!
Uploading file 7, 32.12 MB … done!
Uploading file 8, 24.84 MB … done!
Uploading file 9, 12.80 MB … done!
Verifying file list …
Downloading files
Downloading file 0 … done
Checking hash … done
Downloading file 1 … done
Checking hash … done
Downloading file 2 … done
Checking hash … failed
*** Downloaded file was corrupt
Downloading file 3 … done
Checking hash … failed
*** Downloaded file was corrupt
Downloading file 4 … done
Checking hash … failed
*** Downloaded file was corrupt
Downloading file 5 … done
Checking hash … failed
*** Downloaded file was corrupt
Downloading file 6 … done
Checking hash … failed
*** Downloaded file was corrupt
Downloading file 7 … done
Checking hash … failed
*** Downloaded file was corrupt
Downloading file 8 … done
Checking hash … failed
*** Downloaded file was corrupt
Downloading file 9 … done
Checking hash … done
Deleting files…
Checking retrieval of non-existent file…
*** Retrieval of non-existent file failed: System.Net.WebException: The remote server returned an error: (404) Not Found.
at Duplicati.Library.Utility.AsyncHttpRequest.AsyncWrapper.GetResponseOrStream()
at Duplicati.Library.Utility.AsyncHttpRequest.GetResponse()
at Duplicati.Library.Backend.WEBDAV.Get(String remotename, Stream stream)
at Duplicati.Library.Backend.WEBDAV.Get(String remotename, String filename)
at Duplicati.CommandLine.BackendTester.Program.Run(List1 args, Dictionary2 options, Boolean first)
*** Retrieval of non-existent file should have failed with FileMissingException
Checking DNS names used by this backend…
christalliance.synology.me
Starting run no 3
Generating file 0 (25.16 MB)
Generating file 1 (6.03 MB)
Generating file 2 (28.19 MB)
Generating file 3 (37.96 MB)
Generating file 4 (15.39 MB)
Generating file 5 (9.23 MB)
Generating file 6 (20.77 MB)
Generating file 7 (10.22 MB)
Generating file 8 (18.88 MB)
Generating file 9 (30.53 MB)
Uploading wrong files …
Generating file 10 (1.32 KB)
Uploading file 0, 1.32 KB … done!
Uploading file 0, 1.32 KB … done!
Uploading file 9, 1.32 KB … done!
Uploading files …
Uploading file 0, 25.16 MB … done!
Uploading file 1, 6.03 MB … done!
Uploading file 2, 28.19 MB … done!
Uploading file 3, 37.96 MB … done!
Uploading file 4, 15.39 MB … done!
Uploading file 5, 9.23 MB … done!
Uploading file 6, 20.77 MB … done!
Uploading file 7, 10.22 MB … done!
Uploading file 8, 18.88 MB … done!
Uploading file 9, 30.53 MB … done!
Verifying file list …
Downloading files
Downloading file 0 … done
Checking hash … done
Downloading file 1 … done
Checking hash … failed
*** Downloaded file was corrupt
Downloading file 2 … done
Checking hash … failed
*** Downloaded file was corrupt
Downloading file 3 … done
Checking hash … failed
*** Downloaded file was corrupt
Downloading file 4 … done
Checking hash … failed
*** Downloaded file was corrupt
Downloading file 5 … done
Checking hash … failed
*** Downloaded file was corrupt
Downloading file 6 … done
Checking hash … failed
*** Downloaded file was corrupt
Downloading file 7 … done
Checking hash … failed
*** Downloaded file was corrupt
Downloading file 8 … done
Checking hash … failed
*** Downloaded file was corrupt
Downloading file 9 … done
Checking hash … failed
*** Downloaded file was corrupt
Deleting files…
Checking retrieval of non-existent file…
*** Retrieval of non-existent file failed: System.Net.WebException: The remote server returned an error: (404) Not Found.
at Duplicati.Library.Utility.AsyncHttpRequest.AsyncWrapper.GetResponseOrStream()
at Duplicati.Library.Utility.AsyncHttpRequest.GetResponse()
at Duplicati.Library.Backend.WEBDAV.Get(String remotename, Stream stream)
at Duplicati.Library.Backend.WEBDAV.Get(String remotename, String filename)
at Duplicati.CommandLine.BackendTester.Program.Run(List1 args, Dictionary2 options, Boolean first)
*** Retrieval of non-existent file should have failed with FileMissingException
Checking DNS names used by this backend…
christalliance.synology.me
Starting run no 4
Generating file 0 (34.47 MB)
Generating file 1 (34.72 MB)
Generating file 2 (19.13 MB)
Generating file 3 (46.51 MB)
Generating file 4 (19.77 MB)
Generating file 5 (2.32 MB)
Generating file 6 (17.82 MB)
Generating file 7 (27.84 MB)
Generating file 8 (49.31 MB)
Generating file 9 (34.95 MB)
Uploading wrong files …
Generating file 10 (1.66 KB)
Uploading file 0, 1.66 KB … done!
Uploading file 0, 1.66 KB … done!
Uploading file 9, 1.66 KB … done!
Uploading files …
Uploading file 0, 34.47 MB … done!
Uploading file 1, 34.72 MB … done!
Uploading file 2, 19.13 MB … done!
Uploading file 3, 46.51 MB … done!
Uploading file 4, 19.77 MB … done!
Uploading file 5, 2.32 MB … done!
Uploading file 6, 17.82 MB … done!
Uploading file 7, 27.84 MB … done!
Uploading file 8, 49.31 MB … done!
Uploading file 9, 34.95 MB … done!
Verifying file list …
Downloading files
Downloading file 0 … done
Checking hash … failed
*** Downloaded file was corrupt
Downloading file 1 … done
Checking hash … failed
*** Downloaded file was corrupt
Downloading file 2 … done
Checking hash … failed
*** Downloaded file was corrupt
Downloading file 3 … done
Checking hash … failed
*** Downloaded file was corrupt
Downloading file 4 … done
Checking hash … failed
*** Downloaded file was corrupt
Downloading file 5 … done
Checking hash … done
Downloading file 6 … done
Checking hash … failed
*** Downloaded file was corrupt
Downloading file 7 … done
Checking hash … failed
*** Downloaded file was corrupt
Downloading file 8 … done
Checking hash … failed
*** Downloaded file was corrupt
Downloading file 9 … done
Checking hash … failed
*** Downloaded file was corrupt
Deleting files…
Checking retrieval of non-existent file…
*** Retrieval of non-existent file failed: System.Net.WebException: The remote server returned an error: (404) Not Found.
at Duplicati.Library.Utility.AsyncHttpRequest.AsyncWrapper.GetResponseOrStream()
at Duplicati.Library.Utility.AsyncHttpRequest.GetResponse()
at Duplicati.Library.Backend.WEBDAV.Get(String remotename, Stream stream)
at Duplicati.Library.Backend.WEBDAV.Get(String remotename, String filename)
at Duplicati.CommandLine.BackendTester.Program.Run(List1 args, Dictionary2 options, Boolean first)
*** Retrieval of non-existent file should have failed with FileMissingException
Checking DNS names used by this backend…
christalliance.synology.me
Unittest complete!
‘auth-password’ is not recognized as an internal or external command,
operable program or batch file.

C:\Program Files\Duplicati 2>

[ts678]

The output is long and hard to read fast, but general trend looks like small files tend not to corrupt.
That’s what the big verbose test log was showing. We still don’t know if it’s on upload or download.

Old good backup is gone, so it can’t be tested. If you get SFTP up, you can test tested-bad dblock.
Possibly Cyberduck or Mountain Duck WebDAV can act as second opinion on a tested-bad dblock.
Pick something that failed your big test, download some other way, see if it’s still looking damaged.

@ts678

Individual files like duplicati-b8d4e45575ba545c1b0c87091cc6fccb7.dblock.zip.aes are feasible to download to the PC to decrypt, e.g. using AES Crypt GUI, or Duplicati’s SharpAESCrypt.exe CLI.

however that file failed the initial test (original post) and (if it’s still around) passed the big test all.

EDIT:

This is the end of that big test:

duplicati-b54e8f9ba8a1043a1ae3f274af92f92cb.dblock.zip.aes: 1 
errors
Error: Failed to decrypt data (invalid passphrase?): 
Message has been Altered, do not trust content
Return code: 3

so an idea would be to get that file using some other means, then see if it’s still impossible to decrypt.
If we trust the new means, then repeat fail would suggest problem is on the upload or during storage. Successful decrypt (again assuming we trust the new means) suggests damage during old download although the source of that damage is still unknown. This is just trying to narrow down the issue a bit.

[dr8876]

Opened the port to allow SFTP. Duplicati is asking me to trust the hist certificate? What do I do?

[ts678]

@dr8876

Duplicati is asking me to trust the hist certificate? What do I do?

Generally you say yes, unless you have some reason you think you’re on the wrong server.
Once you’ve said yes, you’ll be able to detect tampering if an imposter servers inserts itself.

[dr8876]

OK. The SFTP connection is working. I have an error message telling me to rebuild or purge the d block files. Do I rebuild them from the command line? I don’t see an option to do that…

[ts678]

@dr8876

The SFTP connection is working.

Meaning what? What did you do with the connection and any backup job you changed or made?
Do you have the error message text?

[ts678]

Maybe this? It matters to know for sure, and to know what you set up. This is not the requested test.

duplicati/duplicati/blob/e7c191389cdb3fdb9500d83ebd06e0ae99634fd1/Duplicati/Library/Main/Operation/RepairHandler.cs#L269-L269

EDIT:

The above code is in repair, but I don’t know why you’re running that, or the database, or destination.
Are you trying to skip right to trying to get SFTP to do what WebDAV couldn’t? If so, we can test that.

[gpatel-fr]

@dr8876

The SFTP connection is working.

yes, did you validate it using backendtester ? if it fails too, I’d begin to test the backend reliability in your place.

[ts678]

Yes, backendtester test on SFTP would be good. SFTP download and decrypt would be informative too. Situation sounds like SFTP is already in a Duplicati job without that, but we’re not told the details of that.

[dr8876]

Meaning I hit the “Test Connection” button and I got a success message.