How to interpret Test command results?

How-To
1

I ran the test command with all argument and output the log to a file, as the browser log displays a few lines only. The test ran for a few hours, however the end of the test doesn’t say anything like Backup verification completed, or No errors found. Instead the log file is full of statements like these…

2022-06-12 10:34:25 -05 - [Information-Duplicati.Library.Main.Controller-StartingOperation]: The operation Backup has started
2022-06-12 10:34:25 -05 - [Profiling-Timer.Begin-Duplicati.Library.Main.Controller-RunBackup]: Starting - Running Backup
2022-06-12 10:34:25 -05 - [Profiling-Timer.Finished-Duplicati.Library.Main.Controller-RunBackup]: Running Backup took 0:00:00:00.000
2022-06-12 10:35:14 -05 - [Information-Duplicati.Library.Main.Controller-StartingOperation]: The operation Backup has started

Could someone tell me how to interpret the log, and make sure that the backup is indeed error free. I use Restic for backup as well, and prints an output at the end of the test command, “No errors found.” This doesn’t seem to be the case with Duplicati however.

2

Welcome to the forum @high5five

My output in GUI Commandline for a test all of a small backup is below. You have no end status?
To me, “found no errors” is pretty clear, but it’s just a file test not a guarantee that everything is great.
The best proof that Restore works is to run a restore, but there are some fine points that go with that.

Running commandline entry
Finished!

            
  Listing remote folder ...
  Downloading file (646 bytes) ...
  Downloading file (610 bytes) ...
  Downloading file (694 bytes) ...
Examined 3 files and found no errors
Return code: 0
3

What logging options did you use?
I selected profiling, as per a few other posts (not verbose). My output is not like yours:

2022-06-12 10:38:51 -05 - [Profiling-Timer.Begin-Duplicati.Library.Main.BackendManager-RemoteOperationGet]: Starting - RemoteOperationGet
2022-06-12 10:38:51 -05 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-20220523T010001Z.dlist.zip.aes (28.87 MB)

The entire console-log file is full of lines like this. No such statement “found no errors.”

4

None at all. Default. I am, however, using the browser log. Command Prompt output is “wrapped” less:

  Listing remote folder ...
  Downloading file (646 bytes) ...
  Downloading file (610 bytes) ...
  Downloading file (694 bytes) ...
Examined 3 files and found no errors

C:\>

Usng –console-log-level=Information gets this:

The operation Test has started
Backend event: List - Started:  ()
  Listing remote folder ...
Backend event: List - Completed:  (3 bytes)
Backend event: Get - Started: duplicati-20220616T183926Z.dlist.zip (646 bytes)
  Downloading file (646 bytes) ...
Backend event: Get - Completed: duplicati-20220616T183926Z.dlist.zip (646 bytes)
Backend event: Get - Started: duplicati-i3de900a626344e8486b923c0301314ba.dindex.zip (610 bytes)
  Downloading file (610 bytes) ...
Backend event: Get - Completed: duplicati-i3de900a626344e8486b923c0301314ba.dindex.zip (610 bytes)
Backend event: Get - Started: duplicati-b3b997c2640954911998c5780451aa0a9.dblock.zip (694 bytes)
  Downloading file (694 bytes) ...
Backend event: Get - Completed: duplicati-b3b997c2640954911998c5780451aa0a9.dblock.zip (694 bytes)
Examined 3 files and found no errors

C:\>

What logging options did you use? It looks like a log-file not a redirected console. Format is different.
While it seems an odd omission that log-file output omits a conclusion, use some format with one.

If you have to use a format that requires interpretation, success is implied by lack of a failure like this.
This is --log-file with --log-file-log-level=Information after I manually extended a dblock.
You can see it doing retries before it finally gives up and declares that there is a problem with that file:

2022-06-16 16:57:17 -04 - [Information-Duplicati.Library.Main.Controller-StartingOperation]: The operation Test has started
2022-06-16 16:57:17 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started:  ()
2022-06-16 16:57:17 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed:  (3 bytes)
2022-06-16 16:57:18 -04 - [Warning-Duplicati.Library.Main.Operation.FilelistProcessor-MissingRemoteHash]: remote file duplicati-b3b997c2640954911998c5780451aa0a9.dblock.zip is listed as Verified with size 695 but should be 694, please verify the sha256 hash "RgHHPXeQvVWh5GvOFLiSGSmSxeN8p/jfmmkrUCTn7dI="
2022-06-16 16:57:18 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-20220616T183926Z.dlist.zip (646 bytes)
2022-06-16 16:57:18 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Completed: duplicati-20220616T183926Z.dlist.zip (646 bytes)
2022-06-16 16:57:18 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-i3de900a626344e8486b923c0301314ba.dindex.zip (610 bytes)
2022-06-16 16:57:18 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Completed: duplicati-i3de900a626344e8486b923c0301314ba.dindex.zip (610 bytes)
2022-06-16 16:57:18 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-b3b997c2640954911998c5780451aa0a9.dblock.zip (694 bytes)
2022-06-16 16:57:18 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Completed: duplicati-b3b997c2640954911998c5780451aa0a9.dblock.zip (695 bytes)
2022-06-16 16:57:18 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Retrying: duplicati-b3b997c2640954911998c5780451aa0a9.dblock.zip (694 bytes)
2022-06-16 16:57:28 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-b3b997c2640954911998c5780451aa0a9.dblock.zip (694 bytes)
2022-06-16 16:57:28 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Completed: duplicati-b3b997c2640954911998c5780451aa0a9.dblock.zip (695 bytes)
2022-06-16 16:57:28 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Retrying: duplicati-b3b997c2640954911998c5780451aa0a9.dblock.zip (694 bytes)
2022-06-16 16:57:38 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-b3b997c2640954911998c5780451aa0a9.dblock.zip (694 bytes)
2022-06-16 16:57:38 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Completed: duplicati-b3b997c2640954911998c5780451aa0a9.dblock.zip (695 bytes)
2022-06-16 16:57:38 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Retrying: duplicati-b3b997c2640954911998c5780451aa0a9.dblock.zip (694 bytes)
2022-06-16 16:57:48 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-b3b997c2640954911998c5780451aa0a9.dblock.zip (694 bytes)
2022-06-16 16:57:48 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Completed: duplicati-b3b997c2640954911998c5780451aa0a9.dblock.zip (695 bytes)
2022-06-16 16:57:48 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Retrying: duplicati-b3b997c2640954911998c5780451aa0a9.dblock.zip (694 bytes)
2022-06-16 16:57:59 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-b3b997c2640954911998c5780451aa0a9.dblock.zip (694 bytes)
2022-06-16 16:57:59 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Completed: duplicati-b3b997c2640954911998c5780451aa0a9.dblock.zip (695 bytes)
2022-06-16 16:57:59 -04 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Failed: duplicati-b3b997c2640954911998c5780451aa0a9.dblock.zip (694 bytes)
2022-06-16 16:57:59 -04 - [Error-Duplicati.Library.Main.AsyncDownloader-FailedToRetrieveFile]: Failed to retrieve file duplicati-b3b997c2640954911998c5780451aa0a9.dblock.zip
System.Exception: The file duplicati-b3b997c2640954911998c5780451aa0a9.dblock.zip was downloaded and had size 695 but the size was expected to be 694
   at Duplicati.Library.Main.BackendManager.FileEntryItem.Duplicati.Library.Main.BackendManager.IDownloadWaitHandle.Wait(String& hash, Int64& size)
   at Duplicati.Library.Main.AsyncDownloader.AsyncDownloaderEnumerator.MoveNext()
2022-06-16 16:57:59 -04 - [Error-Duplicati.Library.Main.Operation.TestHandler-RemoteFileProcessingFailed]: Failed to process file duplicati-b3b997c2640954911998c5780451aa0a9.dblock.zip
System.Exception: The file duplicati-b3b997c2640954911998c5780451aa0a9.dblock.zip was downloaded and had size 695 but the size was expected to be 694
   at Duplicati.Library.Main.AsyncDownloader.AsyncDownloaderEnumerator.AsyncDownloadedFile.get_TempFile()
   at Duplicati.Library.Main.Operation.TestHandler.DoRun(Int64 samples, LocalTestDatabase db, BackendManager backend)

EDIT:

It looked from source that above would set an exit code, and test with Command Prompt confirms that:

C:\>echo %ERRORLEVEL%
3

C:\>

3 seems a little low by current standards, but if it gets raised someday it will still be non-zero, so a clue.
One can also use full-result to add a little bit more information per file. Some selected lines for that are:

duplicati-20220616T183926Z.dlist.zip: No errors
duplicati-i3de900a626344e8486b923c0301314ba.dindex.zip: No errors
duplicati-b3b997c2640954911998c5780451aa0a9.dblock.zip: 1 errors

Above is from console output (which also does not declare “found no errors”), not --log-file logging.

5

Yes, I used the --log-file option, as the log that I was getting extended far beyond the page, and would eventually get overwritten by newer entries. I wanted to be able to view the entire log, so I chose --log-file. I used these settings, for the log-file, according to this post here:
https://forum.duplicati.com/t/how-to-test-verify-your-backups/3700

all
--full-remote-verification=true
--console-log-level=profiling
--console-log-filter=-*.Database.*

Edit:
I’m trying what you did, just left the default options. This is the output. Since the backup is large, its going to take a while to complete.

Downloading file (31.32 MB) ...
  Downloading file (31.32 MB) ...
  Downloading file (31.32 MB) ...
  Downloading file (31.32 MB) ...
  Downloading file (31.32 MB) ...
  Downloading file (31.32 MB) ...
  Downloading file (31.32 MB) ...
  Downloading file (31.32 MB) ...
  Downloading file (31.32 MB) ...
  1. If I navigate away from this page, how do I get back to it?
  2. I seem to have found another log, where I could find relevant information. From the same menu, where you select commandline, there’s an option show log. If I go to the log from here, I’m able to view the results of the test.
6

What page in which browser, terminal program, or editor (if using a file) allows this to happen?
Overwrite is even stranger. Most things will give a scroll bar, navigation, or automatically scroll.

In Command Prompt and Linux shells (what are you in?), you can redirect console to file with >
followed by the desired path to that file. You will then find the line you seek at the bottom of file,
unless some other issue arises first, in which case you will have to look to see which file broke.
Regardless, you should be able to see a return code and can set a desired --console-log-level.

7

This happens in the default page, the one that pops up when you execute the commandline command.
I’m running this in the browser, and not from the actual commandline.

8

Which browser? If you mean a literal popup window, I’ve never seen that.
My most recent test was in Microsoft Edge. Should be similar to Chrome.
Here are screenshots of top and bottom of page. It hit an issue in middle.

image

image
image1373×468 22.6 KB

I’m including the scrollbar on the right because I used it to scroll to the bottom of the rather long page.