Duplicati seems to ignore dotted folders

Support
1

I’ve recently started my very first backup with duplicati 2.0.5.1 on openSUSE Linux 15.1.

It did run fine but I’m missing files!

First estimation of files did report something in the range of 67.000 files. After having finished, it does report:
{
“DeletedFiles”: 0,
“DeletedFolders”: 0,
“ModifiedFiles”: 0,
“ExaminedFiles”: 38441,
“OpenedFiles”: 38441,
“AddedFiles”: 38441,
“SizeOfModifiedFiles”: 0,

The largest part of this belongs to image folders that ALL have .xvpics folders with thumbnails in it. These seem NOT to be backed up. Why?

On a second run estimated amount of files does ignore them from the very beginning.

How to convince duplicati to include those .xvpics folders?

2

More Details:
I did select one file from the .xvpics folder for restoring, then renamed the file and started restore process. This is the result:

Zeit Beginn 2020-09-04 21:38:57 Ende 2020-09-04 21:39:46 Dauer 00:00:50
Quelldateien Geprüft 0 (0 bytes) Geöffnet 0 (0 bytes) Hinzugefügt 0 (0 bytes) Geändert 0 (0 bytes) Gelöscht 0
Dateien wiederhergestellt 0 (0 bytes) Ordner wiederhergestellt 0 Symbolische Verknüpfungen wiederhergestellt 0 Warnings 1

2020-09-04 21:39:46 +02 - [Warning-Duplicati.Library.Main.Operation.RestoreHandler-NoFilesRestored]: Restore completed without errors but no files were restored

Then I did repeat the same procedure with one of the picture files and the process finished successfully! :slight_smile:
Zeit Beginn 2020-09-04 21:46:37 Ende 2020-09-04 21:47:20 Dauer 00:00:43

Quelldateien Geprüft 0 (0 bytes) Geöffnet 0 (0 bytes) Hinzugefügt 0 (0 bytes) Geändert 0 (0 bytes) Gelöscht 0

Dateien wiederhergestellt 1 (634.81 KB) Ordner wiederhergestellt 0 Symbolische Verknüpfungen wiederhergestellt 0 Warnings 0 Errors 0

3

Although it doesn’t appear to fit your case, the typical way people get this is to restore when their restore area is already all set with the desired file in the desired version, therefore there’s not any action needed.

In the run below with some fake data, you can see About → Show log → Live → Verbose checking for desired file, not finding it, then actually doing a restore. The live log should be read from the bottom up…

Sep 7, 2020 9:58 AM: The operation Restore has completed
Sep 7, 2020 9:58 AM: Testing restored file integrity: C:\tmp\xvdir.xvsub\picture.jpg
Sep 7, 2020 9:58 AM: Patching metadata with remote data: C:\tmp\xvdir.xvsub\picture.jpg
Sep 7, 2020 9:58 AM: Patching metadata with remote data: C:\tmp\xvdir.xvsub
Sep 7, 2020 9:58 AM: Recording metadata from remote data: C:\tmp\xvdir.xvsub\picture.jpg
Sep 7, 2020 9:58 AM: Recording metadata from remote data: C:\tmp\xvdir.xvsub
Sep 7, 2020 9:58 AM: Patching file with remote data: C:\tmp\xvdir.xvsub\picture.jpg
Sep 7, 2020 9:58 AM: Backend event: Get - Completed: duplicati-b6901176f73984214985f8ca22f585a5c.dblock.zip.aes (1.93 KB)
Sep 7, 2020 9:58 AM: Backend event: Get - Started: duplicati-b6901176f73984214985f8ca22f585a5c.dblock.zip.aes (1.93 KB)
Sep 7, 2020 9:58 AM: 1 remote files are required to restore
Sep 7, 2020 9:58 AM: Target file does not exist: C:\tmp\xvdir.xvsub\picture.jpg
Sep 7, 2020 9:58 AM: Restore list contains 3 blocks with a total size of 281 bytes
Sep 7, 2020 9:58 AM: Needs to restore 1 files (5 bytes)
Sep 7, 2020 9:58 AM: Searching backup 0 (9/7/2020 12:36:43 PM) …
Sep 7, 2020 9:58 AM: Backend event: List - Completed: (6 bytes)
Sep 7, 2020 9:58 AM: Backend event: List - Started: ()
Sep 7, 2020 9:58 AM: The operation Restore has started

If I do it again, the second restore pops up the warning, and the live log looks like the below:

Sep 7, 2020 10:06 AM: The operation Restore has completed
Sep 7, 2020 10:06 AM: Restore completed without errors but no files were restored
Sep 7, 2020 10:06 AM: Patching metadata with remote data: C:\tmp\xvdir.xvsub\picture.jpg
Sep 7, 2020 10:06 AM: Patching metadata with remote data: C:\tmp\xvdir.xvsub
Sep 7, 2020 10:06 AM: Recording metadata from remote data: C:\tmp\xvdir.xvsub\picture.jpg
Sep 7, 2020 10:06 AM: Recording metadata from remote data: C:\tmp\xvdir.xvsub
Sep 7, 2020 10:06 AM: Backend event: Get - Completed: duplicati-b6901176f73984214985f8ca22f585a5c.dblock.zip.aes (1.93 KB)
Sep 7, 2020 10:06 AM: Backend event: Get - Started: duplicati-b6901176f73984214985f8ca22f585a5c.dblock.zip.aes (1.93 KB)
Sep 7, 2020 10:06 AM: 1 remote files are required to restore
Sep 7, 2020 10:06 AM: Target file exists and is correct version: C:\tmp\xvdir.xvsub\picture.jpg
Sep 7, 2020 10:06 AM: Restore list contains 3 blocks with a total size of 281 bytes
Sep 7, 2020 10:06 AM: Needs to restore 1 files (5 bytes)
Sep 7, 2020 10:06 AM: Searching backup 0 (9/7/2020 12:36:43 PM) …
Sep 7, 2020 10:06 AM: Backend event: List - Completed: (6 bytes)
Sep 7, 2020 10:06 AM: Backend event: List - Started: ()
Sep 7, 2020 10:06 AM: The operation Restore has started

Can you reproduce this with any folder that begins with a dot, consistently? Please supply logs.

4

Thank you. I was able several times to successfully restore files (including from .xvpics folders).
It remains unclear why it didn’t work the first time. Sorry …