Can not restore backup

1

I have backed up a folder about 40 GB my critical data but now Duplicati is not able to restore my backup, when restoring directly from files I encountered with complete log as below:

Feb 7, 2020 1:24 PM - Operation: Restore
Time
Start 2020-02-07 13:24:18
End 2020-02-07 13:24:54
Duration 00:00:37
Source Files
Examined 0 (0 bytes)
Opened 0 (0 bytes)
Added 0 (0 bytes)
Modified 0 (0 bytes)
Deleted 0
Restored Files 59 (0 bytes)
Restored Folders 1320
Restored Symlinks 0
Warnings 0
Errors 45144
2020-02-07 13:24:43 +03 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: “F:\restored_backup\Commadns Start Services.bat”. Error message was: Could not find file ‘\?\F:\restored_backup\Commadns Start Services.bat’.
2020-02-07 13:24:43 +03 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: “F:\restored_backup\Commadns Stop Services.bat”. Error message was: Could not find file ‘\?\F:\restored_backup\Commadns Stop Services.bat’.
2020-02-07 13:24:43 +03 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: “F:\restored_backup\Copies\Thumbs.db”. Error message was: Could not find file ‘\?\F:\restored_backup\Copies\Thumbs.db’.
2020-02-07 13:24:43 +03 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: “F:\restored_backup\Copies[136750_3_1].pdf”. Error message was: Could not find file ‘\?\F:\restored_backup\Copies[136750_3_1].pdf’.
2020-02-07 13:24:43 +03 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: “F:\restored_backup\Copies[1472_1_1].jpg”. Error message was: Could not find file ‘\?\F:\restored_backup\Copies[1472_1_1].jpg’.
2020-02-07 13:24:43 +03 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: “F:\restored_backup\Copies[16030_2_1].jpg”. Error message was: Could not find file ‘\?\F:\restored_backup\Copies[16030_2_1].jpg’.
2020-02-07 13:24:43 +03 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: “F:\restored_backup\Copies[16034_2_1].tif”. Error message was: Could not find file ‘\?\F:\restored_backup\Copies[16034_2_1].tif’.
2020-02-07 13:24:43 +03 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: “F:\restored_backup\Copies[1884_1_1].dwg”. Error message was: Could not find file ‘\?\F:\restored_backup\Copies[1884_1_1].dwg’.
2020-02-07 13:24:43 +03 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: “F:\restored_backup\Copies[1885_1_1].dwg”. Error message was: Could not find file ‘\?\F:\restored_backup\Copies[1885_1_1].dwg’.
2020-02-07 13:24:43 +03 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: “F:\restored_backup\Copies[2040_1_1].JPG”. Error message was: Could not find file ‘\?\F:\restored_backup\Copies[2040_1_1].JPG’.
2020-02-07 13:24:43 +03 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: “F:\restored_backup\Copies[277_3_1].jpg”. Error message was: Could not find file ‘\?\F:\restored_backup\Copies[277_3_1].jpg’.
2020-02-07 13:24:43 +03 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: “F:\restored_backup\Copies[2858_1_1].jpg”. Error message was: Could not find file ‘\?\F:\restored_backup\Copies[2858_1_1].jpg’.
2020-02-07 13:24:43 +03 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: “F:\restored_backup\Copies[3024_10_1].jpg”. Error message was: Could not find file ‘\?\F:\restored_backup\Copies[3024_10_1].jpg’.
2020-02-07 13:24:43 +03 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: “F:\restored_backup\Copies[4141_2_1].jpg”. Error message was: Could not find file ‘\?\F:\restored_backup\Copies[4141_2_1].jpg’.
2020-02-07 13:24:43 +03 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: “F:\restored_backup\Copies[4141_3_1].jpg”. Error message was: Could not find file ‘\?\F:\restored_backup\Copies[4141_3_1].jpg’.
2020-02-07 13:24:43 +03 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: “F:\restored_backup\Copies[4593_1_1].jpg”. Error message was: Could not find file ‘\?\F:\restored_backup\Copies[4593_1_1].jpg’.
2020-02-07 13:24:43 +03 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: “F:\restored_backup\Copies[4741_1_1].jpg”. Error message was: Could not find file ‘\?\F:\restored_backup\Copies[4741_1_1].jpg’.
2020-02-07 13:24:43 +03 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: “F:\restored_backup\Copies[4754_1_1].jpg”. Error message was: Could not find file ‘\?\F:\restored_backup\Copies[4754_1_1].jpg’.
2020-02-07 13:24:43 +03 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: “F:\restored_backup\Copies[4848_2_1].jpg”. Error message was: Could not find file ‘\?\F:\restored_backup\Copies[4848_2_1].jpg’.
2020-02-07 13:24:43 +03 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: “F:\restored_backup\Copies[4856_1_1].jpg”. Error message was: Could not find file ‘\?\F:\restored_backup\Copies[4856_1_1].jpg’.
Complete log
{
“RestoredFiles”: 59,
“SizeOfRestoredFiles”: 0,
“RestoredFolders”: 1320,
“RestoredSymlinks”: 0,
“PatchedFiles”: 0,
“DeletedFiles”: 0,
“DeletedFolders”: 0,
“DeletedSymlinks”: 0,
“MainOperation”: “Restore”,
“RecreateDatabaseResults”: null,
“ParsedResult”: “Error”,
“Version”: “2.0.6.3 (2.0.6.3_beta_2021-06-17)”,
“EndTime”: “2020-02-07T09:54:54.6414456Z”,
“BeginTime”: “2020-02-07T09:54:18.0350484Z”,
“Duration”: “00:00:36.6063972”,
“MessagesActualLength”: 5,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 45144,
“Messages”: [
“2020-02-07 13:24:18 +03 - [Information-Duplicati.Library.Main.Controller-StartingOperation]: The operation Restore has started”,
“2020-02-07 13:24:30 +03 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started: ()”,
“2020-02-07 13:24:30 +03 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed: (685 bytes)”,
“2020-02-07 13:24:30 +03 - [Information-Duplicati.Library.Main.Database.LocalRestoreDatabase-SearchingBackup]: Searching backup 0 (11/28/2021 1:00:00 AM) …”,
“2020-02-07 13:24:54 +03 - [Information-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFailures]: Failed to restore 45144 files”
],
“Warnings”: [],
“Errors”: [
“2020-02-07 13:24:43 +03 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: “F:\restored_backup\Commadns Start Services.bat”. Error message was: Could not find file ‘\\?\F:\restored_backup\Commadns Start Services.bat’.”,
“2020-02-07 13:24:43 +03 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: “F:\restored_backup\Commadns Stop Services.bat”. Error message was: Could not find file ‘\\?\F:\restored_backup\Commadns Stop Services.bat’.”,
“2020-02-07 13:24:43 +03 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: “F:\restored_backup\Copies\Thumbs.db”. Error message was: Could not find file ‘\\?\F:\restored_backup\Copies\Thumbs.db’.”,
“2020-02-07 13:24:43 +03 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: “F:\restored_backup\Copies\[136750_3_1].pdf”. Error message was: Could not find file ‘\\?\F:\restored_backup\Copies\[136750_3_1].pdf’.”,
“2020-02-07 13:24:43 +03 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: “F:\restored_backup\Copies\[1472_1_1].jpg”. Error message was: Could not find file ‘\\?\F:\restored_backup\Copies\[1472_1_1].jpg’.”,
“2020-02-07 13:24:43 +03 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: “F:\restored_backup\Copies\[16030_2_1].jpg”. Error message was: Could not find file ‘\\?\F:\restored_backup\Copies\[16030_2_1].jpg’.”,
“2020-02-07 13:24:43 +03 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: “F:\restored_backup\Copies\[16034_2_1].tif”. Error message was: Could not find file ‘\\?\F:\restored_backup\Copies\[16034_2_1].tif’.”,
“2020-02-07 13:24:43 +03 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: “F:\restored_backup\Copies\[1884_1_1].dwg”. Error message was: Could not find file ‘\\?\F:\restored_backup\Copies\[1884_1_1].dwg’.”,
“2020-02-07 13:24:43 +03 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: “F:\restored_backup\Copies\[1885_1_1].dwg”. Error message was: Could not find file ‘\\?\F:\restored_backup\Copies\[1885_1_1].dwg’.”,
“2020-02-07 13:24:43 +03 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: “F:\restored_backup\Copies\[2040_1_1].JPG”. Error message was: Could not find file ‘\\?\F:\restored_backup\Copies\[2040_1_1].JPG’.”,
“2020-02-07 13:24:43 +03 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: “F:\restored_backup\Copies\[277_3_1].jpg”. Error message was: Could not find file ‘\\?\F:\restored_backup\Copies\[277_3_1].jpg’.”,
“2020-02-07 13:24:43 +03 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: “F:\restored_backup\Copies\[2858_1_1].jpg”. Error message was: Could not find file ‘\\?\F:\restored_backup\Copies\[2858_1_1].jpg’.”,
“2020-02-07 13:24:43 +03 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: “F:\restored_backup\Copies\[3024_10_1].jpg”. Error message was: Could not find file ‘\\?\F:\restored_backup\Copies\[3024_10_1].jpg’.”,
“2020-02-07 13:24:43 +03 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: “F:\restored_backup\Copies\[4141_2_1].jpg”. Error message was: Could not find file ‘\\?\F:\restored_backup\Copies\[4141_2_1].jpg’.”,
“2020-02-07 13:24:43 +03 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: “F:\restored_backup\Copies\[4141_3_1].jpg”. Error message was: Could not find file ‘\\?\F:\restored_backup\Copies\[4141_3_1].jpg’.”,
“2020-02-07 13:24:43 +03 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: “F:\restored_backup\Copies\[4593_1_1].jpg”. Error message was: Could not find file ‘\\?\F:\restored_backup\Copies\[4593_1_1].jpg’.”,
“2020-02-07 13:24:43 +03 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: “F:\restored_backup\Copies\[4741_1_1].jpg”. Error message was: Could not find file ‘\\?\F:\restored_backup\Copies\[4741_1_1].jpg’.”,
“2020-02-07 13:24:43 +03 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: “F:\restored_backup\Copies\[4754_1_1].jpg”. Error message was: Could not find file ‘\\?\F:\restored_backup\Copies\[4754_1_1].jpg’.”,
“2020-02-07 13:24:43 +03 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: “F:\restored_backup\Copies\[4848_2_1].jpg”. Error message was: Could not find file ‘\\?\F:\restored_backup\Copies\[4848_2_1].jpg’.”,
“2020-02-07 13:24:43 +03 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-RestoreFileFailed]: Failed to restore file: “F:\restored_backup\Copies\[4856_1_1].jpg”. Error message was: Could not find file ‘\\?\F:\restored_backup\Copies\[4856_1_1].jpg’.”
],
“BackendStatistics”: {
“RemoteCalls”: 1,
“BytesUploaded”: 0,
“BytesDownloaded”: 0,
“FilesUploaded”: 0,
“FilesDownloaded”: 0,
“FilesDeleted”: 0,
“FoldersCreated”: 0,
“RetryAttempts”: 0,
“UnknownFileSize”: 0,
“UnknownFileCount”: 0,
“KnownFileCount”: 685,
“KnownFileSize”: 44782455962,
“LastBackupDate”: “2021-11-28T04:30:00+03:30”,
“BackupListCount”: 645,
“TotalQuotaSpace”: 913806716928,
“FreeQuotaSpace”: 464757256192,
“AssignedQuotaSpace”: -1,
“ReportedQuotaError”: false,
“ReportedQuotaWarning”: false,
“MainOperation”: “Restore”,
“ParsedResult”: “Success”,
“Version”: “2.0.6.3 (2.0.6.3_beta_2021-06-17)”,
“EndTime”: “0001-01-01T00:00:00”,
“BeginTime”: “2020-02-07T09:54:18.0350484Z”,
“Duration”: “00:00:00”,
“MessagesActualLength”: 0,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: null,
“Warnings”: null,
“Errors”: null
}
}

Any help appreciated so much.

2

Welcome to the forum @hmirheydari

Do you mean Restoring files if your Duplicati installation is lost and you picked

image

The output looks like copy-and-paste from Viewing the log files of a backup job.
This would typically mean you have a Duplicati and a job, and just did a restore.

Please clarify. Did you lose a system? What OS are original and replacement?
What does F: mean in terms of either computer. Is backup on a drive or what?

3

Hi ts678,
Thanks for your answer,
About 3 months ago, I have installed Duplicati on a Win Server 2016 to backup a local folder to another network share with address(\HYPERVISOR01\Backup\Segalsun_Backups\5.23\SegalsunData).
The source machine IP was 192.168.5.23 and the destination network shared folder located at a machine with IP 192.168.5.30. The source machine was a HyperV VM but the destination is a physical machine.
Unfortunately, I have deleted the source machine VM by mistake and now I have only the backup folder on destination.
After I lost my source machine, I have installed latest Duplicati on destination machine to restore my backup directly from backup files.
Now:
The source path is: F:\SegalsunData
The destination path is: F:\restored_backup

I tried to restore backup files but unfortunately after a long time that Duplicati worked, it only recovered the folder structure and no files were restored, finally I received the log sent in my previous post
As I am a Newbie to Duplicati and based on

I must have a backup project to generate a bug report but I have not any and I don’t know how to create a bug report, if you need any more information please inform me how to collect them.
Again thanks for your help, it is the only copy of my data in form of Duplicati backup and recovery of them is a must for me as I am personally responsible for the mistake.

Regards,
Hossein Mirheydari

4

hint it could have restored 59 empty files. These are a special case, and might be a clue for the problems because empty files don’t require any usage of data blocks from dblock files. Did you search for file:*?

Looking at the destination, you must have had a file with dlist in the name, or you wouldn’t see the paths. There should also be a lot of dblock and dindex files, with dblock default 50 MB unless you changed the Remote volume size. During restore, Duplicati reads the dblock files to obtain blocks it needs for restore.

How the restore process works

I wonder if a failure keeps the log around under certain conditions? Do you recall your interactions to get it?

I just tried forcing restore failure by direct restore to nonexistent drive letter. It simultaneously gave an error about that (red, at screen bottom – did you get any of these, or similar yellow popups?) and gave a screen:

Your files and folders have been restored successfully. even though (like yours) it’s not true…

You usually need a backup configured to see its logs, which is why I’m trying to figure out how you got logs.

I would suggest these checks:

Sanity check destination files, as mentioned above. Timewise, it’s often dblock and dindex files, then a dlist.
Recovering by using the Duplicati Recovery tool only needs dlist and dblock files. I don’t know how fast it is.

On destination system, see what’s at F:\SegalsunData. Duplicati restore will by default see if it can find any blocks there, because such blocks mean fewer have to be gotten from the actual backup files. If nothing is there then it’s some slowdown but not absurd. If the path is slow, hung, etc., this step could become worse.

no-local-blocks stops this optimization attempt if need be.

Check right-click → Properties → Security permissions in F:\restored_backup against the user Duplicati is. Probably this is fine, if you got the folder structure, unless NTFS has some way to let folders in but not files.

In what time? I suppose we could launch simultaneous methods, if system can handle it, to see which wins.

Unless it overloads due to size, RecoveryTool is most likely to succeed, but possibly with some file damage among recovered files because it forgives backup issues and keeps trying to recover whatever is available.

Ordinary restore has a lot of checks and consistency expectations even to build partial temporary database. Although restore itself doesn’t have a progress bar, I thought database build for it did. Did you see it moving?

One way to get a better look at the direct restore steps is to run them manually, with a dummy job creation, having the correct Destination screen path, encryption password, etc. but lacking source setup, schedules, previous Advanced options, etc. You could go to Options screen and add Advanced options, for example log-file=<path> and log-file-log-level=verbose might be a good starting level to see what any action is doing.

Going to Database screen will probably offer only Repair in blue. You can run that and watch progress bar, popup messages, etc., and when done, job should have a short, and you can look at your own verbose log.

About → Show log → Live → Verbose should also show progress during the Repair, for a temporary view.

If all that went without complaint, you should be able to do normal (not direct) restore, and see how it goes. Restoring file subsets is also easier once the permanent database is there. Maybe test a single file initially.

EDIT:

and if something went wrong, then at least you now might have a non-temporary database for a bug report.
I don’t think that’s possible with direct restore, but I didn’t think your logs were either, and you found some…