Hi,
I’m under Windows10 Pro x64 21H2 with Duplicati beta 2.0.6.3_beta_2021-06-17.
I choose E:\Backups\MSI as my destination folder.
E:\ is my pCloud drive.
I have my backup in E:\Backups\MSI so it’s good but I also have 181 files *.aes in E:\ why ? Can I delete them ?
Hello and welcome. Was it possibly from an earlier test of Duplicati? What do the timestamps on those files tell you? (How long ago were they created?)
Hi and thanks
Unfortunatly no, same day and i saw them be created during the backup.
can you export the backup as command line and share it here (don’t use the option to export the secret stuff of course, you can alter the names that you would find too revealing but explain clearly what you changed to preserve your privacy, that is, if you replaced your name by xxx say so, etc…).
you mean the JSON file ?
in the JSON file :
"Backup": {
"ID": "1",
"Name": "Sauvegarde automatique",
"Description": "",
"Tags": [],
"TargetURL": "file://E:\\Backups\\MSI\\",
So it’s the good folder.
sorry my english isn’t good my main langage is french 
No, as in select the job, click Export, then As Command Line (‘comme ligne de commande’) then uncheck ‘export passwords’ (‘exporter les mots de passe’), then click the Export button. Then copy/paste the result here.
ok thanks I didn’t remember this command line setting when export
“C:\Program Files\Duplicati 2\Duplicati.CommandLine.exe” backup “file://E:\Backups\MSI\” “C:\User Manual\” “C:\Users\Breat.1password\” “C:\Users\Breat.config\” “C:\Users\Breat.DVDFab64\” “C:\Users\Breat.VirtualBox\” “C:\Users\Breat.vscode\” “C:\Users\Breat\AppData\” “D:\Breat\” --backup-name=“Sauvegarde automatique” --dbpath=“C:\Users\Breat\AppData\Local\Duplicati\USOQYZVMWA.sqlite” --encryption-module=aes --compression-module=zip --dblock-size=100MB --keep-time=1M --exclude-files-attributes=temporary --disable-module=console-password-input --exclude=“C:\Users\Breat\AppData\Local\Temporary Internet Files\” --exclude=“C:\Users\Breat\AppData\Local\Temp\” --exclude=“C:\Users\Breat\AppData\Roaming\Wire\” --exclude=“C:\Users\Breat\AppData\Roaming\Opera Software\” --exclude=“C:\Users\Breat\AppData\Roaming\Joplin\” --exclude=“C:\Users\Breat\AppData\Roaming\discord\” --exclude=“C:\Users\Breat\AppData\Local\Steam\” --exclude=“C:\Users\Breat\AppData\Roaming\1Password\” --exclude=“C:\Users\Breat\AppData\Local\ElevatedDiagnostics\” --exclude=“C:\Users\Breat\AppData\Local\Totem\” --exclude=“C:\Users\Breat\AppData\Local\Packages\” --exclude=“C:\Users\Breat\AppData\Local\Duplicati\” --exclude=“cache\” --exclude=“C:\Users\Breat\AppData\Local@joplinapp-desktop-updater\” --exclude=“C:\Users\Breat\AppData\Local\Adguard_Software_Ltd\” --exclude=“C:\Users\Breat\AppData\Local\Application Data\” --exclude=“C:\Users\Breat\AppData\Local\Apps\” --exclude=“C:\Users\Breat\AppData\Local\Ashampoo\” --exclude=“C:\Users\Breat\AppData\Local\AWSToolkit\” --exclude=“C:\Users\Breat\AppData\Local\Brother\” --exclude=“C:\Users\Breat\AppData\Local\cache\” --exclude=“C:\Users\Breat\AppData\Local\Comms\” --exclude=“C:\Users\Breat\AppData\Local\ConnectedDevicesPlatform\” --exclude=“C:\Users\Breat\AppData\Local\CrashDumps\” --exclude=“C:\Users\Breat\AppData\Local\D3DSCache\” --exclude=“C:\Users\Breat\AppData\Local\Deployment\” --exclude=“C:\Users\Breat\AppData\Local\Discord\” --exclude=“C:\Users\Breat\AppData\Local\EAConnect_microsoft\” --exclude=“C:\Users\Breat\AppData\Local\EADesktop\” --exclude=“C:\Users\Breat\AppData\Local\Electronic Arts\” --exclude=“C:\Users\Breat\AppData\Local\Epic Games\” --exclude=“C:\Users\Breat\AppData\Local\EpicGamesLauncher\” --exclude=“C:\Users\Breat\AppData\Local\GOG.com\” --exclude=“C:\Users\Breat\AppData\Local\Gtarcade\” --exclude=“C:\Users\Breat\AppData\Local\Historique\” --exclude=“C:\Users\Breat\AppData\Local\INetHistory\” --exclude=“C:\Users\Breat\AppData\Local\lector-updater\” --exclude=“C:\Users\Breat\AppData\Local\LineCall\” --exclude=“C:\Users\Breat\AppData\Local\LogiOptionsPlus\” --exclude=“C:\Users\Breat\AppData\Local\Logishrd\” --exclude=“C:\Users\Breat\AppData\Local\Microsoft\” --exclude=“C:\Users\Breat\AppData\Local\Microsoft Help\” --exclude=“C:\Users\Breat\AppData\Local\Micro-Star_International_\” --exclude=“C:\Users\Breat\AppData\Local\Mozilla\” --exclude=“C:\Users\Breat\AppData\Local\MSI\” --exclude=“C:\Users\Breat\AppData\Local\MSI_Remind_Manager\” --exclude=“C:\Users\Breat\AppData\Local\Mullvad VPN\” --exclude=“C:\Users\Breat\AppData\Local\NhNotifSys\” --exclude=“C:\Users\Breat\AppData\Local\Nuance\” --exclude=“C:\Users\Breat\AppData\Local\NVIDIA\” --exclude=“C:\Users\Breat\AppData\Local\NVIDIA Corporation\” --exclude=“C:\Users\Breat\AppData\Local\OneDrive\” --exclude=“C:\Users\Breat\AppData\Local\Opera Software\” --exclude=“C:\Users\Breat\AppData\Local\Origin\” --exclude=“C:\Users\Breat\AppData\Local\paint.net\” --exclude=“C:\Users\Breat\AppData\Local\pCloud\” --exclude=“C:\Users\Breat\AppData\Local\Paradox Interactive\” --exclude=“C:\Users\Breat\AppData\Local\PeerDistRepub\” --exclude=“C:\Users\Breat\AppData\Local\PlaceholderTileLogoFolder\” --exclude=“C:\Users\Breat\AppData\Local\Plex\” --exclude=“C:\Users\Breat\AppData\Local\Programs\” --exclude=“C:\Users\Breat\AppData\Local\Publishers\” --exclude=“C:\Users\Breat\AppData\Local\Sony Interactive Entertainment Inc\” --exclude=“C:\Users\Breat\AppData\Local\SquirrelTemp\” --exclude=“C:\Users\Breat\AppData\Local\ToastNotificationManagerCompat\” --exclude=“C:\Users\Breat\AppData\Local\unali-52018406\” --exclude=“C:\Users\Breat\AppData\Local\unali-52018531\” --exclude=“C:\Users\Breat\AppData\Local\unali-76437656\” --exclude=“C:\Users\Breat\AppData\Local\unali-76438281\” --exclude=“C:\Users\Breat\AppData\Local\Unity\” --exclude=“C:\Users\Breat\AppData\Local\UnrealEngine\” --exclude=“C:\Users\Breat\AppData\Local\UnrealEngineLauncher\” --exclude=“C:\Users\Breat\AppData\Local\VirtualStore\” --exclude=“C:\Users\Breat\AppData\Local\wire\” --exclude=“C:\Users\Breat\AppData\Local\IconCache.db” --exclude=“C:\Users\Breat\AppData\LocalLow\Brother\” --exclude=“C:\Users\Breat\AppData\LocalLow\Microsoft\” --exclude=“C:\Users\Breat\AppData\LocalLow\Mozilla\” --exclude=“C:\Users\Breat\AppData\LocalLow\Sun\” --exclude=“C:\Users\Breat\AppData\LocalLow\Unity\” --exclude=“C:\Users\Breat\AppData\Roaming\Adguard Software Ltd\” --exclude=“C:\Users\Breat\AppData\Roaming\Adobe\” --exclude=“C:\Users\Breat\AppData\Roaming\Brother\” --exclude=“C:\Users\Breat\AppData\Roaming\ConceptMatrix\” --exclude=“C:\Users\Breat\AppData\Roaming\InstallShield\” --exclude=“C:\Users\Breat\AppData\Roaming\logioptionsplus\” --exclude=“C:\Users\Breat\AppData\Roaming\Logishrd\” --exclude=“C:\Users\Breat\AppData\Roaming\Logitech\” --exclude=“C:\Users\Breat\AppData\Roaming\MediaInfo\” --exclude=“C:\Users\Breat\AppData\Roaming\Microsoft\” --exclude=“C:\Users\Breat\AppData\Roaming\Mozilla\” --exclude=“C:\Users\Breat\AppData\Roaming\NVIDIA\” --exclude=“C:\Users\Breat\AppData\Roaming\sp6_log\” --exclude=“C:\Users\Breat\AppData\Roaming\Sun\” --exclude=“C:\Users\Breat\AppData\Roaming\2457fe3357cbf1220231e8917326f70f”
Right, I don’t see anything wrong in your backup. Can you reproduce the problem, by exporting the job as json, change the backup name and the destination directory, say e:\backups\msi2, then import the json and try the new job, will it create a new set of files under e: \ ?
This is very odd. Topic said “Some files are in wrong folder”. Were others in the folder that you wanted?
Also make sure that names start with duplicati- and have dblock, dindex, or dlist. Latter has date.
You can also look in the Complete log of the job log from the time of the files to read “KnownFileCount”.
You can look in <job> → Show log → Remote and click on list near end of backup for exact file names which can be counted against KnownFileCount and compared against folders where they actually went.
Duplicati also checks the file listing before a backup. If pCloud list is combining two folders, be careful when making the combining worse, because a new test backup might break original. Would that be OK?
If you’re technical you could also install Process Monitor to see what requests are being made to pCloud.
@gpatel-fr
i already try this with deleting completly the backup job and reimport it and that do the same. 
@ts678
in E:\ i have 181 files like this : duplicati-XXXX.dblock.zip.aes
in E:\Backups\MSI I have 6994 files :
here the complete log of the 1st time I start this job and saw the problem (some days ago) :
{
“DeletedFiles”: 0,
“DeletedFolders”: 0,
“ModifiedFiles”: 0,
“ExaminedFiles”: 305121,
“OpenedFiles”: 305121,
“AddedFiles”: 305121,
“SizeOfModifiedFiles”: 0,
“SizeOfAddedFiles”: 417929414805,
“SizeOfExaminedFiles”: 417929414805,
“SizeOfOpenedFiles”: 417929414805,
“NotProcessedFiles”: 0,
“AddedFolders”: 24253,
“TooLargeFiles”: 0,
“FilesWithError”: 0,
“ModifiedFolders”: 0,
“ModifiedSymlinks”: 0,
“AddedSymlinks”: 0,
“DeletedSymlinks”: 0,
“PartialBackup”: false,
“Dryrun”: false,
“MainOperation”: “Backup”,
“CompactResults”: null,
“VacuumResults”: null,
“DeleteResults”: {
“DeletedSetsActualLength”: 0,
“DeletedSets”: [],
“Dryrun”: false,
“MainOperation”: “Delete”,
“CompactResults”: null,
“ParsedResult”: “Success”,
“Version”: “2.0.6.3 (2.0.6.3_beta_2021-06-17)”,
“EndTime”: “2022-11-08T17:03:51.2981925Z”,
“BeginTime”: “2022-11-08T17:03:11.1146197Z”,
“Duration”: “00:00:40.1835728”,
“MessagesActualLength”: 0,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: null,
“Warnings”: null,
“Errors”: null,
“BackendStatistics”: {
“RemoteCalls”: 6990,
“BytesUploaded”: 366312679221,
“BytesDownloaded”: 134354247,
“FilesUploaded”: 6985,
“FilesDownloaded”: 3,
“FilesDeleted”: 0,
“FoldersCreated”: 0,
“RetryAttempts”: 0,
“UnknownFileSize”: 0,
“UnknownFileCount”: 0,
“KnownFileCount”: 6985,
“KnownFileSize”: 366312679221,
“LastBackupDate”: “2022-11-08T01:08:04+01:00”,
“BackupListCount”: 1,
“TotalQuotaSpace”: 2199023255552,
“FreeQuotaSpace”: 1774637875200,
“AssignedQuotaSpace”: -1,
“ReportedQuotaError”: false,
“ReportedQuotaWarning”: false,
“MainOperation”: “Backup”,
“ParsedResult”: “Success”,
“Version”: “2.0.6.3 (2.0.6.3_beta_2021-06-17)”,
“EndTime”: “0001-01-01T00:00:00”,
“BeginTime”: “2022-11-08T00:08:04.6400761Z”,
“Duration”: “00:00:00”,
“MessagesActualLength”: 0,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: null,
“Warnings”: null,
“Errors”: null
}
},
“RepairResults”: null,
“TestResults”: {
“MainOperation”: “Test”,
“VerificationsActualLength”: 3,
“Verifications”: [
{
“Key”: “duplicati-20221108T000804Z.dlist.zip.aes”,
“Value”: []
},
{
“Key”: “duplicati-i5023b789000d416c8882c4eb683b5cae.dindex.zip.aes”,
“Value”: []
},
{
“Key”: “duplicati-b744c0e0c0064445ba2d24544b02071b7.dblock.zip.aes”,
“Value”: []
}
],
“ParsedResult”: “Success”,
“Version”: “2.0.6.3 (2.0.6.3_beta_2021-06-17)”,
“EndTime”: “2022-11-08T17:15:29.3829568Z”,
“BeginTime”: “2022-11-08T17:15:16.3593764Z”,
“Duration”: “00:00:13.0235804”,
“MessagesActualLength”: 0,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: null,
“Warnings”: null,
“Errors”: null,
“BackendStatistics”: {
“RemoteCalls”: 6990,
“BytesUploaded”: 366312679221,
“BytesDownloaded”: 134354247,
“FilesUploaded”: 6985,
“FilesDownloaded”: 3,
“FilesDeleted”: 0,
“FoldersCreated”: 0,
“RetryAttempts”: 0,
“UnknownFileSize”: 0,
“UnknownFileCount”: 0,
“KnownFileCount”: 6985,
“KnownFileSize”: 366312679221,
“LastBackupDate”: “2022-11-08T01:08:04+01:00”,
“BackupListCount”: 1,
“TotalQuotaSpace”: 2199023255552,
“FreeQuotaSpace”: 1774637875200,
“AssignedQuotaSpace”: -1,
“ReportedQuotaError”: false,
“ReportedQuotaWarning”: false,
“MainOperation”: “Backup”,
“ParsedResult”: “Success”,
“Version”: “2.0.6.3 (2.0.6.3_beta_2021-06-17)”,
“EndTime”: “0001-01-01T00:00:00”,
“BeginTime”: “2022-11-08T00:08:04.6400761Z”,
“Duration”: “00:00:00”,
“MessagesActualLength”: 0,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: null,
“Warnings”: null,
“Errors”: null
}
},
“ParsedResult”: “Success”,
“Version”: “2.0.6.3 (2.0.6.3_beta_2021-06-17)”,
“EndTime”: “2022-11-08T17:15:29.4064309Z”,
“BeginTime”: “2022-11-08T00:08:04.6400761Z”,
“Duration”: “17:07:24.7663548”,
“MessagesActualLength”: 13982,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: [
“2022-11-08 01:08:04 +01 - [Information-Duplicati.Library.Main.Controller-StartingOperation]: L’opération Backup a débuté”,
“2022-11-08 01:08:05 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started: ()”,
“2022-11-08 01:08:05 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed: ()”,
“2022-11-08 01:08:55 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-bf9dbde18e58a4c95b6115686ab4547a4.dblock.zip.aes (99,98 MB)”,
“2022-11-08 01:08:56 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-b000955e18a3c46c89b7b3f455e588403.dblock.zip.aes (99,97 MB)”,
“2022-11-08 01:08:57 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-bf9dbde18e58a4c95b6115686ab4547a4.dblock.zip.aes (99,98 MB)”,
“2022-11-08 01:08:57 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-b000955e18a3c46c89b7b3f455e588403.dblock.zip.aes (99,97 MB)”,
“2022-11-08 01:08:58 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-i2e404c67ac2842688499d3b124c32f24.dindex.zip.aes (148,17 KB)”,
“2022-11-08 01:08:58 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-i9cbacdd86bb546679111b742dc22fc18.dindex.zip.aes (225,33 KB)”,
“2022-11-08 01:08:58 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-bef8c65e3af5943d8b11c833c68e5402e.dblock.zip.aes (99,98 MB)”,
“2022-11-08 01:08:59 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-i9cbacdd86bb546679111b742dc22fc18.dindex.zip.aes (225,33 KB)”,
“2022-11-08 01:08:59 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-i2e404c67ac2842688499d3b124c32f24.dindex.zip.aes (148,17 KB)”,
“2022-11-08 01:08:59 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-bace6342957e44929b9d38fee3c1cf2c5.dblock.zip.aes (99,94 MB)”,
“2022-11-08 01:08:59 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-bef8c65e3af5943d8b11c833c68e5402e.dblock.zip.aes (99,98 MB)”,
“2022-11-08 01:09:00 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-b0f358713d7794d59be1e75e321440379.dblock.zip.aes (99,97 MB)”,
“2022-11-08 01:09:00 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-b605ca3747af947a08a60503388f0fe63.dblock.zip.aes (99,91 MB)”,
“2022-11-08 01:09:00 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-i551cfcb61e954adfa3b07f5c01f85a95.dindex.zip.aes (181,70 KB)”,
“2022-11-08 01:09:00 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-i551cfcb61e954adfa3b07f5c01f85a95.dindex.zip.aes (181,70 KB)”,
“2022-11-08 01:09:01 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-bace6342957e44929b9d38fee3c1cf2c5.dblock.zip.aes (99,94 MB)”,
“2022-11-08 01:09:01 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-b605ca3747af947a08a60503388f0fe63.dblock.zip.aes (99,91 MB)”
],
“Warnings”: [],
“Errors”: [],
“BackendStatistics”: {
“RemoteCalls”: 6990,
“BytesUploaded”: 366312679221,
“BytesDownloaded”: 134354247,
“FilesUploaded”: 6985,
“FilesDownloaded”: 3,
“FilesDeleted”: 0,
“FoldersCreated”: 0,
“RetryAttempts”: 0,
“UnknownFileSize”: 0,
“UnknownFileCount”: 0,
“KnownFileCount”: 6985,
“KnownFileSize”: 366312679221,
“LastBackupDate”: “2022-11-08T01:08:04+01:00”,
“BackupListCount”: 1,
“TotalQuotaSpace”: 2199023255552,
“FreeQuotaSpace”: 1774637875200,
“AssignedQuotaSpace”: -1,
“ReportedQuotaError”: false,
“ReportedQuotaWarning”: false,
“MainOperation”: “Backup”,
“ParsedResult”: “Success”,
“Version”: “2.0.6.3 (2.0.6.3_beta_2021-06-17)”,
“EndTime”: “0001-01-01T00:00:00”,
“BeginTime”: “2022-11-08T00:08:04.6400761Z”,
“Duration”: “00:00:00”,
“MessagesActualLength”: 0,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: null,
“Warnings”: null,
“Errors”: null
}
}
Have there been backups since? If you give me current folder stats, I can only compare to a matching log.
Here’s the maybe-apples-to-oranges comparison for this log.
“FilesUploaded”: 6985 and “KnownFileCount”: 6985 are expected file count, after this initial backup.
181 + 6994 is 7175 but extra files may be from new backups.
If you know when backups ran, you can sort each folder by date, and try to match its files counts with logs.
Or just match up current files with “KnownFileCount” from latest backup to at least pass that sanity check.
After that passes (and maybe even if it doesn’t), you can pick one of the E:\ dblock files and check list of initial backup to confirm it was seen by list after backup (described above). You can browser-search file.
Example:
Based on your report of no misplaced dlist files, search for that string in the same file listing. If any dlist exists, then the shocking conclusion might be that pCloud is somehow combining two folders for its listing. Do files actually exist on physical E: drive (synced with pCloud) or any other, or are they streamed directly?
I will get out of this discussion - I have missed completely a very important point because I did not read carefully the original post; I did read ‘E:’ and I missed the ‘Pcloud’ part, so I was believing that it was a local drive. Now that I have realized belatedly that it’s a software emulation of a local drive pointing to a clould server, I am not so shocked by strange things happening.
I’m going to disagree with the local forum master by saying that the Duplicati documentation should include a backend section, notably warning about the emulated drives - and possibly warning about the compatibility problems with S3
These emulated drives are very seductive until one realize the hidden complexity of this feature, and the very real possibility of bugs that can emerge with a particular use pattern - such as a backup software.
So backing up on an emulated local drive is usually all right if it’s a Windows computer hosting the network drive, or if it’s a Samba server managed by an experienced admin. In all other cases, using such a backend is taking unnecessary risks (reliability and even security) if more secure and stable solutions are available - such as WebDav for PCloud, the native Duplicati when it exists for other uses case such as Dropbox, or using sftp or ftp for a Nas or a Linux server.
That’s the current Storage Providers section.
Local folder or drive would be a good place for that. It already talks about SMB, but emulated drives are generally a risky approach. Short of naming names, I’m not sure how subtle things like “does it stream immediately rather than sync later?” can be explained. Sync-later leaves unknown remote for awhile…
What’s seemingly proposed here is to add what I might call “application” notes, beyond only reference.
The manual is a somewhat independent project whose maintainer has asked for pull requests like this:
Corrections/changes/additions may be submitted as a pull request at Github: GitHub - kees-z/DuplicatiDocs: Duplicati User's Manual
EDIT:
S3 Compatible documents
--s3-ext-signatureversion = 4Extended option SignatureVersion
but doesn’t say when one might want it, or how one might know. Choosing right options can be difficult.
As you also gave this a “possibly”, you might agree, but S3 is not alone in potential compatibility issues.
Possibly documenting ones that come up a lot is workable, but it’s probably more Manual author’s call.
Another one is when people copy files to Google Drive, Duplicati can’t see them by default. It surprises.
This sort of ties in with emulated drives because Google Drive has that as well as a programmatic API.
API by default uses a limited setting (Google may kill the full access) where Duplicati sees its own files.
@ts678
yes there are 3 more backups since the initial.
all 181 files in E:\ are with the date of the initial backup. (08/11/2022)
in E:\Backups\MSI I have :
I used duplicati canary with pcloud before and after seeing wasn’t a good idea i uninstalled duplicati canary delete all backups (files in pcloud and settings) and duplicati settings and install deplicati beta.
I havn’t this problem with canary version with pcloud.
if need i can give you logs of other run jobs 3 actually, next time is today at 13h (french time or gmt+1)
That makes the math line up better. The 6985 from first log match your age breakdown.
Current 6994 in MSI was 9 files higher, and those would be from the other two backups.
I’m thinking this suggests that ones in E:\ might be duplicates of 181 from the right spot.
You’re the only one who can look, and if you don’t want to use Duplicati as I had shown,
probably there is some other way such as the File Explorer search box for the file name.
If you want to do a larger scale comparison between folders, folder compare tools exist.
You would compare E:\ without subfolders against desired folder, which looks complete.
If limiting depth of the compare is hard, you could copy 181 files elsewhere for compare.
if i understand well my 181 files in E:\ should be in E:\Backups\MSI too ?
i just tryed to copy 1 file from E:\ to E:\Backups\MSI and that don’t ask to replace.
You got it backwards.
That was a theory of what went wrong. It’s not a “should”. We’re exploring theories.
Meaning you wound up copying, I guess? You might have just damaged the backup.
Because backup was happy before with 6994 files in right place, it won’t like extras.
You might be better off reverting that, maybe after studying Explorer Date created.
The experiment did, however, disprove the new theory which was duplicated names.
yes i know was a theorie.
i canceled the copy before the end to avoid break the backup, was just to see if i get the replace message.
discredits the idea that a retry happened, which causes Duplicati to try to upload again with new name.
Further experiments are unclear. Maybe it’s time to ask for a link to a database bug report to get a look.
Going along with that would be some sample names of the 181 files to study the history and relevance.
If wish to do more yourself, one safe method is to use Commandline to run The AFFECTED command.
Returns a report explaining what backup sets and files are affected by a remote file. You can use this option to see what source files are affected if one or more remote files are damaged or deleted.
This can be given names of dblock files, using lines in its Commandline arguments box. You can check activity by giving some files from intended folder (source files should be affected), then test mystery files.
If you’re willing to look in a copy of the database using a browser, that can get better info, with more work.
Another way to test if 181 files are relevant is to manually rename the database (because we might need database bug report later, depending on this test), move 181 files elsewhere, and see if database Repair button can recreate the database without warning and without going past 70% on its status bar progress.
The above test is good anyway. If disaster recovery is ever needed, database recreation needs to work…
Restoring files if your Duplicati installation is lost makes a partial temporary database, if that’s preferable.
Or one can add the job back and use the Repair button to rebuild a complete database, as this test does.
One drawback of just verifying files are not useful is that it leaves all the other open questions about them.
Great. I wasn’t certain how well that cleans up, but if you’re back to 6994 files, then interrupt did as desired.
I don’t really trust the repair button/function when i was under canary version this never works it’s why i’m on beta version now.
I just thinked about this, maybe it’s why i got this bug :
whe i changed the duplicati version, i deleted the job in duplicati and of course the check if the database of this job was deleted too here : C:\Users\Breat\AppData\Local\Duplicati but i NEVER deleted the Duplicati-server.sqlite file in this folder
so maybe will be good to delete job and all content of this folder and all backups files in E:\ / E:\Backup\MSI and create a new backup ?
