Keep getting file size difference warnings

Support
1

I keep getting these warnings about file size differences with every command.
Trying to repair:

~ » duplicati-cli repair /media/xxx                

Enter encryption passphrase: 
  Listing remote folder ...
remote file duplicati-b62e6e68803d44e0b84e7679813d61524.dblock.zip.aes is listed as Verified with size 15597568 but should be 52338573, please verify the sha256 hash "Cw2hEUVWDx+mxiew2XXSbDon5pD5uUjM/NW5t14z9Zs="
remote file duplicati-b2c511300d0cf448986de4d1e300e5e21.dblock.zip.aes is listed as Verified with size 6029312 but should be 52345517, please verify the sha256 hash "dZejNnWQTqdMbTUWvU6d5WFKoWzyjiuqxisyXaSMxxE="
remote file duplicati-be9e654a75614473180e6545d5a60fd1d.dblock.zip.aes is listed as Verified with size 6291456 but should be 52339165, please verify the sha256 hash "bhMOPwBuyEGpCURrRoETKXczPEy6+EE5Ed6HWcpUQzE="
  Downloading file duplicati-b62e6e68803d44e0b84e7679813d61524.dblock.zip.aes (unknown) ...
  Downloading file duplicati-b62e6e68803d44e0b84e7679813d61524.dblock.zip.aes (unknown) ...
  Downloading file duplicati-b62e6e68803d44e0b84e7679813d61524.dblock.zip.aes (unknown) ...
  Downloading file duplicati-b62e6e68803d44e0b84e7679813d61524.dblock.zip.aes (unknown) ...
  Downloading file duplicati-b62e6e68803d44e0b84e7679813d61524.dblock.zip.aes (unknown) ...
Failed to perform verification for file: duplicati-b62e6e68803d44e0b84e7679813d61524.dblock.zip.aes, please run verify; message: File length is invalid => File length is invalid
  Downloading file duplicati-b2c511300d0cf448986de4d1e300e5e21.dblock.zip.aes (unknown) ...
  Downloading file duplicati-b2c511300d0cf448986de4d1e300e5e21.dblock.zip.aes (unknown) ...
  Downloading file duplicati-b2c511300d0cf448986de4d1e300e5e21.dblock.zip.aes (unknown) ...
  Downloading file duplicati-b2c511300d0cf448986de4d1e300e5e21.dblock.zip.aes (unknown) ...
  Downloading file duplicati-b2c511300d0cf448986de4d1e300e5e21.dblock.zip.aes (unknown) ...
Failed to perform verification for file: duplicati-b2c511300d0cf448986de4d1e300e5e21.dblock.zip.aes, please run verify; message: File length is invalid => File length is invalid
  Downloading file duplicati-be9e654a75614473180e6545d5a60fd1d.dblock.zip.aes (unknown) ...
  Downloading file duplicati-be9e654a75614473180e6545d5a60fd1d.dblock.zip.aes (unknown) ...
  Downloading file duplicati-be9e654a75614473180e6545d5a60fd1d.dblock.zip.aes (unknown) ...
  Downloading file duplicati-be9e654a75614473180e6545d5a60fd1d.dblock.zip.aes (unknown) ...
  Downloading file duplicati-be9e654a75614473180e6545d5a60fd1d.dblock.zip.aes (unknown) ...
Failed to perform verification for file: duplicati-be9e654a75614473180e6545d5a60fd1d.dblock.zip.aes, please run verify; message: File length is invalid => File length is invalid
Update to Duplicati v2.1.0.2 detected, manual install required: https://duplicati.com/download

and trying to verify:

duplicati-cli verify /media/xxx

Enter encryption passphrase: 
  Listing remote folder ...
remote file duplicati-b62e6e68803d44e0b84e7679813d61524.dblock.zip.aes is listed as Verified with size 15597568 but should be 52338573, please verify the sha256 hash "Cw2hEUVWDx+mxiew2XXSbDon5pD5uUjM/NW5t14z9Zs="
remote file duplicati-b2c511300d0cf448986de4d1e300e5e21.dblock.zip.aes is listed as Verified with size 6029312 but should be 52345517, please verify the sha256 hash "dZejNnWQTqdMbTUWvU6d5WFKoWzyjiuqxisyXaSMxxE="
remote file duplicati-be9e654a75614473180e6545d5a60fd1d.dblock.zip.aes is listed as Verified with size 6291456 but should be 52339165, please verify the sha256 hash "bhMOPwBuyEGpCURrRoETKXczPEy6+EE5Ed6HWcpUQzE="
  Downloading file duplicati-20241013T080102Z.dlist.zip.aes (169.80 MB) ...
  Downloading file duplicati-iad97d24d7e704e7988ec9d36fa1b17b9.dindex.zip.aes (46.68 KB) ...
  Downloading file duplicati-bdb86710d68bb4371a89802aa6540f4a8.dblock.zip.aes (49.99 MB) ...
Examined 3 files and found no errors

And then trying to purge broken files, the same thing:

~ » duplicati-cli purge-broken-files /media/xxx

Enter encryption passphrase: 
  Listing remote folder ...
remote file duplicati-b62e6e68803d44e0b84e7679813d61524.dblock.zip.aes is listed as Verified with size 15597568 but should be 52338573, please verify the sha256 hash "Cw2hEUVWDx+mxiew2XXSbDon5pD5uUjM/NW5t14z9Zs="
remote file duplicati-b2c511300d0cf448986de4d1e300e5e21.dblock.zip.aes is listed as Verified with size 6029312 but should be 52345517, please verify the sha256 hash "dZejNnWQTqdMbTUWvU6d5WFKoWzyjiuqxisyXaSMxxE="
remote file duplicati-be9e654a75614473180e6545d5a60fd1d.dblock.zip.aes is listed as Verified with size 6291456 but should be 52339165, please verify the sha256 hash "bhMOPwBuyEGpCURrRoETKXczPEy6+EE5Ed6HWcpUQzE="
Update to Duplicati v2.1.0.2 detected, manual install required: https://duplicati.com/download
---

Nothing happens, the warning keeps appearing.
What can I do?

I have looked through various forum posts, tried my luck with ChatGPT, but the cases seem to be very different and I don’t really know how I can “fix” my backup so that it stays reliable.

My current version is 2.0.8.1_beta_2024-05-07 and I know there’s an update to 2.1 and I will do that asap, but I’m afraid it will complicate things even further.

Update: Tried to run a backup, getting two (new) missing files now (and same warnings about different file sizes appear again):

            {
  "DeletedFiles": 100214,
  "DeletedFolders": 11054,
  "ModifiedFiles": 16050,
  "ExaminedFiles": 2910050,
  "OpenedFiles": 2760732,
  "AddedFiles": 123448,
  "SizeOfModifiedFiles": 11032405845,
  "SizeOfAddedFiles": 19722326160,
  "SizeOfExaminedFiles": 172906986421,
  "SizeOfOpenedFiles": 160526963886,
  "NotProcessedFiles": 0,
  "AddedFolders": 10641,
  "TooLargeFiles": 0,
  "FilesWithError": 0,
  "ModifiedFolders": 0,
  "ModifiedSymlinks": 0,
  "AddedSymlinks": 384,
  "DeletedSymlinks": 397,
  "PartialBackup": false,
  "Dryrun": false,
  "MainOperation": "Backup",
  "CompactResults": {
    "DeletedFileCount": 6,
    "DownloadedFileCount": 0,
    "UploadedFileCount": 0,
    "DeletedFileSize": 157305630,
    "DownloadedFileSize": 0,
    "UploadedFileSize": 0,
    "Dryrun": false,
    "VacuumResults": null,
    "MainOperation": "Compact",
    "ParsedResult": "Success",
    "Interrupted": false,
    "Version": "2.0.8.1 (2.0.8.1_beta_2024-05-07)",
    "EndTime": "2025-05-11T10:31:47.54439Z",
    "BeginTime": "2025-05-11T10:30:21.985796Z",
    "Duration": "00:01:25.5585940",
    "MessagesActualLength": 0,
    "WarningsActualLength": 0,
    "ErrorsActualLength": 0,
    "Messages": null,
    "Warnings": null,
    "Errors": null,
    "BackendStatistics": {
      "RemoteCalls": 476,
      "BytesUploaded": 12303026259,
      "BytesDownloaded": 0,
      "FilesUploaded": 463,
      "FilesDownloaded": 0,
      "FilesDeleted": 8,
      "FoldersCreated": 0,
      "RetryAttempts": 3,
      "UnknownFileSize": 0,
      "UnknownFileCount": 0,
      "KnownFileCount": 8135,
      "KnownFileSize": 214211432708,
      "LastBackupDate": "2025-05-11T09:54:07+02:00",
      "BackupListCount": 13,
      "TotalQuotaSpace": 499981516800,
      "FreeQuotaSpace": 153309347840,
      "AssignedQuotaSpace": -1,
      "ReportedQuotaError": false,
      "ReportedQuotaWarning": false,
      "MainOperation": "Backup",
      "ParsedResult": "Success",
      "Interrupted": false,
      "Version": "2.0.8.1 (2.0.8.1_beta_2024-05-07)",
      "EndTime": "0001-01-01T00:00:00",
      "BeginTime": "2025-05-11T07:54:07.218525Z",
      "Duration": "00:00:00",
      "MessagesActualLength": 0,
      "WarningsActualLength": 0,
      "ErrorsActualLength": 0,
      "Messages": null,
      "Warnings": null,
      "Errors": null
    }
  },
  "VacuumResults": null,
  "DeleteResults": {
    "DeletedSetsActualLength": 2,
    "DeletedSets": [
      {
        "Item1": 4,
        "Item2": "2025-03-01T11:56:00+01:00"
      },
      {
        "Item1": 2,
        "Item2": "2025-03-10T12:00:00+01:00"
      }
    ],
    "Dryrun": false,
    "MainOperation": "Delete",
    "CompactResults": {
      "DeletedFileCount": 6,
      "DownloadedFileCount": 0,
      "UploadedFileCount": 0,
      "DeletedFileSize": 157305630,
      "DownloadedFileSize": 0,
      "UploadedFileSize": 0,
      "Dryrun": false,
      "VacuumResults": null,
      "MainOperation": "Compact",
      "ParsedResult": "Success",
      "Interrupted": false,
      "Version": "2.0.8.1 (2.0.8.1_beta_2024-05-07)",
      "EndTime": "2025-05-11T10:31:47.54439Z",
      "BeginTime": "2025-05-11T10:30:21.985796Z",
      "Duration": "00:01:25.5585940",
      "MessagesActualLength": 0,
      "WarningsActualLength": 0,
      "ErrorsActualLength": 0,
      "Messages": null,
      "Warnings": null,
      "Errors": null,
      "BackendStatistics": {
        "RemoteCalls": 476,
        "BytesUploaded": 12303026259,
        "BytesDownloaded": 0,
        "FilesUploaded": 463,
        "FilesDownloaded": 0,
        "FilesDeleted": 8,
        "FoldersCreated": 0,
        "RetryAttempts": 3,
        "UnknownFileSize": 0,
        "UnknownFileCount": 0,
        "KnownFileCount": 8135,
        "KnownFileSize": 214211432708,
        "LastBackupDate": "2025-05-11T09:54:07+02:00",
        "BackupListCount": 13,
        "TotalQuotaSpace": 499981516800,
        "FreeQuotaSpace": 153309347840,
        "AssignedQuotaSpace": -1,
        "ReportedQuotaError": false,
        "ReportedQuotaWarning": false,
        "MainOperation": "Backup",
        "ParsedResult": "Success",
        "Interrupted": false,
        "Version": "2.0.8.1 (2.0.8.1_beta_2024-05-07)",
        "EndTime": "0001-01-01T00:00:00",
        "BeginTime": "2025-05-11T07:54:07.218525Z",
        "Duration": "00:00:00",
        "MessagesActualLength": 0,
        "WarningsActualLength": 0,
        "ErrorsActualLength": 0,
        "Messages": null,
        "Warnings": null,
        "Errors": null
      }
    },
    "ParsedResult": "Success",
    "Interrupted": false,
    "Version": "2.0.8.1 (2.0.8.1_beta_2024-05-07)",
    "EndTime": "2025-05-11T10:31:47.544819Z",
    "BeginTime": "2025-05-11T10:27:41.163034Z",
    "Duration": "00:04:06.3817850",
    "MessagesActualLength": 0,
    "WarningsActualLength": 0,
    "ErrorsActualLength": 0,
    "Messages": null,
    "Warnings": null,
    "Errors": null,
    "BackendStatistics": {
      "RemoteCalls": 476,
      "BytesUploaded": 12303026259,
      "BytesDownloaded": 0,
      "FilesUploaded": 463,
      "FilesDownloaded": 0,
      "FilesDeleted": 8,
      "FoldersCreated": 0,
      "RetryAttempts": 3,
      "UnknownFileSize": 0,
      "UnknownFileCount": 0,
      "KnownFileCount": 8135,
      "KnownFileSize": 214211432708,
      "LastBackupDate": "2025-05-11T09:54:07+02:00",
      "BackupListCount": 13,
      "TotalQuotaSpace": 499981516800,
      "FreeQuotaSpace": 153309347840,
      "AssignedQuotaSpace": -1,
      "ReportedQuotaError": false,
      "ReportedQuotaWarning": false,
      "MainOperation": "Backup",
      "ParsedResult": "Success",
      "Interrupted": false,
      "Version": "2.0.8.1 (2.0.8.1_beta_2024-05-07)",
      "EndTime": "0001-01-01T00:00:00",
      "BeginTime": "2025-05-11T07:54:07.218525Z",
      "Duration": "00:00:00",
      "MessagesActualLength": 0,
      "WarningsActualLength": 0,
      "ErrorsActualLength": 0,
      "Messages": null,
      "Warnings": null,
      "Errors": null
    }
  },
  "RepairResults": null,
  "TestResults": null,
  "ParsedResult": "Fatal",
  "Interrupted": false,
  "Version": "2.0.8.1 (2.0.8.1_beta_2024-05-07)",
  "EndTime": "2025-05-11T10:32:17.996248Z",
  "BeginTime": "2025-05-11T07:54:07.218519Z",
  "Duration": "02:38:10.7777290",
  "MessagesActualLength": 976,
  "WarningsActualLength": 45,
  "ErrorsActualLength": 3,
  "Messages": [
    "2025-05-11 09:54:07 +02 - [Information-Duplicati.Library.Main.Controller-StartingOperation]: The operation Backup has started",
    "2025-05-11 10:03:02 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started:  ()",
    "2025-05-11 10:03:03 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed:  (7.50 KB)",
    "2025-05-11 10:06:21 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-b10c52cb639834b46bec8420ed022abe0.dblock.zip.aes (49.97 MB)",
    "2025-05-11 10:06:26 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-b10c52cb639834b46bec8420ed022abe0.dblock.zip.aes (49.97 MB)",
    "2025-05-11 10:06:26 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-ib8b55970291447a49db74776e97736cf.dindex.zip.aes (86.47 KB)",
    "2025-05-11 10:06:26 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-ib8b55970291447a49db74776e97736cf.dindex.zip.aes (86.47 KB)",
    "2025-05-11 10:06:32 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-b06c2338e239440d4af8048b809ad2ec3.dblock.zip.aes (49.93 MB)",
    "2025-05-11 10:06:32 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-b462e86b3224647248eddbd23b183e60a.dblock.zip.aes (49.93 MB)",
    "2025-05-11 10:06:34 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-b06c2338e239440d4af8048b809ad2ec3.dblock.zip.aes (49.93 MB)",
    "2025-05-11 10:06:36 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-b462e86b3224647248eddbd23b183e60a.dblock.zip.aes (49.93 MB)",
    "2025-05-11 10:06:36 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-i64c31d5c5e2e4ff3b75066c6805c2208.dindex.zip.aes (61.11 KB)",
    "2025-05-11 10:06:36 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-i64c31d5c5e2e4ff3b75066c6805c2208.dindex.zip.aes (61.11 KB)",
    "2025-05-11 10:06:36 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-i78e4db59b2f04f38a0e0fd9de84d0828.dindex.zip.aes (79.43 KB)",
    "2025-05-11 10:06:36 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-i78e4db59b2f04f38a0e0fd9de84d0828.dindex.zip.aes (79.43 KB)",
    "2025-05-11 10:06:37 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-b4b3bc1adba69460f8f03f4db55777bb0.dblock.zip.aes (49.91 MB)",
    "2025-05-11 10:06:38 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-b4b3bc1adba69460f8f03f4db55777bb0.dblock.zip.aes (49.91 MB)",
    "2025-05-11 10:06:38 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-ic8b58ab20dbf4e7e9d46b62292e59e3e.dindex.zip.aes (58.58 KB)",
    "2025-05-11 10:06:38 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-ic8b58ab20dbf4e7e9d46b62292e59e3e.dindex.zip.aes (58.58 KB)",
    "2025-05-11 10:08:42 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-b1578e45020cb4c2e9ef74daf25ae11a8.dblock.zip.aes (49.91 MB)"
  ],
  "Warnings": [
    "2025-05-11 10:03:03 +02 - [Warning-Duplicati.Library.Main.Operation.FilelistProcessor-MissingRemoteHash]: remote file duplicati-b62e6e68803d44e0b84e7679813d61524.dblock.zip.aes is listed as Verified with size 15597568 but should be 52338573, please verify the sha256 hash \"Cw2hEUVWDx+mxiew2XXSbDon5pD5uUjM/NW5t14z9Zs=\"",
    "2025-05-11 10:03:03 +02 - [Warning-Duplicati.Library.Main.Operation.FilelistProcessor-MissingRemoteHash]: remote file duplicati-b2c511300d0cf448986de4d1e300e5e21.dblock.zip.aes is listed as Verified with size 6029312 but should be 52345517, please verify the sha256 hash \"dZejNnWQTqdMbTUWvU6d5WFKoWzyjiuqxisyXaSMxxE=\"",
    "2025-05-11 10:03:03 +02 - [Warning-Duplicati.Library.Main.Operation.FilelistProcessor-MissingRemoteHash]: remote file duplicati-be9e654a75614473180e6545d5a60fd1d.dblock.zip.aes is listed as Verified with size 6291456 but should be 52339165, please verify the sha256 hash \"bhMOPwBuyEGpCURrRoETKXczPEy6+EE5Ed6HWcpUQzE=\"",
    "2025-05-11 10:03:16 +02 - [Warning-Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess-FileAccessError]: Error reported while accessing file: /home/ [ redacted for privacy]
  ],
  "Errors": [
    "2025-05-11 12:32:17 +02 - [Error-Duplicati.Library.Main.Operation.FilelistProcessor-MissingRemoteFiles]: Found 2 files that are missing from the remote storage, please run repair",
    "2025-05-11 12:32:17 +02 - [Error-Duplicati.Library.Main.Operation.BackupHandler-FatalError]: Fatal error\nRemoteListVerificationException: Found 2 files that are missing from the remote storage, please run repair",
    "2025-05-11 12:32:17 +02 - [Error-Duplicati.Library.Main.Controller-FailedOperation]: The operation Backup has failed with error: Found 2 files that are missing from the remote storage, please run repair\nRemoteListVerificationException: Found 2 files that are missing from the remote storage, please run repair"
  ],
  "BackendStatistics": {
    "RemoteCalls": 476,
    "BytesUploaded": 12303026259,
    "BytesDownloaded": 0,
    "FilesUploaded": 463,
    "FilesDownloaded": 0,
    "FilesDeleted": 8,
    "FoldersCreated": 0,
    "RetryAttempts": 3,
    "UnknownFileSize": 0,
    "UnknownFileCount": 0,
    "KnownFileCount": 8135,
    "KnownFileSize": 214211432708,
    "LastBackupDate": "2025-05-11T09:54:07+02:00",
    "BackupListCount": 13,
    "TotalQuotaSpace": 499981516800,
    "FreeQuotaSpace": 153309347840,
    "AssignedQuotaSpace": -1,
    "ReportedQuotaError": false,
    "ReportedQuotaWarning": false,
    "MainOperation": "Backup",
    "ParsedResult": "Success",
    "Interrupted": false,
    "Version": "2.0.8.1 (2.0.8.1_beta_2024-05-07)",
    "EndTime": "0001-01-01T00:00:00",
    "BeginTime": "2025-05-11T07:54:07.218525Z",
    "Duration": "00:00:00",
    "MessagesActualLength": 0,
    "WarningsActualLength": 0,
    "ErrorsActualLength": 0,
    "Messages": null,
    "Warnings": null,
    "Errors": null
  }
}

Running repair then gives this for both of the missing files:

{"ClassName":"Duplicati.Library.Interface.UserInformationException","Message":"Repair not possible, missing 3969 blocks.\nIf you want to continue working with the database, you can use the \"list-broken-files\" and \"purge-broken-files\" commands to purge the missing data from the database and the remote storage.","Data":null,"InnerException":null,"HelpURL":null,"StackTraceString":"  at Duplicati.Library.Main.Operation.RepairHandler.RunRepairRemote () [0x00ff1] in <9b99db820df3422db0aa96d4648dc7b1>:0 ","RemoteStackTraceString":null,"RemoteStackIndex":0,"ExceptionMethod":null,"HResult":-2146233088,"Source":"Duplicati.Library.Main"}

Once I purge them, I’m back to the different file size errors:

duplicati-cli repair /media/xxx

Enter encryption passphrase: 
  Listing remote folder ...
remote file duplicati-b62e6e68803d44e0b84e7679813d61524.dblock.zip.aes is listed as Verified with size 15597568 but should be 52338573, please verify the sha256 hash "Cw2hEUVWDx+mxiew2XXSbDon5pD5uUjM/NW5t14z9Zs="
remote file duplicati-b2c511300d0cf448986de4d1e300e5e21.dblock.zip.aes is listed as Verified with size 6029312 but should be 52345517, please verify the sha256 hash "dZejNnWQTqdMbTUWvU6d5WFKoWzyjiuqxisyXaSMxxE="
remote file duplicati-be9e654a75614473180e6545d5a60fd1d.dblock.zip.aes is listed as Verified with size 6291456 but should be 52339165, please verify the sha256 hash "bhMOPwBuyEGpCURrRoETKXczPEy6+EE5Ed6HWcpUQzE="
  Downloading file duplicati-b62e6e68803d44e0b84e7679813d61524.dblock.zip.aes (unknown) ...
  Downloading file duplicati-b62e6e68803d44e0b84e7679813d61524.dblock.zip.aes (unknown) ...
  Downloading file duplicati-b62e6e68803d44e0b84e7679813d61524.dblock.zip.aes (unknown) ...
  Downloading file duplicati-b62e6e68803d44e0b84e7679813d61524.dblock.zip.aes (unknown) ...
  Downloading file duplicati-b62e6e68803d44e0b84e7679813d61524.dblock.zip.aes (unknown) ...
Failed to perform verification for file: duplicati-b62e6e68803d44e0b84e7679813d61524.dblock.zip.aes, please run verify; message: File length is invalid => File length is invalid
  Downloading file duplicati-b2c511300d0cf448986de4d1e300e5e21.dblock.zip.aes (unknown) ...
  Downloading file duplicati-b2c511300d0cf448986de4d1e300e5e21.dblock.zip.aes (unknown) ...
  Downloading file duplicati-b2c511300d0cf448986de4d1e300e5e21.dblock.zip.aes (unknown) ...
  Downloading file duplicati-b2c511300d0cf448986de4d1e300e5e21.dblock.zip.aes (unknown) ...
  Downloading file duplicati-b2c511300d0cf448986de4d1e300e5e21.dblock.zip.aes (unknown) ...
Failed to perform verification for file: duplicati-b2c511300d0cf448986de4d1e300e5e21.dblock.zip.aes, please run verify; message: File length is invalid => File length is invalid
  Downloading file duplicati-be9e654a75614473180e6545d5a60fd1d.dblock.zip.aes (unknown) ...
  Downloading file duplicati-be9e654a75614473180e6545d5a60fd1d.dblock.zip.aes (unknown) ...
  Downloading file duplicati-be9e654a75614473180e6545d5a60fd1d.dblock.zip.aes (unknown) ...
  Downloading file duplicati-be9e654a75614473180e6545d5a60fd1d.dblock.zip.aes (unknown) ...
  Downloading file duplicati-be9e654a75614473180e6545d5a60fd1d.dblock.zip.aes (unknown) ...
Failed to perform verification for file: duplicati-be9e654a75614473180e6545d5a60fd1d.dblock.zip.aes, please run verify; message: File length is invalid => File length is invalid
Update to Duplicati v2.1.0.2 detected, manual install required: https://duplicati.com/download
2

Turns out after the final repair (that failed according to the logs), the backup now runs through. However, it still shows the warnings.
How can I get rid of them?

  "DeletedFiles": 1501,
  "DeletedFolders": 8,
  "ModifiedFiles": 1314,
  "ExaminedFiles": 2910817,
  "OpenedFiles": 9840,
  "AddedFiles": 8526,
  "SizeOfModifiedFiles": 6037176975,
  "SizeOfAddedFiles": 1690395350,
  "SizeOfExaminedFiles": 173149410658,
  "SizeOfOpenedFiles": 7733363578,
  "NotProcessedFiles": 0,
  "AddedFolders": 1191,
  "TooLargeFiles": 0,
  "FilesWithError": 0,
  "ModifiedFolders": 0,
  "ModifiedSymlinks": 0,
  "AddedSymlinks": 0,
  "DeletedSymlinks": 0,
  "PartialBackup": false,
  "Dryrun": false,
  "MainOperation": "Backup",
  "CompactResults": null,
  "VacuumResults": null,
  "DeleteResults": {
    "DeletedSetsActualLength": 0,
    "DeletedSets": [],
    "Dryrun": false,
    "MainOperation": "Delete",
    "CompactResults": null,
    "ParsedResult": "Success",
    "Interrupted": false,
    "Version": "2.0.8.1 (2.0.8.1_beta_2024-05-07)",
    "EndTime": "2025-05-11T15:27:00.861454Z",
    "BeginTime": "2025-05-11T15:25:43.885754Z",
    "Duration": "00:01:16.9757000",
    "MessagesActualLength": 0,
    "WarningsActualLength": 0,
    "ErrorsActualLength": 0,
    "Messages": null,
    "Warnings": null,
    "Errors": null,
    "BackendStatistics": {
      "RemoteCalls": 126,
      "BytesUploaded": 3316544693,
      "BytesDownloaded": 242547591,
      "FilesUploaded": 121,
      "FilesDownloaded": 3,
      "FilesDeleted": 0,
      "FoldersCreated": 0,
      "RetryAttempts": 0,
      "UnknownFileSize": 0,
      "UnknownFileCount": 0,
      "KnownFileCount": 8256,
      "KnownFileSize": 217527540713,
      "LastBackupDate": "2025-05-11T16:12:21+02:00",
      "BackupListCount": 14,
      "TotalQuotaSpace": 499981516800,
      "FreeQuotaSpace": 149991358464,
      "AssignedQuotaSpace": -1,
      "ReportedQuotaError": false,
      "ReportedQuotaWarning": false,
      "MainOperation": "Backup",
      "ParsedResult": "Success",
      "Interrupted": false,
      "Version": "2.0.8.1 (2.0.8.1_beta_2024-05-07)",
      "EndTime": "0001-01-01T00:00:00",
      "BeginTime": "2025-05-11T14:12:21.841234Z",
      "Duration": "00:00:00",
      "MessagesActualLength": 0,
      "WarningsActualLength": 0,
      "ErrorsActualLength": 0,
      "Messages": null,
      "Warnings": null,
      "Errors": null
    }
  },
  "RepairResults": null,
  "TestResults": {
    "MainOperation": "Test",
    "VerificationsActualLength": 3,
    "Verifications": [
      {
        "Key": "duplicati-20250511T141221Z.dlist.zip.aes",
        "Value": []
      },
      {
        "Key": "duplicati-iad19fdcad068479e8d23768e71a46b05.dindex.zip.aes",
        "Value": []
      },
      {
        "Key": "duplicati-b345e686821fb45858f9f2bf560b8bb18.dblock.zip.aes",
        "Value": []
      }
    ],
    "ParsedResult": "Success",
    "Interrupted": false,
    "Version": "2.0.8.1 (2.0.8.1_beta_2024-05-07)",
    "EndTime": "2025-05-11T15:27:05.134619Z",
    "BeginTime": "2025-05-11T15:27:02.31452Z",
    "Duration": "00:00:02.8200990",
    "MessagesActualLength": 0,
    "WarningsActualLength": 0,
    "ErrorsActualLength": 0,
    "Messages": null,
    "Warnings": null,
    "Errors": null,
    "BackendStatistics": {
      "RemoteCalls": 126,
      "BytesUploaded": 3316544693,
      "BytesDownloaded": 242547591,
      "FilesUploaded": 121,
      "FilesDownloaded": 3,
      "FilesDeleted": 0,
      "FoldersCreated": 0,
      "RetryAttempts": 0,
      "UnknownFileSize": 0,
      "UnknownFileCount": 0,
      "KnownFileCount": 8256,
      "KnownFileSize": 217527540713,
      "LastBackupDate": "2025-05-11T16:12:21+02:00",
      "BackupListCount": 14,
      "TotalQuotaSpace": 499981516800,
      "FreeQuotaSpace": 149991358464,
      "AssignedQuotaSpace": -1,
      "ReportedQuotaError": false,
      "ReportedQuotaWarning": false,
      "MainOperation": "Backup",
      "ParsedResult": "Success",
      "Interrupted": false,
      "Version": "2.0.8.1 (2.0.8.1_beta_2024-05-07)",
      "EndTime": "0001-01-01T00:00:00",
      "BeginTime": "2025-05-11T14:12:21.841234Z",
      "Duration": "00:00:00",
      "MessagesActualLength": 0,
      "WarningsActualLength": 0,
      "ErrorsActualLength": 0,
      "Messages": null,
      "Warnings": null,
      "Errors": null
    }
  },
  "ParsedResult": "Warning",
  "Interrupted": false,
  "Version": "2.0.8.1 (2.0.8.1_beta_2024-05-07)",
  "EndTime": "2025-05-11T15:27:05.147746Z",
  "BeginTime": "2025-05-11T14:12:21.841226Z",
  "Duration": "01:14:43.3065200",
  "MessagesActualLength": 260,
  "WarningsActualLength": 34,
  "ErrorsActualLength": 0,
  "Messages": [
    "2025-05-11 16:12:21 +02 - [Information-Duplicati.Library.Main.Controller-StartingOperation]: The operation Backup has started",
    "2025-05-11 16:20:42 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started:  ()",
    "2025-05-11 16:20:42 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed:  (7.94 KB)",
    "2025-05-11 16:26:57 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-ba3c6056d09154ac4ba66c65e269ff0a0.dblock.zip.aes (49.91 MB)",
    "2025-05-11 16:26:57 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-b195917f879a64fc9a81364f5bd87aeb9.dblock.zip.aes (49.93 MB)",
    "2025-05-11 16:27:02 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-ba3c6056d09154ac4ba66c65e269ff0a0.dblock.zip.aes (49.91 MB)",
    "2025-05-11 16:27:03 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-b195917f879a64fc9a81364f5bd87aeb9.dblock.zip.aes (49.93 MB)",
    "2025-05-11 16:27:03 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-ifdebb8269ebd448fa520d0c6cbb229e8.dindex.zip.aes (99.34 KB)",
    "2025-05-11 16:27:03 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-bfe3c2d9a4bc842f4868c4e9d5fda65e6.dblock.zip.aes (49.91 MB)",
    "2025-05-11 16:27:04 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-ifdebb8269ebd448fa520d0c6cbb229e8.dindex.zip.aes (99.34 KB)",
    "2025-05-11 16:27:04 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-i399362a0d64f4e2a9d459a0a5ef870ac.dindex.zip.aes (153.64 KB)",
    "2025-05-11 16:27:04 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-i399362a0d64f4e2a9d459a0a5ef870ac.dindex.zip.aes (153.64 KB)",
    "2025-05-11 16:27:04 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-bf9fefcf3f8c540bd9062d30827d284fb.dblock.zip.aes (49.93 MB)",
    "2025-05-11 16:27:05 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-bfe3c2d9a4bc842f4868c4e9d5fda65e6.dblock.zip.aes (49.91 MB)",
    "2025-05-11 16:27:06 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-bf9fefcf3f8c540bd9062d30827d284fb.dblock.zip.aes (49.93 MB)",
    "2025-05-11 16:27:06 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-i5f9918eb9c844deaac5bb591296f1074.dindex.zip.aes (48.54 KB)",
    "2025-05-11 16:27:06 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-i5f9918eb9c844deaac5bb591296f1074.dindex.zip.aes (48.54 KB)",
    "2025-05-11 16:27:06 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-id45ccca507af4f07b4a8c328a36c452e.dindex.zip.aes (56.15 KB)",
    "2025-05-11 16:27:06 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Completed: duplicati-id45ccca507af4f07b4a8c328a36c452e.dindex.zip.aes (56.15 KB)",
    "2025-05-11 16:27:43 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Put - Started: duplicati-bc12327f743564712b32b75ba3fb90756.dblock.zip.aes (49.95 MB)"
  ],
  "Warnings": [
    "2025-05-11 16:20:42 +02 - [Warning-Duplicati.Library.Main.Operation.FilelistProcessor-MissingRemoteHash]: remote file duplicati-b62e6e68803d44e0b84e7679813d61524.dblock.zip.aes is listed as Verified with size 15597568 but should be 52338573, please verify the sha256 hash \"Cw2hEUVWDx+mxiew2XXSbDon5pD5uUjM/NW5t14z9Zs=\"",
    "2025-05-11 16:20:42 +02 - [Warning-Duplicati.Library.Main.Operation.FilelistProcessor-MissingRemoteHash]: remote file duplicati-b2c511300d0cf448986de4d1e300e5e21.dblock.zip.aes is listed as Verified with size 6029312 but should be 52345517, please verify the sha256 hash \"dZejNnWQTqdMbTUWvU6d5WFKoWzyjiuqxisyXaSMxxE=\"",
    "2025-05-11 16:20:42 +02 - [Warning-Duplicati.Library.Main.Operation.FilelistProcessor-MissingRemoteHash]: remote file duplicati-be9e654a75614473180e6545d5a60fd1d.dblock.zip.aes is listed as Verified with size 6291456 but should be 52339165, please verify the sha256 hash \"bhMOPwBuyEGpCURrRoETKXczPEy6+EE5Ed6HWcpUQzE=\"",
    "2025-05-11 16:20:54 +02 - [ redacted for privacy
  ],
  "Errors": [],
  "BackendStatistics": {
    "RemoteCalls": 126,
    "BytesUploaded": 3316544693,
    "BytesDownloaded": 242547591,
    "FilesUploaded": 121,
    "FilesDownloaded": 3,
    "FilesDeleted": 0,
    "FoldersCreated": 0,
    "RetryAttempts": 0,
    "UnknownFileSize": 0,
    "UnknownFileCount": 0,
    "KnownFileCount": 8256,
    "KnownFileSize": 217527540713,
    "LastBackupDate": "2025-05-11T16:12:21+02:00",
    "BackupListCount": 14,
    "TotalQuotaSpace": 499981516800,
    "FreeQuotaSpace": 149991358464,
    "AssignedQuotaSpace": -1,
    "ReportedQuotaError": false,
    "ReportedQuotaWarning": false,
    "MainOperation": "Backup",
    "ParsedResult": "Success",
    "Interrupted": false,
    "Version": "2.0.8.1 (2.0.8.1_beta_2024-05-07)",
    "EndTime": "0001-01-01T00:00:00",
    "BeginTime": "2025-05-11T14:12:21.841234Z",
    "Duration": "00:00:00",
    "MessagesActualLength": 0,
    "WarningsActualLength": 0,
    "ErrorsActualLength": 0,
    "Messages": null,
    "Warnings": null,
    "Errors": null
  }
}
3

The warnings happen because Duplicati knows the size (and hash) of the file when it uploads it to the storage. Later, when listing the remote contents, it checks that the size has not changed, and if it has changed, something is wrong.

This one for instance seems fully broken. It should be ~50MiB but is instead ~15MB.
I think this will cause problems when trying to restore, because most of the file is missing.

From the commandline, it looks like it is something that is mounted locally, but I have not seen any disks behave like that, so most likely you are using some kind of remote storage that is mounted, and this does not work as it should.

Can you reveal what setup you are using?

4

I’m suspicious of filesystem or network protocol error when file size gets too binary-even.
You can try your own file listings to see what size you get. Duplicati sees small and even:

decimal         hexadecimal
15597568        EE0000
6029312         5C0000
6291456         600000

There has also been a case where reading a file seems to give different size than listed.
That could be another test, e.g. maybe with wc or dd or whatever way you can think of.
If the files are truly trashed, it would be nice to find the cause, but there’s a cleanup path.

1 Like
5

Thanks for your answers and sorry for the late reply. The setup is as follows: I’ve used a remote storage via network (I basically plugged in a USB drive to my Fritz router that supports some sort of NAS functionality).
The problems already started occuring when still using this, but after that, I switched to plugging the USB drive directly into my laptop (which would not solve the problems). The command line extracts are all from a setup where the drive is mounted locally (=plugged directly in).

Well, I’ve tried quite a lot of things and there doesn’t seem to be a solution. I keep getting errors.
It seems to me that I have to ditch the backup and start from scratch.
It’s a bummer for my file history though, but not sure whether I would use that anyway.
Or what else could I try?

6

Did you try using a terminal to list the files sizes? Did you try to copy from the USB disk to the local disk and check the file sizes?

To me it looks like something is feeding wrong sizes to Duplicati, and I don’t think this will be fixed by starting over.

7

Terminal: What would be the command for the file sizes?
Copying over to the local disk is not really an option, as I don’t have space for all these files. It’s about 200 GB or so and I only have a 500 GB SSD. Or do I just need to do that with bespoke files?

8

dir if you’re in a Command Prompt
Get-Item if you’re in PowerShell
You can also get sizes in Explorer, as the main question is whether size is genuinely off.

EDIT 1:

The size check and possible copy check should be aimed at files showing a size problem.
Presumably you have enough space to copy a file at a time somewhere to see the results.

9

I would just sample a few of the files. Check their reported size, copy them over and check the size is what was reported.

Specifically, pick the ones you listed in the log messages earlier.