Error notifications

Support
1

Hello
New user here, on Kubuntu 19.04 running Duplicati 2.0.4.23_beta_2019-07-14

I am running a learning test with one file which I have successfully set up as an encrypted backup to an S3 bucket - and successfully restored.

but I get error message at each operation: WARNING on 3 files during backup (one for each .aes file); and ERROR 1 during restore
Duplicati%20notifications

I’d like to understand if I’ve done something wrong, or something in config which is failing, or something else?
maybe similar to the discussion here

Appreciate any guidance here
Many Thanks

Log output:

Backup log:

DeletedFiles: 0
DeletedFolders: 0
ModifiedFiles: 0
ExaminedFiles: 1
OpenedFiles: 0
AddedFiles: 0
SizeOfModifiedFiles: 0
SizeOfAddedFiles: 0
SizeOfExaminedFiles: 26321
SizeOfOpenedFiles: 0
NotProcessedFiles: 0
AddedFolders: 0
TooLargeFiles: 0
FilesWithError: 0
ModifiedFolders: 0
ModifiedSymlinks: 0
AddedSymlinks: 0
DeletedSymlinks: 0
PartialBackup: False
Dryrun: False
MainOperation: Backup
CompactResults: null
DeleteResults: null
RepairResults: null
TestResults:
    MainOperation: Test
    Verifications: [
        Key: duplicati-20190927T060448Z.dlist.zip.aes
        Value: [
            Key: Error
            Value: The operation is not valid for the object's storage class
        ],
        Key: duplicati-i0044a32a48f24fc9a9a50c66741ec03d.dindex.zip.aes
        Value: [
            Key: Error
            Value: The operation is not valid for the object's storage class
        ],
        Key: duplicati-be8ab781871394813a05d5984f0588e3c.dblock.zip.aes
        Value: [
            Key: Error
            Value: The operation is not valid for the object's storage class
        ]
    ]
    ParsedResult: Error
    Version: 2.0.4.23 (2.0.4.23_beta_2019-07-14)
    EndTime: 28/09/2019 13:02:01 (1569672121)
    BeginTime: 28/09/2019 13:00:00 (1569672000)
    Duration: 00:02:01.0351480
    Messages: [
        2019-09-28 13:00:00 +01 - [Information-Duplicati.Library.Main.Controller-StartingOperation]: The operation Backup has started,
        2019-09-28 13:00:00 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started:  (),
        2019-09-28 13:00:00 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed:  (4 bytes),
        2019-09-28 13:00:00 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started:  (),
        2019-09-28 13:00:00 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed:  (4 bytes),
...
    ]
    Warnings: []
    Errors: [
        2019-09-28 13:00:41 +01 - [Error-Duplicati.Library.Main.Operation.TestHandler-FailedToProcessFile]: Failed to process file duplicati-20190927T060448Z.dlist.zip.aes,
        2019-09-28 13:01:21 +01 - [Error-Duplicati.Library.Main.Operation.TestHandler-FailedToProcessFile]: Failed to process file duplicati-i0044a32a48f24fc9a9a50c66741ec03d.dindex.zip.aes,
        2019-09-28 13:02:01 +01 - [Error-Duplicati.Library.Main.Operation.TestHandler-FailedToProcessFile]: Failed to process file duplicati-be8ab781871394813a05d5984f0588e3c.dblock.zip.aes
    ]
    BackendStatistics:
        RemoteCalls: 17
        BytesUploaded: 0
        BytesDownloaded: 0
        FilesUploaded: 0
        FilesDownloaded: 0
        FilesDeleted: 0
        FoldersCreated: 0
        RetryAttempts: 12
        UnknownFileSize: 0
        UnknownFileCount: 1
        KnownFileCount: 3
        KnownFileSize: 29111
        LastBackupDate: 27/09/2019 07:04:48 (1569564288)
        BackupListCount: 1
        TotalQuotaSpace: 0
        FreeQuotaSpace: 0
        AssignedQuotaSpace: -1
        ReportedQuotaError: False
        ReportedQuotaWarning: False
        ParsedResult: Error
        Version: 2.0.4.23 (2.0.4.23_beta_2019-07-14)
        Messages: [
            2019-09-28 13:00:00 +01 - [Information-Duplicati.Library.Main.Controller-StartingOperation]: The operation Backup has started,
            2019-09-28 13:00:00 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started:  (),
            2019-09-28 13:00:00 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed:  (4 bytes),
            2019-09-28 13:00:00 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started:  (),
            2019-09-28 13:00:00 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed:  (4 bytes),
...
        ]
        Warnings: []
        Errors: [
            2019-09-28 13:00:41 +01 - [Error-Duplicati.Library.Main.Operation.TestHandler-FailedToProcessFile]: Failed to process file duplicati-20190927T060448Z.dlist.zip.aes,
            2019-09-28 13:01:21 +01 - [Error-Duplicati.Library.Main.Operation.TestHandler-FailedToProcessFile]: Failed to process file duplicati-i0044a32a48f24fc9a9a50c66741ec03d.dindex.zip.aes,
            2019-09-28 13:02:01 +01 - [Error-Duplicati.Library.Main.Operation.TestHandler-FailedToProcessFile]: Failed to process file duplicati-be8ab781871394813a05d5984f0588e3c.dblock.zip.aes
        ]
ParsedResult: Error
Version: 2.0.4.23 (2.0.4.23_beta_2019-07-14)
EndTime: 28/09/2019 13:02:01 (1569672121)
BeginTime: 28/09/2019 13:00:00 (1569672000)
Duration: 00:02:01.7362870
Messages: [
    2019-09-28 13:00:00 +01 - [Information-Duplicati.Library.Main.Controller-StartingOperation]: The operation Backup has started,
    2019-09-28 13:00:00 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started:  (),
    2019-09-28 13:00:00 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed:  (4 bytes),
    2019-09-28 13:00:00 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started:  (),
    2019-09-28 13:00:00 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed:  (4 bytes),
...
]
Warnings: []
Errors: [
    2019-09-28 13:00:41 +01 - [Error-Duplicati.Library.Main.Operation.TestHandler-FailedToProcessFile]: Failed to process file duplicati-20190927T060448Z.dlist.zip.aes,
    2019-09-28 13:01:21 +01 - [Error-Duplicati.Library.Main.Operation.TestHandler-FailedToProcessFile]: Failed to process file duplicati-i0044a32a48f24fc9a9a50c66741ec03d.dindex.zip.aes,
    2019-09-28 13:02:01 +01 - [Error-Duplicati.Library.Main.Operation.TestHandler-FailedToProcessFile]: Failed to process file duplicati-be8ab781871394813a05d5984f0588e3c.dblock.zip.aes
]

Restore log:

FilesRestored: 1
SizeOfRestoredFiles: 26321
FoldersRestored: 0
SymlinksRestored: 0
FilesPatched: 0
FilesDeleted: 0
FoldersDeleted: 0
SymlinksDeleted: 0
MainOperation: Restore
RecreateDatabaseResults: null
ParsedResult: Error
Version: 2.0.4.23 (2.0.4.23_beta_2019-07-14)
EndTime: 30/09/2019 10:00:30 (1569834030)
BeginTime: 30/09/2019 09:59:49 (1569833989)
Duration: 00:00:40.8101280
Messages: [
    2019-09-30 09:59:49 +01 - [Information-Duplicati.Library.Main.Controller-StartingOperation]: The operation Restore has started,
    2019-09-30 09:59:49 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started:  (),
    2019-09-30 09:59:49 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed:  (4 bytes),
    2019-09-30 09:59:49 +01 - [Information-Duplicati.Library.Main.Database.LocalRestoreDatabase-SearchingBackup]: Searching backup 0 (27/09/2019 06:04:48) ...,
    2019-09-30 09:59:49 +01 - [Information-Duplicati.Library.Main.Operation.RestoreHandler-RemoteFileCount]: 1 remote files are required to restore,
...
]
Warnings: []
Errors: [
    2019-09-30 10:00:30 +01 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-PatchingFailed]: Failed to patch with remote file: "duplicati-be8ab781871394813a05d5984f0588e3c.dblock.zip.aes", message: The operation is not valid for the object's storage class
]
BackendStatistics:
    RemoteCalls: 6
    BytesUploaded: 0
    BytesDownloaded: 0
    FilesUploaded: 0
    FilesDownloaded: 0
    FilesDeleted: 0
    FoldersCreated: 0
    RetryAttempts: 4
    UnknownFileSize: 0
    UnknownFileCount: 1
    KnownFileCount: 3
    KnownFileSize: 29111
    LastBackupDate: 27/09/2019 07:04:48 (1569564288)
    BackupListCount: 1
    TotalQuotaSpace: 0
    FreeQuotaSpace: 0
    AssignedQuotaSpace: -1
    ReportedQuotaError: False
    ReportedQuotaWarning: False
    ParsedResult: Error
    Version: 2.0.4.23 (2.0.4.23_beta_2019-07-14)
    Messages: [
        2019-09-30 09:59:49 +01 - [Information-Duplicati.Library.Main.Controller-StartingOperation]: The operation Restore has started,
        2019-09-30 09:59:49 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started:  (),
        2019-09-30 09:59:49 +01 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed:  (4 bytes),
        2019-09-30 09:59:49 +01 - [Information-Duplicati.Library.Main.Database.LocalRestoreDatabase-SearchingBackup]: Searching backup 0 (27/09/2019 06:04:48) ...,
        2019-09-30 09:59:49 +01 - [Information-Duplicati.Library.Main.Operation.RestoreHandler-RemoteFileCount]: 1 remote files are required to restore,
...
    ]
    Warnings: []
    Errors: [
        2019-09-30 10:00:30 +01 - [Error-Duplicati.Library.Main.Operation.RestoreHandler-PatchingFailed]: Failed to patch with remote file: "duplicati-be8ab781871394813a05d5984f0588e3c.dblock.zip.aes", message: The operation is not valid for the object's storage class
    ]
2

Welcome to the forum @Remsky

I’m not an S3 expert, but I’ll ask what storage class you configured when you set up your backup.
“The operation is not valid for the object’s storage class” comes up for Glacier, e.g. if I Google for

"The operation is not valid for the object's storage class" site:aws.amazon.com

the error will apparently happen if you don’t restore from Glacier before trying to download the file.

Your Duplicati BackendStatistics show way too many zero values in spite of many RetryAttempts.

Verifying backend files is GUI terminology for The TEST command which downloads and tests files, however your results showed zero successful downloads and errors on all three files being verified.

Restore results also got zero successful downloads but managed to restore probably due to the file existing on the disk, so blocks were taken from that for the restored file. Probably it’s even identical.

Setting Advanced option –no-local-blocks is good practice to make sure restore is from the remote.

If the Glacier guess is right, there are ways known to work better with Glacier, but it’s not really nice.