Thousands of "Metadata was reported as not changed, but still requires being added?" warnings

[sylerner]

I am running Duplicati - 2.0.5.110_canary_2020-08-10 on openSUSE Leap 15.2.

I ran a backup after a database recreate (which had hundreds of "[Warning-Duplicati.Library.Main.Operation.RecreateDatabaseHandler-MissingBlockHash]: No block hash found for file: " warnings). The backup generated thousands of warnings.

What is the significance of these errors, and do I need to delete and recreate my entire backup to be safe after all the warnings from the recreate and backup?

Thanks.

Warnings 5503

2020-08-10 10:00:20 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-UnexpectedMetadataLookup]: Metadata was reported as not changed, but still requires being added? Hash: KDxt6p3WUmPR5DIhNMYH99kD7mXMY5rzo4QzQMNw5ZY=, Length: 199, ID: -1, Path: /home/sylerner/.muttrc
2020-08-10 10:00:20 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-UnexpectedMetadataLookup]: Metadata was reported as not changed, but still requires being added? Hash: FIcdfib7QsU669GgnbsuzEhQC7xKCyPSOPAAc2qWuDQ=, Length: 199, ID: -1, Path: /home/sylerner/.hunspell_en_US
2020-08-10 10:00:20 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-UnexpectedMetadataLookup]: Metadata was reported as not changed, but still requires being added? Hash: 0JyryQWh7U5RIq6sgFRQg7GeFgfC1FtA9jbQMfZLGbE=, Length: 199, ID: -1, Path: /home/sylerner/.xinitrc.template
2020-08-10 10:00:20 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-UnexpectedMetadataLookup]: Metadata was reported as not changed, but still requires being added? Hash: 7FtTyczve15OarEzGO2dz1/oaWin5MYIhmC5IzxYbH8=, Length: 199, ID: -1, Path: /home/sylerner/.esd_auth
2020-08-10 10:00:20 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-UnexpectedMetadataLookup]: Metadata was reported as not changed, but still requires being added? Hash: 06bD4G3yALj/+vUjQVoj8hqm1M8+DXoN1Tg5OrudcNg=, Length: 199, ID: -1, Path: /home/sylerner/.viminfo
2020-08-10 10:00:20 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-UnexpectedMetadataLookup]: Metadata was reported as not changed, but still requires being added? Hash: KDxt6p3WUmPR5DIhNMYH99kD7mXMY5rzo4QzQMNw5ZY=, Length: 199, ID: -1, Path: /home/sylerner/.inputrc
2020-08-10 10:00:20 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-UnexpectedMetadataLookup]: Metadata was reported as not changed, but still requires being added? Hash: Eep3Vz3JbN4/1zkR9hgPJgF1JyD3ccWtmgsEJO5/Vn4=, Length: 199, ID: -1, Path: /home/sylerner/.wget-hsts
2020-08-10 10:00:20 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-UnexpectedMetadataLookup]: Metadata was reported as not changed, but still requires being added? Hash: 28NgI5V2V9UFgNDSKU7+0E3I+H7mG1xRTnP6Y5YzpcQ=, Length: 199, ID: -1, Path: /home/sylerner/.y2log
2020-08-10 10:00:20 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-UnexpectedMetadataLookup]: Metadata was reported as not changed, but still requires being added? Hash: 8YHbd22QbD3C5qdwXOnVjtQrXk7vVVZIb4V/mDN2VAc=, Length: 199, ID: -1, Path: /home/sylerner/.bashrc
2020-08-10 10:00:20 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-UnexpectedMetadataLookup]: Metadata was reported as not changed, but still requires being added? Hash: MjQi4kX4wKIcC3wU7Q3r+Qa/fBTGYprwONBtbM6WCX8=, Length: 199, ID: -1, Path: /home/sylerner/.profile
2020-08-10 10:00:20 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-UnexpectedMetadataLookup]: Metadata was reported as not changed, but still requires being added? Hash: k6Oyrcg6I2KhDfYE++Xw8M18STs/mPIz+xGkwHJmaj8=, Length: 199, ID: -1, Path: /home/sylerner/.directory
2020-08-10 10:00:20 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-UnexpectedMetadataLookup]: Metadata was reported as not changed, but still requires being added? Hash: b8nkJlx8XDNFm4ntMAzchK1lgYnBzXOKWEJvCBMmDq0=, Length: 199, ID: -1, Path: /home/sylerner/NASdupes.txt
2020-08-10 10:00:21 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-UnexpectedMetadataLookup]: Metadata was reported as not changed, but still requires being added? Hash: TtXRNjEhZtcsNPiIRHcGsGYsh/qgXjmm5KUczZQMR0U=, Length: 199, ID: -1, Path: /home/sylerner/.joe_state
2020-08-10 10:00:21 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-UnexpectedMetadataLookup]: Metadata was reported as not changed, but still requires being added? Hash: KDxt6p3WUmPR5DIhNMYH99kD7mXMY5rzo4QzQMNw5ZY=, Length: 199, ID: -1, Path: /home/sylerner/.i18n
2020-08-10 10:00:21 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-UnexpectedMetadataLookup]: Metadata was reported as not changed, but still requires being added? Hash: KDxt6p3WUmPR5DIhNMYH99kD7mXMY5rzo4QzQMNw5ZY=, Length: 199, ID: -1, Path: /home/sylerner/.xim.template
2020-08-10 10:00:21 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-UnexpectedMetadataLookup]: Metadata was reported as not changed, but still requires being added? Hash: Ow6zGU+hq3Nc4Ht/TGb1jIYO7UeTz6nnNkDu4kuli2M=, Length: 199, ID: -1, Path: /home/sylerner/.y2usersettings
2020-08-10 10:00:21 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-UnexpectedMetadataLookup]: Metadata was reported as not changed, but still requires being added? Hash: KDxt6p3WUmPR5DIhNMYH99kD7mXMY5rzo4QzQMNw5ZY=, Length: 199, ID: -1, Path: /home/sylerner/.urlview
2020-08-10 10:00:21 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-UnexpectedMetadataLookup]: Metadata was reported as not changed, but still requires being added? Hash: KDxt6p3WUmPR5DIhNMYH99kD7mXMY5rzo4QzQMNw5ZY=, Length: 199, ID: -1, Path: /home/sylerner/.emacs
2020-08-10 10:00:21 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-UnexpectedMetadataLookup]: Metadata was reported as not changed, but still requires being added? Hash: KkmJ0tl4j0/HvaDHT6sfAyBUlWXelG0WVink7OAbNUA=, Length: 199, ID: -1, Path: /home/sylerner/.setprompt
2020-08-10 10:00:21 -04 - [Warning-Duplicati.Library.Main.Operation.Backup.FileBlockProcessor.FileEntry-UnexpectedMetadataLookup]: Metadata was reported as not changed, but still requires being added? Hash: jU/EMNoutvoO8Dq+QZ6TebfAPHZUO96Txm/8/UuuxVg=, Length: 199, ID: -1, Path: /home/sylerner/.y2control/control-02/README

[ts678]

What became of below experiments from last time you had the same problem? Nobody else is seeing it.

@sylerner

This had gone away for a while, but is back with a vengeance, possibly coinciding with my upgrade to 2.0.5.108_canary_2020-07-09

@sylerner

Also, where can I get a very of 2.0.5.107 canary at this point?

I’m also still looking for lines from a verbose log for one of the affected files, as shown here with example.

@sylerner

do I need to delete and recreate my entire backup

If you have some extra space, how about replicating it (in whole or in part) to see if fresh backup hits this?
If it does, it supports the version theory, although comparing code for 2.0.5.108 didn’t see obvious change.
EDIT: More accurately, it supports not doing the delete and recreate until the cause of the issue is located.

Metadata was reported as not changed, but still requires being added? was a 2018 regression caused by code change. This got a lot of debugging experiments. You can read them and see if they help your issue.

In case this is due to the options used, could you post a redacted version from Export As Command-line?