New duplicati install new backup missing files on S3 Minio

Support
1

Hi,
I’m running OMV with somes services with docker.

I want to backup my server i a choose duplicati , first i only backup few docker volumes for testing and upload to MEGA. It’s looks working.

Now, i want to backup all my OMV (Nextcloud , Jellyfin , media etc) only 200GO so I take my RPI and instal minio , it’s works fine , i can upload to bucket with duplicati.
my bucket : duplicati
inside i have folder : homelab

(this Issue is solved) First time the backup take very long time, very slow (6 cores +12G RAM full local 1G network) i fix this because i backup firefox container full , and the cache contains 700 000 files … If can help some one :wink:
You can check number of files in active directory with this

root@omvdocker-compose/firefox# for i in */ .*/ ; do     echo -n $i": " ;     (find "$i" -type f | wc -l) ; done
Downloads/: 6
ssl/: 2
.cache/: 765189
.config/: 19
.dbus/: 3
.local/: 6
.mozilla/: 305
.XDG/: 0

My issue : when the backup is finished , i have 263 files missing from storage.
But in bucket > duplicati/homelab , i have 260 files
Duplicati want to repair, i repair but instant error :
2024-09-08 13:15:17 +02 - [Error-Duplicati.Library.Main.Controller-FailedOperation]: L’opération Repair a échoué avec l’erreur : The backup storage destination is missing data files.

I check on the forum and i find to run backup with command --no-backend-verification and it’s worked but only for 3 files :cry:

When i try restart backup 260 files missing, ask to repair, repair tell me filles are missing so … i need help pleas.

Edit : when i try regenerate the database : No files were found at the remote location, perhaps the target url is incorrect?

But the connection with minio is ok i retry before and after

I think i found a bug : i select MinioSDK insteade of Amazon SDK for the S3 library, i save but when i come back to the edit backup it’s again Amazon SDK

Thank guys

2

Ok think problem with the connection only for reading , it’s strange

if i run curl -u myuser:mypassword http://192.168.1.28:9000/duplicati

<Error><Code>InvalidRequest</Code><Message>The authorization mechanism you have provided is not supported. Please use AWS4-HMAC-SHA256.</Message><Resource>/duplicati</Resource><RequestId>17F348E11525727E</RequestId><HostId>ididid</HostId></Error>

if i run curl http://192.168.1.28:9000/duplicati
It’s return the bucket

My bucket is RW public and enable anonymous but duplicati dont return the bucket and show “missing 260 files” → all files on the bucket (260)

Duplicati can write but i cant read … :hot_face:

Anyone use Minio as a S3 storage ?

Log when i try repair :hot_face: Duplicati.Library.Interface.UserInformationException: No files were found at the remote location, perhaps the target url is incorrect? at Duplicati.Library.Main.Operation.RecreateDatabaseHandler.DoRun (Duplicati.Library.Main.Database.LocalDatabase dbparent, System.Boolean updating, Duplicati.Library.Utility.IFilter filter, Duplicati.Library.Main.Operation.RecreateDatabaseHandler+NumberedFilterFilelistDelegate filelistfilter, Duplicati.Library.Main.Operation.RecreateDatabaseHandler+BlockVolumePostProcessor blockprocessor) [0x00132] in <9b99db820df3422db0aa96d4648dc7b1>:0 at Duplicati.Library.Main.Operation.RecreateDatabaseHandler.Run (System.String path, Duplicati.Library.Utility.IFilter filter, Duplicati.Library.Main.Operation.RecreateDatabaseHandler+NumberedFilterFilelistDelegate filelistfilter, Duplicati.Library.Main.Operation.RecreateDatabaseHandler+BlockVolumePostProcessor blockprocessor) [0x00037] in <9b99db820df3422db0aa96d4648dc7b1>:0 at Duplicati.Library.Main.Operation.RepairHandler.RunRepairLocal (Duplicati.Library.Utility.IFilter filter) [0x000ba] in <9b99db820df3422db0aa96d4648dc7b1>:0 at Duplicati.Library.Main.Operation.RepairHandler.Run (Duplicati.Library.Utility.IFilter filter) [0x00158] in <9b99db820df3422db0aa96d4648dc7b1>:0 at Duplicati.Library.Main.Controller+<>c__DisplayClass18_0.<Repair>b__0 (Duplicati.Library.Main.RepairResults result) [0x0001c] in <9b99db820df3422db0aa96d4648dc7b1>:0 at Duplicati.Library.Main.Controller.RunAction[T] (T result, System.String[]& paths, Duplicati.Library.Utility.IFilter& filter, System.Action1[T] method) [0x0036c] in <9b99db820df3422db0aa96d4648dc7b1>:0
at Duplicati.Library.Main.Controller.RunAction[T] (T result, Duplicati.Library.Utility.IFilter& filter, System.Action1[T] method) [0x00007] in <9b99db820df3422db0aa96d4648dc7b1>:0 at Duplicati.Library.Main.Controller.Repair (Duplicati.Library.Utility.IFilter filter) [0x0001a] in <9b99db820df3422db0aa96d4648dc7b1>:0 at Duplicati.Server.Runner.Run (Duplicati.Server.Runner+IRunnerData data, System.Boolean fromQueue) [0x003ad] in <17916a3bd21d425da6aeece2c5428e16>:0

3

solved after many hours , it’s stupid mistake (like many times ^^)
In config S3
folder patch :/homelab
change to :homelab and it’s works

I dont understand why it’s write fin but cant read if the path its the same