Hello @JonMikelV,
I’ve been trying to dig deeper to find the issues, but no luck. I think the communication is correct. I’ve tried it on different user, different locations, but all states that is working. But I’m not able to repair the missing files.
I’ve removed the whole backup, and tried again. I started with a partial backup (only 50% of my total files I want to backup), then there are not problems. So I’ve expanded the files to 80%, and then the same issues appears:
Found 6568 files that are missing from the remote storage, please run repair
So I was wondering what files where missing, so I tried the list-broken-files command. It took me a while to get the right command line, but I’ve ended with this commandline:
Duplicati.CommandLine.exe list-broken-files od4b://****-my.sharepoint.com:443/personal/****/Documents/Backups/Laptop****Backup --auth-username=**** --auth-password=**** --dbpath=C:\Users\****\AppData\Local\Duplicati\DMOGIOEBJY.sqlite --passphrase=**** --console-log-level=Profiling --log-file=c:/Test.txt
The responds is:
The operation ListBrokenFiles has started
Starting - Running ListBrokenFiles
Starting - ExecuteScalarInt64: INSERT INTO "Operation" ("Description", "Timestamp") VALUES (?, ?); SELECT last_insert_rowid();
ExecuteScalarInt64: INSERT INTO "Operation" ("Description", "Timestamp") VALUES (?, ?); SELECT last_insert_rowid(); took 0:00:00:00.015
Starting - ExecuteReader: SELECT "Key", "Value" FROM "Configuration"
ExecuteReader: SELECT "Key", "Value" FROM "Configuration" took 0:00:00:00.000
Starting - ExecuteReader: SELECT "ID", "Timestamp" FROM "Fileset" ORDER BY "Timestamp" DESC
ExecuteReader: SELECT "ID", "Timestamp" FROM "Fileset" ORDER BY "Timestamp" DESC took 0:00:00:00.000
Starting - ExecuteReader: SELECT DISTINCT "B"."Timestamp", "A"."FilesetID", COUNT("A"."FileID") AS "FileCount" FROM "FilesetEntry" A, "Fileset" B WHERE "A"."FilesetID" = "B"."ID" AND "A"."FileID" IN (
SELECT DISTINCT "ID" FROM (
SELECT "ID" AS "ID", "BlocksetID" AS "BlocksetID" FROM "File" WHERE "BlocksetID" != -100 AND "BlocksetID" != -200
UNION
SELECT "A"."ID" AS "ID", "B"."BlocksetID" AS "BlocksetID" FROM "File" A LEFT JOIN "Metadataset" B ON "A"."MetadataID" = "B"."ID"
)
WHERE "BlocksetID" IS NULL OR "BlocksetID" IN
(
SELECT DISTINCT "BlocksetID" FROM
(
SELECT "BlocksetID" FROM "BlocksetEntry" WHERE "BlockID" NOT IN
(SELECT "ID" FROM "Block" WHERE "VolumeID" IN
(SELECT "ID" FROM "RemoteVolume" WHERE "Type" = "Blocks"))
UNION
SELECT "BlocksetID" FROM "BlocklistHash" WHERE "Hash" NOT IN
(SELECT "Hash" FROM "Block" WHERE "VolumeID" IN
(SELECT "ID" FROM "RemoteVolume" WHERE "Type" = "Blocks"))
UNION
SELECT "A"."ID" AS "BlocksetID" FROM "Blockset" A LEFT JOIN "BlocksetEntry" B ON "A"."ID" = "B"."BlocksetID" WHERE "A"."Length" > 0 AND "B"."BlocksetID" IS NULL
)
WHERE "BlocksetID" NOT IN (SELECT "ID" FROM "Blockset" WHERE "Length" == 0)
)
) GROUP BY "A"."FilesetID"
ExecuteReader: SELECT DISTINCT "B"."Timestamp", "A"."FilesetID", COUNT("A"."FileID") AS "FileCount" FROM "FilesetEntry" A, "Fileset" B WHERE "A"."FilesetID" = "B"."ID" AND "A"."FileID" IN (
SELECT DISTINCT "ID" FROM (
SELECT "ID" AS "ID", "BlocksetID" AS "BlocksetID" FROM "File" WHERE "BlocksetID" != -100 AND "BlocksetID" != -200
UNION
SELECT "A"."ID" AS "ID", "B"."BlocksetID" AS "BlocksetID" FROM "File" A LEFT JOIN "Metadataset" B ON "A"."MetadataID" = "B"."ID"
)
WHERE "BlocksetID" IS NULL OR "BlocksetID" IN
(
SELECT DISTINCT "BlocksetID" FROM
(
SELECT "BlocksetID" FROM "BlocksetEntry" WHERE "BlockID" NOT IN
(SELECT "ID" FROM "Block" WHERE "VolumeID" IN
(SELECT "ID" FROM "RemoteVolume" WHERE "Type" = "Blocks"))
UNION
SELECT "BlocksetID" FROM "BlocklistHash" WHERE "Hash" NOT IN
(SELECT "Hash" FROM "Block" WHERE "VolumeID" IN
(SELECT "ID" FROM "RemoteVolume" WHERE "Type" = "Blocks"))
UNION
SELECT "A"."ID" AS "BlocksetID" FROM "Blockset" A LEFT JOIN "BlocksetEntry" B ON "A"."ID" = "B"."BlocksetID" WHERE "A"."Length" > 0 AND "B"."BlocksetID" IS NULL
)
WHERE "BlocksetID" NOT IN (SELECT "ID" FROM "Blockset" WHERE "Length" == 0)
)
) GROUP BY "A"."FilesetID" took 0:00:00:28.422
Starting - ExecuteReader: SELECT "Key", "Value" FROM "Configuration"
ExecuteReader: SELECT "Key", "Value" FROM "Configuration" took 0:00:00:00.000
No broken filesets found in database, checking for missing remote files
Starting - RemoteOperationList
Backend event: List - Started: ()
Listing remote folder ...
Backend event: List - Completed: ()
RemoteOperationList took 0:00:00:01.344
Starting - ExecuteReader: SELECT DISTINCT "Name", "State" FROM "Remotevolume" WHERE "Name" IN (SELECT "Name" FROM "Remotevolume" WHERE "State" IN ("Deleted", "Deleting")) AND NOT "State" IN ("Deleted", "Deleting")
ExecuteReader: SELECT DISTINCT "Name", "State" FROM "Remotevolume" WHERE "Name" IN (SELECT "Name" FROM "Remotevolume" WHERE "State" IN ("Deleted", "Deleting")) AND NOT "State" IN ("Deleted", "Deleting") took 0:00:00:00.000
Running ListBrokenFiles took 0:00:00:30.016
No remote volumes were found, refusing purge
So if I read the log-file correct: There are no missing files in the database, and also no missing files on the remote location?
So can you help me @JonMikelV (or others?)
