# Consistent Unexpected difference in fileset version

**URL:** https://forum.duplicati.com/t/consistent-unexpected-difference-in-fileset-version/7101
**Category:** Support
**Created:** [May 21, 2019, 8:45am UTC](https://forum.duplicati.com/t/consistent-unexpected-difference-in-fileset-version/7101 "2019-05-21T08:45:54Z")
**Posts on this page:** 18
**Page:** 2

<div class="post-metadata">

### Author: ![sanderson](https://forum.duplicati.com/letter_avatar_proxy/v4/letter/s/dfb087/32.png) [@sanderson](https://forum.duplicati.com/u/sanderson)
#### Post date: [July 1, 2019, 3:43am UTC](https://forum.duplicati.com/t/consistent-unexpected-difference-in-fileset-version/7101/21 "2019-07-01T03:43:18Z")

</div>

Thanks for confirming!

For what it’s worth I deleted a handful more versions trying the version reported, the one after, the one before with no real luck. I think I started with 40 versions and made it down to about 25 versions deleting them one at a time.

Finally it was telling me the missing entry was in version 20 of the 25 so I ran a delete with --keep-version=18 and that seems to have done the trick. Not sure that is really helpful to anyone else but it did finally work once I deleted enough versions.

---

<div class="post-metadata">

### Author: ![kenkendk](https://forum.duplicati.com/user_avatar/forum.duplicati.com/kenkendk/32/5305_2.png) [@kenkendk](https://forum.duplicati.com/u/kenkendk)
#### Post date: [July 1, 2019, 6:21am UTC](https://forum.duplicati.com/t/consistent-unexpected-difference-in-fileset-version/7101/22 "2019-07-01T06:21:12Z")

</div>

> [@ts678](#):
>
> If you want to get into manual database editing, coming up with a method might be a bit easier now that there’s a better understanding of one cause.

In my understanding, the block is removed from the database, even though it is in a volume. Fixing this would require re-reading t least the index file once the offending volume is known.

---

<div class="post-metadata">

### Author: ![Sami\_Lehtinen](https://forum.duplicati.com/user_avatar/forum.duplicati.com/sami_lehtinen/32/1779_2.png) [@Sami\_Lehtinen](https://forum.duplicati.com/u/Sami_Lehtinen)
#### Post date: [October 22, 2019, 5:02am UTC](https://forum.duplicati.com/t/consistent-unexpected-difference-in-fileset-version/7101/23 "2019-10-22T05:02:06Z")

</div>

> [@drwtsn32](#):
>
> That being said, you can “fix” this by just deleting the backup version that has the issue. It is faster than deleting/recreating the database.
> 
> So you could delete backup version 6 and then future backups should be fine (until it possibly happens again).

Thanks, this tip saved more than 1 terabyte of network traffic today. I also updated latest version, if it would have better protection against this.

---

<div class="post-metadata">

### Author: ![Jamie\_Leeke](https://forum.duplicati.com/user_avatar/forum.duplicati.com/jamie_leeke/32/4422_2.png) [@Jamie\_Leeke](https://forum.duplicati.com/u/Jamie_Leeke)
#### Post date: [May 12, 2020, 10:27am UTC](https://forum.duplicati.com/t/consistent-unexpected-difference-in-fileset-version/7101/24 "2020-05-12T10:27:19Z")

</div>

Hi,

I am having real trouble with this same error. Due to the notifications not working only just realised it hasn’t been backing up since 8th April, I’ve tried deleting and repairing but I keep getting the same outcome, any help will be most appreciated

Failed: Unexpected difference in fileset version 0: 08/04/2020 23:00:00 (database id: 187), found 1000145 entries, but expected 1000166  
Details: Duplicati.Library.Interface.UserInformationException: Unexpected difference in fileset version 0: 08/04/2020 23:00:00 (database id: 187), found 1000145 entries, but expected 1000166  
at Duplicati.Library.Main.Database.LocalDatabase.VerifyConsistency(Int64 blocksize, Int64 hashsize, Boolean verifyfilelists, IDbTransaction transaction)  
at Duplicati.Library.Main.Operation.TestHandler.Run(Int64 samples)  
at Duplicati.Library.Main.Controller.RunAction[T](T result, String& paths, IFilter& filter, Action`1 method)

---

<div class="post-metadata">

### Author: ![ts678](https://forum.duplicati.com/letter_avatar_proxy/v4/letter/t/8491ac/32.png) [@ts678](https://forum.duplicati.com/u/ts678)
#### Post date: [May 12, 2020, 6:21pm UTC](https://forum.duplicati.com/t/consistent-unexpected-difference-in-fileset-version/7101/25 "2020-05-12T18:21:09Z")

</div>

Welcome to the forum @Jamie_Leeke

> [@Jamie\_Leeke](#):
>
> I am having real trouble with this same error.

Are you running 2.0.5.1? It does hugely better.

---

<div class="post-metadata">

### Author: ![Jamie\_Leeke](https://forum.duplicati.com/user_avatar/forum.duplicati.com/jamie_leeke/32/4422_2.png) [@Jamie\_Leeke](https://forum.duplicati.com/u/Jamie_Leeke)
#### Post date: [May 13, 2020, 7:39am UTC](https://forum.duplicati.com/t/consistent-unexpected-difference-in-fileset-version/7101/26 "2020-05-13T07:39:51Z")

</div>

I upgraded to that yesterday but still got the same error. It’s currently recreating the database but with it being 3Tb it’s taking a while so hopefully it will complete once that’s done. If not I think I’m just going to try recreating the task and see if that works

---

<div class="post-metadata">

### Author: ![ts678](https://forum.duplicati.com/letter_avatar_proxy/v4/letter/t/8491ac/32.png) [@ts678](https://forum.duplicati.com/u/ts678)
#### Post date: [May 13, 2020, 12:25pm UTC](https://forum.duplicati.com/t/consistent-unexpected-difference-in-fileset-version/7101/27 "2020-05-13T12:25:17Z")

</div>

> [@Jamie\_Leeke](#):
>
> I upgraded to that yesterday but still got the same error.

The error is a DB consistency check before the backup runs, to avoid making a problem worse.  
2.0.5.1 has the same check, but if you can get a good DB, it’s much better at keeping it good…

---

<div class="post-metadata">

### Author: ![techcolin](https://forum.duplicati.com/letter_avatar_proxy/v4/letter/t/c5a1d2/32.png) [@techcolin](https://forum.duplicati.com/u/techcolin)
#### Post date: [May 13, 2020, 1:21pm UTC](https://forum.duplicati.com/t/consistent-unexpected-difference-in-fileset-version/7101/28 "2020-05-13T13:21:57Z")

</div>

The original server which I opened this ticket for hasn’t reported this issue since I upgraded to 2.0.5.1\_beta\_2020-01-18, so it appears the fix rolled out has worked in this instance (I’ve had to let it run for several weeks to be sure).

Sadly we had to abandon Duplicati on another server as the upgrade process left it in an unusable state. It lost DB integrity completely and we couldn’t manage or add to the existing backup set. We couldn’t recover from this position and had to go with another backup solution.

We need to be mindful that Duplicati is both free and in beta. That said, it’s been in beta for over two years now, and the rate of development (esp time to fix issues like this) will make the difference between this becoming a trusted product and one that isn’t going to make the grade. We simply can’t have consistency or integrity issues within a backup product.

I genuinely like where this is going, and wish the Duplicati team all the best moving things forward.

---

<div class="post-metadata">

### Author: ![Jamie\_Leeke](https://forum.duplicati.com/user_avatar/forum.duplicati.com/jamie_leeke/32/4422_2.png) [@Jamie\_Leeke](https://forum.duplicati.com/u/Jamie_Leeke)
#### Post date: [May 14, 2020, 8:22am UTC](https://forum.duplicati.com/t/consistent-unexpected-difference-in-fileset-version/7101/29 "2020-05-14T08:22:23Z")

</div>

Thank you, It’s still performing the database recreate but doesn’t look to have moved much since yesterday so I’ll give another couple of days and see if it moves. I realize with it being 3 Tb it will take a while.

---

<div class="post-metadata">

### Author: ![ts678](https://forum.duplicati.com/letter_avatar_proxy/v4/letter/t/8491ac/32.png) [@ts678](https://forum.duplicati.com/u/ts678)
#### Post date: [May 14, 2020, 12:11pm UTC](https://forum.duplicati.com/t/consistent-unexpected-difference-in-fileset-version/7101/30 "2020-05-14T12:11:55Z")

</div>

> [@Jamie\_Leeke](#):
>
> doesn’t look to have moved much since yesterday

Roughly where is it on the progress bar? The 70% to 100% range is three passes, and the last which is from 90% to 100% finishes a complete search of remote dblock files, if there is still missing information.

Viewing the live log at About → Show log → Live → Verbose will give you status info on how far it is…

Or possibly you’re not that far yet. The ideal for even a large backup is to download only the small [files](https://duplicati.readthedocs.io/en/latest/appendix-a-how-the-backup-process-works/), meaning only dlist (list of files in the backup), and dindex (index to the relatively large dblock data files).

One known slow spot even with ideal downloads is that the DB for a large backup can grow slow from having to track too many blocks. If you’re running at defaults, the [block size](https://duplicati.readthedocs.io/en/latest/06-advanced-options/#blocksize) is 100 KB, so 3 TB means about 3 million blocks’ info must be put in recreated DB. [Using larger block sizes](https://duplicati.readthedocs.io/en/latest/appendix-c-choosing-sizes-in-duplicati/#using-larger-block-sizes) in advance can help, however this can’t be changed on an existing backup, so that’s just a hint for any future large backups.

If recreate finishes and errors, please try to make a note of the error. At this speed, don’t want to rerun.

---

<div class="post-metadata">

### Author: ![Jamie\_Leeke](https://forum.duplicati.com/user_avatar/forum.duplicati.com/jamie_leeke/32/4422_2.png) [@Jamie\_Leeke](https://forum.duplicati.com/u/Jamie_Leeke)
#### Post date: [May 14, 2020, 2:52pm UTC](https://forum.duplicati.com/t/consistent-unexpected-difference-in-fileset-version/7101/31 "2020-05-14T14:52:02Z")

</div>

The bar is around 75% complete, I’ve looked at the log and it says the following:

14 May 2020 15:35: Backend event: Get - Completed: duplicati-b1567e0079fbf443a8d9ade8c344886a1.dblock.zip.aes (50.07 MB

What do you advise I do?

Thanks

---

<div class="post-metadata">

### Author: ![ts678](https://forum.duplicati.com/letter_avatar_proxy/v4/letter/t/8491ac/32.png) [@ts678](https://forum.duplicati.com/u/ts678)
#### Post date: [May 14, 2020, 6:05pm UTC](https://forum.duplicati.com/t/consistent-unexpected-difference-in-fileset-version/7101/32 "2020-05-14T18:05:28Z")

</div>

You should see more than one `Get - Completed`, for example next Get - Started should happen.  
Because you’re getting dblocks, you should also see status info like below but with bigger values:

- May 14, 2020 1:43 PM: Pass 2 of 3, processing blocklist volume 1 of 1

Especially if you get into Pass 3, the times seen should let you estimate the time of completion of downloading, however even when pass 3 finishes, it’s not guaranteed that Recreate will succeed.

Depending on upload/download speed, charges, and importance of keeping historical data, some Recreate runs that went all the way to the end before failing took longer than starting new backup.

What you do is somewhat up to you based on factors above. For my own backups, my B2 upload doesn’t cost me anything, whereas download might. I also try not to keep long-term historical files. Because of this, I don’t mind a restart on 2.0.5.1 (in fact I just did on a backup) because it’s better.  
Situations vary though, and I don’t know yours. First choice is to wait for a result or give it up early.  
Pass 3 is certainly capable of coming through, but for a large backup it’s a whole lot of downloads.

---

<div class="post-metadata">

### Author: ![Jamie\_Leeke](https://forum.duplicati.com/user_avatar/forum.duplicati.com/jamie_leeke/32/4422_2.png) [@Jamie\_Leeke](https://forum.duplicati.com/u/Jamie_Leeke)
#### Post date: [May 18, 2020, 7:53am UTC](https://forum.duplicati.com/t/consistent-unexpected-difference-in-fileset-version/7101/33 "2020-05-18T07:53:27Z")

</div>

Thank you, it was only on 142 of 1115 after running for 5 days or so and on pass 1 of 3 so I’ve decided to cancel it and set a new backup to run due to not having a backup for so long, this will still take a while but hopefully will work this time.

---

<div class="post-metadata">

### Author: ![Jamie\_Leeke](https://forum.duplicati.com/user_avatar/forum.duplicati.com/jamie_leeke/32/4422_2.png) [@Jamie\_Leeke](https://forum.duplicati.com/u/Jamie_Leeke)
#### Post date: [May 19, 2020, 7:03am UTC](https://forum.duplicati.com/t/consistent-unexpected-difference-in-fileset-version/7101/34 "2020-05-19T07:03:04Z")

</div>

Hi,

Sorry me again, the new backup started to run and then I got a similar error to the original backup, I had added it below, any ideas?

Failed: Unexpected difference in fileset version 1: 18/05/2020 08:56:28 (database id: 1), found 114574 entries, but expected 114917  
Details: Duplicati.Library.Interface.UserInformationException: Unexpected difference in fileset version 1: 18/05/2020 08:56:28 (database id: 1), found 114574 entries, but expected 114917  
at Duplicati.Library.Main.Database.LocalDatabase.VerifyConsistency(Int64 blocksize, Int64 hashsize, Boolean verifyfilelists, IDbTransaction transaction)  
at Duplicati.Library.Main.Operation.Backup.BackupDatabase.\<\>c\_\_DisplayClass34\_0.b\_\_0()  
at Duplicati.Library.Main.Operation.Common.SingleRunner.\<\>c\_\_DisplayClass3\_0.b\_\_0()  
at Duplicati.Library.Main.Operation.Common.SingleRunner.d\_\_2`1.MoveNext() --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) at Duplicati.Library.Main.Operation.BackupHandler.<RunAsync>d__20.MoveNext() --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() at CoCoL.ChannelExtensions.WaitForTaskOrThrow(Task task) at Duplicati.Library.Main.Controller.<>c__DisplayClass14_0.<Backup>b__0(BackupResults result) at Duplicati.Library.Main.Controller.RunAction[T](T result, String[]& paths, IFilter& filter, Action`1 method)

Log data:  
2020-05-18 23:02:06 +01 - [Error-Duplicati.Library.Main.Operation.BackupHandler-FatalError]: Fatal error  
Duplicati.Library.Interface.UserInformationException: Unexpected difference in fileset version 1: 18/05/2020 08:56:28 (database id: 1), found 114574 entries, but expected 114917  
at Duplicati.Library.Main.Database.LocalDatabase.VerifyConsistency(Int64 blocksize, Int64 hashsize, Boolean verifyfilelists, IDbTransaction transaction)  
at Duplicati.Library.Main.Operation.Backup.BackupDatabase.\<\>c\_\_DisplayClass34\_0.b\_\_0()  
at Duplicati.Library.Main.Operation.Common.SingleRunner.\<\>c\_\_DisplayClass3\_0.b\_\_0()  
at Duplicati.Library.Main.Operation.Common.SingleRunner.d\_\_2`1.MoveNext()  
— End of stack trace from previous location where exception was thrown —  
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()  
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)  
at Duplicati.Library.Main.Operation.BackupHandler.d\_\_20.MoveNext()

Thanks

---

<div class="post-metadata">

### Author: ![ts678](https://forum.duplicati.com/letter_avatar_proxy/v4/letter/t/8491ac/32.png) [@ts678](https://forum.duplicati.com/u/ts678)
#### Post date: [May 19, 2020, 12:42pm UTC](https://forum.duplicati.com/t/consistent-unexpected-difference-in-fileset-version/7101/35 "2020-05-19T12:42:51Z")

</div>

> [@Jamie\_Leeke](#):
>
> set a new backup to run

How was this done? The “Unexpected difference” is a local database error found in pre-backup check.  
[Database](https://duplicati.readthedocs.io/en/latest/03-using-the-graphical-user-interface/#database-management) `Delete` button deletes it. You manually delete remote files, assuming you want a fresh start.

If space and interest exist, and older versions could be of interest, the old file folder could perhaps be renamed (or Duplicati could be configured to use a different empty one), in case you ever want to use [Duplicati.CommandLine.RecoveryTool.exe](https://duplicati.readthedocs.io/en/latest/07-other-command-line-utilities/#duplicaticommandlinerecoverytoolexe) which is more tolerant about somewhat corrupted backups.

Fresh start is also a good chance to change [–blocksize](https://duplicati.readthedocs.io/en/latest/06-advanced-options/#blocksize) to something larger, especially if the Recreate seemed to be making the CPU or drive busy. It’s also possible, though, that your network was the limit.

> [@Jamie\_Leeke](#):
>
> due to not having a backup for so long, this will still take a while

If you can keep track of your source folder plan ([Commandline arguments](https://duplicati.readthedocs.io/en/latest/03-using-the-graphical-user-interface/#using-the-command-line-tools-from-within-the-graphical-user-interface) also offers a textual display), backing up your most important folders first would be good. That way you at least have that set in case backup is interrupted, or a disaster occurs. The above idea of keeping old backup awhile may help too.

> [@Jamie\_Leeke](#):
>
> the new backup started to run and then I got a similar error to the original backup

Please see earlier question about how new backup was done, and was this run the very first run done?

> [@Jamie\_Leeke](#):
>
> Log data:  
> 2020-05-18 23:02:06 +01 - [Error-Duplicati.Library.Main.Operation.BackupHandler-FatalError]: Fatal error  
> Duplicati.Library.Interface.UserInformationException: Unexpected difference in fileset version 1: 18/05/2020 08:56:28 (database id: 1), found 114574 entries, but expected 114917

The error time was at 23:02, complaining about a seemingly earlier backup at time 08:56 that managed to backup over a hundred thousand files before something went wrong. Sound likely? What happened?

---

<div class="post-metadata">

### Author: ![Jamie\_Leeke](https://forum.duplicati.com/user_avatar/forum.duplicati.com/jamie_leeke/32/4422_2.png) [@Jamie\_Leeke](https://forum.duplicati.com/u/Jamie_Leeke)
#### Post date: [May 19, 2020, 1:16pm UTC](https://forum.duplicati.com/t/consistent-unexpected-difference-in-fileset-version/7101/36 "2020-05-19T13:16:26Z")

</div>

I edited the old backup schedule and stopped it from automatically running but didn’t delete it as a job as I wanted the option to restore files if possible from it. I then set up a new job to a different folder and it looked to be running ok and did about 500 Gb and then errored, so I tried to run it again and get the error I sent over.

> [@ts678](#):
>
> the old file folder could perhaps be renamed (or Duplicati could be configured to use a different empty one)

When you say rename the folder, is that the local folder or the folder in Google Drive as I’ve created a new folder for the backup in Google Drive.

This is the first error I received yesterday:  
Failed: One or more errors occurred.  
Details: System.AggregateException: One or more errors occurred. —\> System.AggregateException: Could not find file ‘C:\Users\systemadmin\AppData\Local\Temp\2\dup-a6a85bb8-78b8-4c83-bfa2-3c8ca9a5c069’. —\> System.IO.FileNotFoundException: Could not find file ‘C:\Users\systemadmin\AppData\Local\Temp\2\dup-a6a85bb8-78b8-4c83-bfa2-3c8ca9a5c069’.  
at [System.IO](http://System.IO).\_\_Error.WinIOError(Int32 errorCode, String maybeFullPath)  
at System.IO.FileStream.Init(String path, FileMode mode, FileAccess access, Int32 rights, Boolean useRights, FileShare share, Int32 bufferSize, FileOptions options, SECURITY\_ATTRIBUTES secAttrs, String msgPath, Boolean bFromProxy, Boolean useLongPath, Boolean checkHost)  
at System.IO.FileStream…ctor(String path, FileMode mode, FileAccess access, FileShare share)  
at Duplicati.Library.Main.Operation.Backup.SpillCollectorProcess.\<\>c\_\_DisplayClass0\_0.\<b\_\_0\>d.MoveNext()  
— End of stack trace from previous location where exception was thrown —  
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()  
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)  
at CoCoL.AutomationExtensions.d\_\_10`1.MoveNext() --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) at Duplicati.Library.Main.Operation.BackupHandler.<RunMainOperation>d__13.MoveNext() --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) at Duplicati.Library.Main.Operation.BackupHandler.<RunAsync>d__20.MoveNext() --- End of inner exception stack trace --- at Duplicati.Library.Main.Operation.BackupHandler.<RunAsync>d__20.MoveNext() --- End of inner exception stack trace --- at CoCoL.ChannelExtensions.WaitForTaskOrThrow(Task task) at Duplicati.Library.Main.Controller.<>c__DisplayClass14_0.<Backup>b__0(BackupResults result) at Duplicati.Library.Main.Controller.RunAction[T](T result, String[]& paths, IFilter& filter, Action`1 method)  
—\> (Inner Exception #0) System.AggregateException: Could not find file ‘C:\Users\systemadmin\AppData\Local\Temp\2\dup-a6a85bb8-78b8-4c83-bfa2-3c8ca9a5c069’. —\> System.IO.FileNotFoundException: Could not find file ‘C:\Users\systemadmin\AppData\Local\Temp\2\dup-a6a85bb8-78b8-4c83-bfa2-3c8ca9a5c069’.  
at [System.IO](http://System.IO).\_\_Error.WinIOError(Int32 errorCode, String maybeFullPath)  
at System.IO.FileStream.Init(String path, FileMode mode, FileAccess access, Int32 rights, Boolean useRights, FileShare share, Int32 bufferSize, FileOptions options, SECURITY\_ATTRIBUTES secAttrs, String msgPath, Boolean bFromProxy, Boolean useLongPath, Boolean checkHost)  
at System.IO.FileStream…ctor(String path, FileMode mode, FileAccess access, FileShare share)  
at Duplicati.Library.Main.Operation.Backup.SpillCollectorProcess.\<\>c\_\_DisplayClass0\_0.\<b\_\_0\>d.MoveNext()  
— End of stack trace from previous location where exception was thrown —  
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()  
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)  
at CoCoL.AutomationExtensions.d\_\_10`1.MoveNext() --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) at Duplicati.Library.Main.Operation.BackupHandler.<RunMainOperation>d__13.MoveNext() --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) at Duplicati.Library.Main.Operation.BackupHandler.<RunAsync>d__20.MoveNext() --- End of inner exception stack trace --- at Duplicati.Library.Main.Operation.BackupHandler.<RunAsync>d__20.MoveNext() ---> (Inner Exception #0) System.IO.FileNotFoundException: Could not find file 'C:\Users\systemadmin\AppData\Local\Temp\2\dup-a6a85bb8-78b8-4c83-bfa2-3c8ca9a5c069'. File name: 'C:\Users\systemadmin\AppData\Local\Temp\2\dup-a6a85bb8-78b8-4c83-bfa2-3c8ca9a5c069' at System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath) at System.IO.FileStream.Init(String path, FileMode mode, FileAccess access, Int32 rights, Boolean useRights, FileShare share, Int32 bufferSize, FileOptions options, SECURITY_ATTRIBUTES secAttrs, String msgPath, Boolean bFromProxy, Boolean useLongPath, Boolean checkHost) at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access, FileShare share) at Duplicati.Library.Main.Operation.Backup.SpillCollectorProcess.<>c __DisplayClass0_0.<<Run>b__ 0>d.MoveNext() --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) at CoCoL.AutomationExtensions.<RunTask>d__10`1.MoveNext()  
— End of stack trace from previous location where exception was thrown —  
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()  
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)  
at Duplicati.Library.Main.Operation.BackupHandler.d\_\_13.MoveNext()  
— End of stack trace from previous location where exception was thrown —  
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()  
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)  
at Duplicati.Library.Main.Operation.BackupHandler.d\_\_20.MoveNext()\<—

—\> (Inner Exception #1) System.AggregateException: One or more errors occurred. —\> System.Net.WebException: The remote server returned an error: (403) Forbidden.  
at Duplicati.Library.Utility.AsyncHttpRequest.AsyncWrapper.GetResponseOrStream()  
at Duplicati.Library.Utility.AsyncHttpRequest.GetResponse()  
at Duplicati.Library.JSONWebHelper.GetResponse(AsyncHttpRequest req, Object requestdata)  
at Duplicati.Library.JSONWebHelper.ReadJSONResponse[T](AsyncHttpRequest req, Object requestdata)  
at Duplicati.Library.Backend.GoogleDrive.GoogleDrive.d\_\_42.MoveNext()  
at Duplicati.Library.Backend.GoogleDrive.GoogleDrive.d\_\_17.MoveNext()  
at Duplicati.Library.Backend.GoogleDrive.GoogleDrive.d\_\_15.MoveNext()  
— End of stack trace from previous location where exception was thrown —  
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()  
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)  
at Duplicati.Library.Main.Operation.Backup.BackendUploader.d\_\_21.MoveNext()  
— End of stack trace from previous location where exception was thrown —  
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()  
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)  
at Duplicati.Library.Main.Operation.Backup.BackendUploader.\<\>c\_\_DisplayClass17\_0.\<b\_\_0\>d.MoveNext()  
— End of stack trace from previous location where exception was thrown —  
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()  
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)  
at Duplicati.Library.Main.Operation.Backup.BackendUploader.d\_\_18.MoveNext()  
— End of stack trace from previous location where exception was thrown —  
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()  
at Duplicati.Library.Main.Operation.Backup.BackendUploader.d\_\_18.MoveNext()  
— End of stack trace from previous location where exception was thrown —  
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()  
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)  
at Duplicati.Library.Main.Operation.Backup.BackendUploader.d\_\_17.MoveNext()  
— End of stack trace from previous location where exception was thrown —  
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()  
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)  
at Duplicati.Library.Main.Operation.Backup.BackendUploader.d\_\_15.MoveNext()  
— End of stack trace from previous location where exception was thrown —  
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()  
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)  
at Duplicati.Library.Main.Operation.Backup.BackendUploader.\<b\_\_13\_0\>d.MoveNext()  
— End of stack trace from previous location where exception was thrown —  
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()  
at Duplicati.Library.Main.Operation.Backup.BackendUploader.\<b\_\_13\_0\>d.MoveNext()  
— End of stack trace from previous location where exception was thrown —  
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()  
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)  
at CoCoL.AutomationExtensions.d\_\_10`1.MoveNext() --- End of inner exception stack trace --- ---> (Inner Exception #0) System.Net.WebException: The remote server returned an error: (403) Forbidden. at Duplicati.Library.Utility.AsyncHttpRequest.AsyncWrapper.GetResponseOrStream() at Duplicati.Library.Utility.AsyncHttpRequest.GetResponse() at Duplicati.Library.JSONWebHelper.GetResponse(AsyncHttpRequest req, Object requestdata) at Duplicati.Library.JSONWebHelper.ReadJSONResponse[T](AsyncHttpRequest req, Object requestdata) at Duplicati.Library.Backend.GoogleDrive.GoogleDrive.<ListFolder>d__42.MoveNext() at Duplicati.Library.Backend.GoogleDrive.GoogleDrive.<List>d__17.MoveNext() at Duplicati.Library.Backend.GoogleDrive.GoogleDrive.<PutAsync>d__15.MoveNext() --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) at Duplicati.Library.Main.Operation.Backup.BackendUploader.<DoPut>d__21.MoveNext() --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) at Duplicati.Library.Main.Operation.Backup.BackendUploader.<>c __DisplayClass17_0.<<UploadFileAsync>b__ 0>d.MoveNext() --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) at Duplicati.Library.Main.Operation.Backup.BackendUploader.<DoWithRetry>d__18.MoveNext() --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() at Duplicati.Library.Main.Operation.Backup.BackendUploader.<DoWithRetry>d__18.MoveNext() --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) at Duplicati.Library.Main.Operation.Backup.BackendUploader.<UploadFileAsync>d__17.MoveNext() --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) at Duplicati.Library.Main.Operation.Backup.BackendUploader.<UploadBlockAndIndexAsync>d__15.MoveNext() --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) at Duplicati.Library.Main.Operation.Backup.BackendUploader.<<Run>b__13_0>d.MoveNext() --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() at Duplicati.Library.Main.Operation.Backup.BackendUploader.<<Run>b__13_0>d.MoveNext() --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) at CoCoL.AutomationExtensions.<RunTask>d__10`1.MoveNext()\<—  
\<—  
\<—

Log data:  
2020-05-18 13:04:17 +01 - [Error-Duplicati.Library.Main.Operation.BackupHandler-FatalError]: Fatal error  
System.IO.FileNotFoundException: Could not find file ‘C:\Users\systemadmin\AppData\Local\Temp\2\dup-a6a85bb8-78b8-4c83-bfa2-3c8ca9a5c069’.  
File name: ‘C:\Users\systemadmin\AppData\Local\Temp\2\dup-a6a85bb8-78b8-4c83-bfa2-3c8ca9a5c069’  
at [System.IO](http://System.IO).\_\_Error.WinIOError(Int32 errorCode, String maybeFullPath)  
at System.IO.FileStream.Init(String path, FileMode mode, FileAccess access, Int32 rights, Boolean useRights, FileShare share, Int32 bufferSize, FileOptions options, SECURITY\_ATTRIBUTES secAttrs, String msgPath, Boolean bFromProxy, Boolean useLongPath, Boolean checkHost)  
at System.IO.FileStream…ctor(String path, FileMode mode, FileAccess access, FileShare share)  
at Duplicati.Library.Main.Operation.Backup.SpillCollectorProcess.\<\>c\_\_DisplayClass0\_0.\<b\_\_0\>d.MoveNext()  
— End of stack trace from previous location where exception was thrown —  
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()  
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)  
at CoCoL.AutomationExtensions.d\_\_10`1.MoveNext()  
— End of stack trace from previous location where exception was thrown —  
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()  
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)  
at Duplicati.Library.Main.Operation.BackupHandler.d\_\_13.MoveNext()  
— End of stack trace from previous location where exception was thrown —  
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()  
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)  
at Duplicati.Library.Main.Operation.BackupHandler.d\_\_20.MoveNext()

Sorry to keep messaging but I’m new to all this, I’ve managed to get it running on 4 other servers without a problem it’s just this one that is being a pain.

If I was to delete all the jobs within Duplicati and started again would I still be able to recover the files from Google Drive?

---

<div class="post-metadata">

### Author: ![ts678](https://forum.duplicati.com/letter_avatar_proxy/v4/letter/t/8491ac/32.png) [@ts678](https://forum.duplicati.com/u/ts678)
#### Post date: [May 19, 2020, 2:45pm UTC](https://forum.duplicati.com/t/consistent-unexpected-difference-in-fileset-version/7101/37 "2020-05-19T14:45:36Z")

</div>

> [@Jamie\_Leeke](#):
>
> I tried to run it again and get the error I sent over.

That fits well with the version numbers, where 0 is the newest, and 1 is previous (i.e one that crashed).

The error on the temporary file has been seen before, but I don’t think the cause is known, and maybe adequate information has never been collected (hard to do unless problem repeats). I’ll check cases…

Ideally one would have a log file running in advance to maybe catch something leading up to the error.

Network errors sometimes lead to issues later on, but such details are not logged very well by default.

[–log-file](https://duplicati.readthedocs.io/en/latest/06-advanced-options/#log-file) with [–log-file-log-level](https://duplicati.readthedocs.io/en/latest/06-advanced-options/#log-file-log-level)=Retry is a good level to catch those. There are higher levels but output becomes overwhelming at some point (so I hope it’s not necessary to go to Verbose or even Profiling).

Because you kept your old job, you can see if you have job `Complete log` to look for `RetryAttempts`. Recreate attempt might have wiped out the logs though. The per-job logs are kept in the job database.

> [@Jamie\_Leeke](#):
>
> When you say rename the folder, is that the local folder or the folder in Google Drive as I’ve created a new folder for the backup in Google Drive.

Google Drive. These are roughly equivalent:

1. Rename remote folder (to preserver data just in case), leaving Duplicati configuration alone.
2. Change Duplicati configuration to a new folder, leaving old remote folder alone. You did this.

You also avoided needing `Delete` button on database by creating a new job (so a new database).

EDIT: missed this one:

> [@Jamie\_Leeke](#):
>
> If I was to delete all the jobs within Duplicati and started again would I still be able to recover the files from Google Drive?

[Restoring files using the Recovery Tool](https://duplicati.readthedocs.io/en/latest/08-disaster-recovery/#downloading-all-remote-files-using-the-recovery-tool) and prior steps are command line tools, and things you might want from the Duplicati server installation would be the `<remoteurl>`, encryption password, and such from [Export As Command-line](https://duplicati.readthedocs.io/en/latest/03-using-the-graphical-user-interface/#exporting-a-backup-job-configuration). If you don’t have job information saved elsewhere, it’d be a good idea.

Exporting to a file is a good idea too, but if the reason for a deletion is because of some concern about configuration, you might prefer a manual retype based on clues from the command-line export version.

If you’re not worried about a bad config, you could import then try to recover, but I don’t know why that would work better than just the job database recreate, which was running too long and slow previously.

---

<div class="post-metadata">

### Author: ![ts678](https://forum.duplicati.com/letter_avatar_proxy/v4/letter/t/8491ac/32.png) [@ts678](https://forum.duplicati.com/u/ts678)
#### Post date: [May 20, 2020, 12:53am UTC](https://forum.duplicati.com/t/consistent-unexpected-difference-in-fileset-version/7101/38 "2020-05-20T00:53:24Z")

</div>

Similar issues with some comments and troubleshooting ideas which the users didn’t clearly pursue:

[Need help, backup failing to B2 cloud](https://forum.duplicati.com/t/need-help-backup-failing-to-b2-cloud/7442) has an antivirus theory and a Process Monitor debugging idea.

[Backup error - sftp - put](https://forum.duplicati.com/t/backup-error-sftp-put/7436) has `SftpPermissionDeniedException` further down in all the stack traces.

The backend failure that I notice further down in all your stack traces is the following:

> System.Net.WebException: The remote server returned an error: (403) Forbidden

[Delete dlist file not found & exclude ~$ temporary files](https://forum.duplicati.com/t/delete-dlist-file-not-found-exclude-temporary-files/9768/5) was my history of odd Google Drive 403 errors.  
Generally such errors will be retried based on [–number-of-retries](https://duplicati.readthedocs.io/en/latest/06-advanced-options/#number-of-retries), but eventually retries might exhaust.  
Running a log at Retry level will detail each error, otherwise you might just see how the last one failed.

[Previous page](https://forum.duplicati.com/t/consistent-unexpected-difference-in-fileset-version/7101.md?page=1)
