# Critical issues with the current canary \[2.0.3.9\]

**URL:** https://forum.duplicati.com/t/critical-issues-with-the-current-canary-2-0-3-9/4283
**Category:** Releases
**Created:** [August 5, 2018, 9:35pm UTC](https://forum.duplicati.com/t/critical-issues-with-the-current-canary-2-0-3-9/4283 "2018-08-05T21:35:38Z")
**Posts on this page:** 20
**Page:** 1

<div class="post-metadata">

### Author: ![kenkendk](https://forum.duplicati.com/user_avatar/forum.duplicati.com/kenkendk/32/5305_2.png) [@kenkendk](https://forum.duplicati.com/u/kenkendk)
#### Post date: [August 5, 2018, 9:35pm UTC](https://forum.duplicati.com/t/critical-issues-with-the-current-canary-2-0-3-9/4283/1 "2018-08-05T21:35:38Z")

</div>

I would like to move on a new beta release, but I think we have some lingering issues with the current canary build.

@JonMikelV: do you have an overview of what issues we need to address?

I think the performance issues were fixed, but I am not sure.

New list with the checkbox plugin:

[Processing files which are not in backup sources](https://forum.duplicati.com/t/processing-files-which-are-not-in-backup-sources/4009) (only if --snapshot-policy is on)

[Counting of size of file to go · Issue #3305](https://github.com/duplicati/duplicati/issues/3305) (as Pectojin suggested)

[Skip-files-larger-than ignored](https://forum.duplicati.com/t/skip-files-larger-than-ignored/4112) (no default B, KB, MB, etc. size)

[UNIQUE constraint failed with SIA (Support Request) [2.0.3.6] ](https://forum.duplicati.com/t/unique-constraint-failed-with-sia-support-request-2-0-3-6/3515) (resolved by downgrading, I also had this with SFTP)

[Backup unusable: Duplicati tells me to repair, but repairing doesn’t work](https://forum.duplicati.com/t/backup-unusable-duplicati-tells-me-to-repair-but-repairing-doesnt-work/4209) (getting a few of these missing files reported, including on my SFTP - I think it’s dlist files referencing deleted or empty dblocks so repair AFTER deleting all dlists seems to resolve it)

[Metadata was reported as not changed, but still requires being added?](https://forum.duplicati.com/t/metadata-was-reported-as-not-changed-but-still-requires-being-added/3320) (I’ve had this randomly happen starting with 2.0.3.6 but can’t seem to force it)

There’s also misc. non-canary stuff like:

[Throttle translation is inversed in French](https://forum.duplicati.com/t/throttle-translation-is-inversed-in-french/4179)  
 [Linux “Failed to process metadata” errors on CIFS files related to xattr change](https://github.com/duplicati/duplicati/issues/3327)

---

<div class="post-metadata">

### Author: ![Pectojin](https://forum.duplicati.com/user_avatar/forum.duplicati.com/pectojin/32/1231_2.png) [@Pectojin](https://forum.duplicati.com/u/Pectojin)
#### Post date: [August 5, 2018, 9:41pm UTC](https://forum.duplicati.com/t/critical-issues-with-the-current-canary-2-0-3-9/4283/2 "2018-08-05T21:41:43Z")

</div>

I would add this one to the list [Counting of size of file to go · Issue #3305 · duplicati/duplicati · GitHub](https://github.com/duplicati/duplicati/issues/3305)

It appears to just be cosmetic, but it’s pretty unsettling for users.

---

<div class="post-metadata">

### Author: ![JonMikelV](https://forum.duplicati.com/letter_avatar_proxy/v4/letter/j/439d5e/32.png) [@JonMikelV](https://forum.duplicati.com/u/JonMikelV)
#### Post date: [August 5, 2018, 9:57pm UTC](https://forum.duplicati.com/t/critical-issues-with-the-current-canary-2-0-3-9/4283/3 "2018-08-05T21:57:49Z")

</div>

I think there are some more, but at the moment the ones I can think of are:

- [Processing files which are not in backup sources](https://forum.duplicati.com/t/processing-files-which-are-not-in-backup-sources/4009) (only if --snapshot-policy is on)
- [Counting of size of file to go · Issue #3305 · duplicati/duplicati · GitHub](https://github.com/duplicati/duplicati/issues/3305) (as Pectojin suggested)
- [Skip-files-larger-than ignored](https://forum.duplicati.com/t/skip-files-larger-than-ignored/4112) (no default B, KB, MB, etc. size)
- [UNIQUE constraint failed with SIA (Support Request) [2.0.3.6]](https://forum.duplicati.com/t/unique-constraint-failed-with-sia-support-request-2-0-3-6/3515) (resolved by downgrading, I also had this with SFTP)
- [Backup unusable: Duplicati tells me to repair, but repairing doesn’t work](https://forum.duplicati.com/t/backup-unusable-duplicati-tells-me-to-repair-but-repairing-doesnt-work/4209) (getting a few of these missing files reported, including on my SFTP - I think it’s dlist files referencing deleted or empty dblocks so repair AFTER deleting all dlists seems to resolve it)
- [Metadata was reported as not changed, but still requires being added?](https://forum.duplicati.com/t/metadata-was-reported-as-not-changed-but-still-requires-being-added/3320) (I’ve had this randomly happen starting with 2.0.3.6 but can’t seem to force it)

There’s also misc. non-canary stuff like:

- [Throttle translation is inversed in French](https://forum.duplicati.com/t/throttle-translation-is-inversed-in-french/4179)
- [Linux "Failed to process metadata" errors on CIFS files related to xattr change · Issue #3327 · duplicati/duplicati · GitHub](https://github.com/duplicati/duplicati/issues/3327)

---

<div class="post-metadata">

### Author: ![warwickmm](https://forum.duplicati.com/letter_avatar_proxy/v4/letter/w/5e9695/32.png) [@warwickmm](https://forum.duplicati.com/u/warwickmm)
#### Post date: [August 6, 2018, 3:55am UTC](https://forum.duplicati.com/t/critical-issues-with-the-current-canary-2-0-3-9/4283/4 "2018-08-06T03:55:39Z")

</div>

I believe the issue with [slow database queries](https://github.com/duplicati/duplicati/issues/3194) might still be unresolved? It appears that some of the queries may scale poorly with the size of the local database. See my [later posts](https://github.com/duplicati/duplicati/issues/3194#issuecomment-399307067) for more details.

Unfortunately, I am no longer able to replicate this issue as I have since modified my retention settings and trimmed my local database size from over 4GB to a few hundred MB. This has reduced my backup time from over 20 minutes to less than 4 minutes.

---

<div class="post-metadata">

### Author: ![kenkendk](https://forum.duplicati.com/user_avatar/forum.duplicati.com/kenkendk/32/5305_2.png) [@kenkendk](https://forum.duplicati.com/u/kenkendk)
#### Post date: [August 6, 2018, 6:49am UTC](https://forum.duplicati.com/t/critical-issues-with-the-current-canary-2-0-3-9/4283/5 "2018-08-06T06:49:12Z")

</div>

> [@JonMikelV](#):
>
> I think there are some more, but at the moment the ones I can think of are:

Thanks! I will use it as my “todo” list for now.

I have two minor things, that I will fix first, and the I will go on to this list.

---

<div class="post-metadata">

### Author: ![tugdualenligne](https://forum.duplicati.com/letter_avatar_proxy/v4/letter/t/d2c977/32.png) [@tugdualenligne](https://forum.duplicati.com/u/tugdualenligne)
#### Post date: [August 13, 2018, 1:05pm UTC](https://forum.duplicati.com/t/critical-issues-with-the-current-canary-2-0-3-9/4283/6 "2018-08-13T13:05:48Z")

</div>

Hi kenkendk,  
The Throttle translation has been corrected in French and several hundreds other parts have been translated, please include them in the next beta release.  
Cheers,

---

<div class="post-metadata">

### Author: ![kenkendk](https://forum.duplicati.com/user_avatar/forum.duplicati.com/kenkendk/32/5305_2.png) [@kenkendk](https://forum.duplicati.com/u/kenkendk)
#### Post date: [August 13, 2018, 8:11pm UTC](https://forum.duplicati.com/t/critical-issues-with-the-current-canary-2-0-3-9/4283/7 "2018-08-13T20:11:01Z")

</div>

Yep, I have pulled translations for the languages and will include them!

---

<div class="post-metadata">

### Author: ![JonMikelV](https://forum.duplicati.com/letter_avatar_proxy/v4/letter/j/439d5e/32.png) [@JonMikelV](https://forum.duplicati.com/u/JonMikelV)
#### Post date: [August 14, 2018, 5:24pm UTC](https://forum.duplicati.com/t/critical-issues-with-the-current-canary-2-0-3-9/4283/8 "2018-08-14T17:24:58Z")

</div>

> [@kenkendk](#):
>
> I’ve had this randomly happen starting with 2.0.3.6 but can’t seem to force it

I may have found a repeatable scenario to trigger this. It seems like whenever I do multiple database repair / rebuild tests around dindex / dlist failure scenarios I eventually run into the “Metadat awas reported as not changed, but still requires being added?” issue.

And it just so happens I triggered it on a test backup yesterday so I’ll let that sit as a test bed for when new version comes out.

I love the checkbox plugin!

Though I did notice I can change the checkboxes without editing the post and it appears it’s not a wiki…hopefully it’s only because of my access and not everybody can do it.

---

<div class="post-metadata">

### Author: ![SamSirry](https://forum.duplicati.com/user_avatar/forum.duplicati.com/samsirry/32/1550_2.png) [@SamSirry](https://forum.duplicati.com/u/SamSirry)
#### Post date: [August 14, 2018, 7:29pm UTC](https://forum.duplicati.com/t/critical-issues-with-the-current-canary-2-0-3-9/4283/9 "2018-08-14T19:29:04Z")

</div>

> [@JonMikelV](#):
>
> hopefully it’s only because of my access and not everybody can do it

True. I cannot make any change to the check boxes, they are _unclickable_.

---

<div class="post-metadata">

### Author: ![warwickmm](https://forum.duplicati.com/letter_avatar_proxy/v4/letter/w/5e9695/32.png) [@warwickmm](https://forum.duplicati.com/u/warwickmm)
#### Post date: [August 25, 2018, 5:28am UTC](https://forum.duplicati.com/t/critical-issues-with-the-current-canary-2-0-3-9/4283/10 "2018-08-25T05:28:00Z")

</div>

It looks like there are several users that are having 404 issues with 2.0.3.9 and the Google Cloud Storage backend:

> [@File PUT to Google Cloud Storge gives "(404) Not Found" error](https://forum.duplicati.com/t/file-put-to-google-cloud-storge-gives-404-not-found-error/4058):
>
> The e-mail now is correct (with 2.0.3.8?), saying the backup is ok, but indeed tries to put files on GCS (Google Cloud Storage) and receive errors. Operation Put with file duplicati-bf33e810347ea4a39a5b4a6d979c35ac3.dblock.zip attempt 5 of 5 failed with message: The remote server returned an error: (404) Not Found. It tries to store the data but receive errors from the server. And doesn’t store anything! I realize only today, looking in the bucket of GCS, and I have seen that there were no …

> <https://github.com/duplicati/duplicati/issues/3328>
>
> \- \[x\] I have searched open and closed issues for duplicates.
> 
> \----------------…------------------------
> 
> \## Environment info
> 
> 
> \- \*\*Duplicati version\*\*: 2.0.3.9
> \- \*\*Operating system\*\*: Windows 10
> \- \*\*Backend\*\*: Google Cloud Storage
> 
> \## Description
> 
> All backups to the Google Cloud Storage are failing. Tried to reinstall and recreate all backups. Saving backups to a local folder is working. When choosing Google Cloud Storage as a backend, the backup fails after some seconds of scanning the files.
> 
> 
> \## Debug log
> 
> 
> 
> \`System.AggregateException: One or more errors occurred. ---\> System.AggregateException: Object reference not set to an instance of an object. ---\> System.NullReferenceException: Object reference not set to an instance of an object.
> at Duplicati.Library.Main.Volumes.BlockVolumeWriter.AddBlock(String hash, Byte\[\] data, Int32 offset, Int32 size, CompressionHint hint)
> at Duplicati.Library.Main.Operation.Backup.SpillCollectorProcess.\<\>c\_\_DisplayClass0\_0.\<\<Run\>b\_\_0\>d.MoveNext()
> \--- End of stack trace from previous location where exception was thrown ---
> at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
> at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
> at CoCoL.AutomationExtensions.\<RunTask\>d\_\_10\`1.MoveNext()
> \--- End of stack trace from previous location where exception was thrown ---
> at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
> at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
> at Duplicati.Library.Main.Operation.BackupHandler.\<RunMainOperation\>d\_\_12.MoveNext()
> \--- End of stack trace from previous location where exception was thrown ---
> at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
> at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
> at Duplicati.Library.Main.Operation.BackupHandler.\<RunAsync\>d\_\_19.MoveNext()
> --- End of inner exception stack trace ---
> at Duplicati.Library.Main.Operation.BackupHandler.\<RunAsync\>d\_\_19.MoveNext()
> --- End of inner exception stack trace ---
> at CoCoL.ChannelExtensions.WaitForTaskOrThrow(Task task)
> at Duplicati.Library.Main.Controller.\<\>c\_\_DisplayClass13\_0.\<Backup\>b\_\_0(BackupResults result)
> at Duplicati.Library.Main.Controller.RunAction\[T\](T result, String\[\]& paths, IFilter& filter, Action\`1 method)
> at Duplicati.Library.Main.Controller.Backup(String\[\] inputsources, IFilter filter)
> at Duplicati.Server.Runner.Run(IRunnerData data, Boolean fromQueue)
> \---\> (Inner Exception #0) System.AggregateException: Object reference not set to an instance of an object. ---\> System.NullReferenceException: Object reference not set to an instance of an object.
> at Duplicati.Library.Main.Volumes.BlockVolumeWriter.AddBlock(String hash, Byte\[\] data, Int32 offset, Int32 size, CompressionHint hint)
> at Duplicati.Library.Main.Operation.Backup.SpillCollectorProcess.\<\>c\_\_DisplayClass0\_0.\<\<Run\>b\_\_0\>d.MoveNext()
> \--- End of stack trace from previous location where exception was thrown ---
> at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
> at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
> at CoCoL.AutomationExtensions.\<RunTask\>d\_\_10\`1.MoveNext()
> \--- End of stack trace from previous location where exception was thrown ---
> at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
> at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
> at Duplicati.Library.Main.Operation.BackupHandler.\<RunMainOperation\>d\_\_12.MoveNext()
> \--- End of stack trace from previous location where exception was thrown ---
> at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
> at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
> at Duplicati.Library.Main.Operation.BackupHandler.\<RunAsync\>d\_\_19.MoveNext()
> --- End of inner exception stack trace ---
> at Duplicati.Library.Main.Operation.BackupHandler.\<RunAsync\>d\_\_19.MoveNext()
> \---\> (Inner Exception #0) System.NullReferenceException: Object reference not set to an instance of an object.
> at Duplicati.Library.Main.Volumes.BlockVolumeWriter.AddBlock(String hash, Byte\[\] data, Int32 offset, Int32 size, CompressionHint hint)
> at Duplicati.Library.Main.Operation.Backup.SpillCollectorProcess.\<\>c\_\_DisplayClass0\_0.\<\<Run\>b\_\_0\>d.MoveNext()
> \--- End of stack trace from previous location where exception was thrown ---
> at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
> at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
> at CoCoL.AutomationExtensions.\<RunTask\>d\_\_10\`1.MoveNext()
> \--- End of stack trace from previous location where exception was thrown ---
> at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
> at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
> at Duplicati.Library.Main.Operation.BackupHandler.\<RunMainOperation\>d\_\_12.MoveNext()
> \--- End of stack trace from previous location where exception was thrown ---
> at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
> at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
> at Duplicati.Library.Main.Operation.BackupHandler.\<RunAsync\>d\_\_19.MoveNext()\<---
> 
> \---\> (Inner Exception #1) System.AggregateException: One or more errors occurred. ---\> System.Net.WebException: The remote server returned an error: (404) Not Found.
> at Duplicati.Library.Main.Operation.Common.BackendHandler.\<DoWithRetry\>d\_\_21\`1.MoveNext()
> \--- End of stack trace from previous location where exception was thrown ---
> at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
> at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
> at Duplicati.Library.Main.Operation.Common.BackendHandler.\<\>c\_\_DisplayClass13\_0.\<\<UploadFileAsync\>b\_\_1\>d.MoveNext()
> \--- End of stack trace from previous location where exception was thrown ---
> at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
> at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
> at Duplicati.Library.Main.Operation.Common.BackendHandler.\<UploadFileAsync\>d\_\_13.MoveNext()
> \--- End of stack trace from previous location where exception was thrown ---
> at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
> at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
> at Duplicati.Library.Main.Operation.Backup.BackendUploader.\<\>c\_\_DisplayClass0\_0.\<\<Run\>b\_\_0\>d.MoveNext()
> \--- End of stack trace from previous location where exception was thrown ---
> at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
> at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
> at CoCoL.AutomationExtensions.\<RunTask\>d\_\_10\`1.MoveNext()
> --- End of inner exception stack trace ---
> \---\> (Inner Exception #0) System.Net.WebException: The remote server returned an error: (404) Not Found.
> at Duplicati.Library.Main.Operation.Common.BackendHandler.\<DoWithRetry\>d\_\_21\`1.MoveNext()
> \--- End of stack trace from previous location where exception was thrown ---
> at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
> at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
> at Duplicati.Library.Main.Operation.Common.BackendHandler.\<\>c\_\_DisplayClass13\_0.\<\<UploadFileAsync\>b\_\_1\>d.MoveNext()
> \--- End of stack trace from previous location where exception was thrown ---
> at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
> at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
> at Duplicati.Library.Main.Operation.Common.BackendHandler.\<UploadFileAsync\>d\_\_13.MoveNext()
> \--- End of stack trace from previous location where exception was thrown ---
> at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
> at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
> at Duplicati.Library.Main.Operation.Backup.BackendUploader.\<\>c\_\_DisplayClass0\_0.\<\<Run\>b\_\_0\>d.MoveNext()
> \--- End of stack trace from previous location where exception was thrown ---
> at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
> at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
> at CoCoL.AutomationExtensions.\<RunTask\>d\_\_10\`1.MoveNext()\<---
> \<---
> 
> \---\> (Inner Exception #2) System.AggregateException: One or more errors occurred. ---\> System.Exception: Unable to find log in lookup table, this may be caused by attempting to transport call contexts between AppDomains (eg. with remoting calls)
> at Duplicati.Library.Logging.Log.get\_CurrentScope()
> at Duplicati.Library.Logging.Log.WriteMessage(LogMessageType type, String tag, String id, Exception ex, String message, Object\[\] arguments)
> at Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess.\<\>c.\<Run\>b\_\_1\_3(String rootpath, String errorpath, Exception ex)
> at Duplicati.Library.Utility.Utility.\<EnumerateFileSystemEntries\>d\_\_23.MoveNext()
> at System.Linq.Enumerable.\<SelectManyIterator\>d\_\_17\`2.MoveNext()
> at Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess.\<ExpandWorkList\>d\_\_4.MoveNext()
> at Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess.\<\>c\_\_DisplayClass1\_0.\<\<Run\>b\_\_0\>d.MoveNext()
> \--- End of stack trace from previous location where exception was thrown ---
> at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
> at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
> at CoCoL.AutomationExtensions.\<RunTask\>d\_\_10\`1.MoveNext()
> --- End of inner exception stack trace ---
> \---\> (Inner Exception #0) System.Exception: Unable to find log in lookup table, this may be caused by attempting to transport call contexts between AppDomains (eg. with remoting calls)
> at Duplicati.Library.Logging.Log.get\_CurrentScope()
> at Duplicati.Library.Logging.Log.WriteMessage(LogMessageType type, String tag, String id, Exception ex, String message, Object\[\] arguments)
> at Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess.\<\>c.\<Run\>b\_\_1\_3(String rootpath, String errorpath, Exception ex)
> at Duplicati.Library.Utility.Utility.\<EnumerateFileSystemEntries\>d\_\_23.MoveNext()
> at System.Linq.Enumerable.\<SelectManyIterator\>d\_\_17\`2.MoveNext()
> at Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess.\<ExpandWorkList\>d\_\_4.MoveNext()
> at Duplicati.Library.Main.Operation.Backup.FileEnumerationProcess.\<\>c\_\_DisplayClass1\_0.\<\<Run\>b\_\_0\>d.MoveNext()
> \--- End of stack trace from previous location where exception was thrown ---
> at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
> at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
> at CoCoL.AutomationExtensions.\<RunTask\>d\_\_10\`1.MoveNext()\<---
> \<---
> \`

I am able to replicate this, and have a potential fix (it was a bit difficult to bisect, since many of the commits do not build). I’ll test some more and submit a pull request if things look good.

edit: pull request submitted…

> <https://github.com/duplicati/duplicati/pull/3347>
>
> This fixes an issue where Google Cloud Storage users encountered the following e…xception:
> 
> \`System.Net.WebException: The remote server returned an error: (404) Not Found.\`
> 
> The refactoring in revision 18de687530 ("Updated Put and Createfolder using WebApi") omitted the \`/o\` in the endpoint for object uploads.
> 
> This addresses issue #3328.

---

<div class="post-metadata">

### Author: ![Tapio](https://forum.duplicati.com/user_avatar/forum.duplicati.com/tapio/32/3371_2.png) [@Tapio](https://forum.duplicati.com/u/Tapio)
#### Post date: [August 25, 2018, 1:23pm UTC](https://forum.duplicati.com/t/critical-issues-with-the-current-canary-2-0-3-9/4283/11 "2018-08-25T13:23:57Z")

</div>

Latest Canaries are not fun to use. Disk2disk backup, many files and \>1TB with just some small MB of change, takes now hours instead of \<10 minutes. Despite rebuild of database and use of check-filetime-only. Duplicati reads whole file contents (I see a permanent IO of \>80MByte/s) which is terrible, because effectively I cannot run this backup any more since May.

Also, but this is probably not a problem, 10000s of warnings (# of files).

---

<div class="post-metadata">

### Author: ![ts678](https://forum.duplicati.com/letter_avatar_proxy/v4/letter/t/8491ac/32.png) [@ts678](https://forum.duplicati.com/u/ts678)
#### Post date: [August 25, 2018, 4:10pm UTC](https://forum.duplicati.com/t/critical-issues-with-the-current-canary-2-0-3-9/4283/12 "2018-08-25T16:10:04Z")

</div>

Hi @Tapio

–check-filetime-only for canary from the big 2.0.3.6 rewrite through 2.0.3.9 can cause warnings and slowdowns.  
The “Metadata” topic above describes how the option regressed, and has speed comparisions with and without.  
2.0.3.6 was Apr 23. Any May problem might have come from 2.0.3.6 picking up an existing --check-filetime-only.  
Removal might not fix every performance or read rate worry. I’m just giving a specific workaround that may help.

---

<div class="post-metadata">

### Author: ![Tapio](https://forum.duplicati.com/user_avatar/forum.duplicati.com/tapio/32/3371_2.png) [@Tapio](https://forum.duplicati.com/u/Tapio)
#### Post date: [August 27, 2018, 11:47am UTC](https://forum.duplicati.com/t/critical-issues-with-the-current-canary-2-0-3-9/4283/13 "2018-08-27T11:47:51Z")

</div>

Thanks. Yeah, I remove the checkfiletime flag and it still reads my whole contents. Backing up my few MBytes will maybe take 5 hrs now. This time I will try to let it finish the process, maybe on next backup it will not read everything again then.

---

<div class="post-metadata">

### Author: ![kenkendk](https://forum.duplicati.com/user_avatar/forum.duplicati.com/kenkendk/32/5305_2.png) [@kenkendk](https://forum.duplicati.com/u/kenkendk)
#### Post date: [August 29, 2018, 12:30pm UTC](https://forum.duplicati.com/t/critical-issues-with-the-current-canary-2-0-3-9/4283/14 "2018-08-29T12:30:03Z")

</div>

> [@JonMikelV](#):
>
> I may have found a repeatable scenario to trigger this. It seems like whenever I do multiple database repair / rebuild tests around dindex / dlist failure scenarios I eventually run into the “Metadat awas reported as not changed, but still requires being added?” issue.

Ok. There are now three open issues left on the list, and I think the snapshot issue is causing the `UNIQUE constraint` issue.

I _think_ the snapshot issue is fixed, but I was never able to reproduce locally, so it may still lurk. If I am correct, this means we only have the “repair does not work” issue left.

I have some ideas for how we can make the repair process more robust, but it will take some rewriting to complete. I propose that we make a new canary with the fixes already in there, and then make the “repair does not work” issue the top priority for the next release. And we get some feedback on the snapshot issue.

---

<div class="post-metadata">

### Author: ![JonMikelV](https://forum.duplicati.com/letter_avatar_proxy/v4/letter/j/439d5e/32.png) [@JonMikelV](https://forum.duplicati.com/u/JonMikelV)
#### Post date: [August 29, 2018, 1:10pm UTC](https://forum.duplicati.com/t/critical-issues-with-the-current-canary-2-0-3-9/4283/15 "2018-08-29T13:10:04Z")

</div>

> [@kenkendk](#):
>
> I propose that we make a new canary with the fixes already in there, and then make the “repair does not work” issue the top priority for the next release. And we get some feedback on the snapshot issue.

Sounds like a great plan (full disclosure, I was thinking of proposing the same thing). 🙂

Thanks for all the effort to get these initial items resolved!

---

<div class="post-metadata">

### Author: ![kenkendk](https://forum.duplicati.com/user_avatar/forum.duplicati.com/kenkendk/32/5305_2.png) [@kenkendk](https://forum.duplicati.com/u/kenkendk)
#### Post date: [August 30, 2018, 10:10am UTC](https://forum.duplicati.com/t/critical-issues-with-the-current-canary-2-0-3-9/4283/16 "2018-08-30T10:10:45Z")

</div>

> [@JonMikelV](#):
>
> Sounds like a great plan

New version out 🙂

---

<div class="post-metadata">

### Author: ![mnaiman](https://forum.duplicati.com/user_avatar/forum.duplicati.com/mnaiman/32/5961_2.png) [@mnaiman](https://forum.duplicati.com/u/mnaiman)
#### Post date: [August 31, 2018, 8:05pm UTC](https://forum.duplicati.com/t/critical-issues-with-the-current-canary-2-0-3-9/4283/17 "2018-08-31T20:05:36Z")

</div>

Great fixes!  
Rolling update to one server/day to confirm that all nasty bugs are gone especially this one [Processing files which are not in backup sources · Issue #3307 · duplicati/duplicati · GitHub](https://github.com/duplicati/duplicati/issues/3307)

---

<div class="post-metadata">

### Author: ![mikaelmello](https://forum.duplicati.com/user_avatar/forum.duplicati.com/mikaelmello/32/2097_2.png) [@mikaelmello](https://forum.duplicati.com/u/mikaelmello)
#### Post date: [November 19, 2018, 1:25pm UTC](https://forum.duplicati.com/t/critical-issues-with-the-current-canary-2-0-3-9/4283/18 "2018-11-19T13:25:25Z")

</div>

I think this is also somewhat important:

> <https://github.com/duplicati/duplicati/issues/3445>

---

<div class="post-metadata">

### Author: ![JonMikelV](https://forum.duplicati.com/letter_avatar_proxy/v4/letter/j/439d5e/32.png) [@JonMikelV](https://forum.duplicati.com/u/JonMikelV)
#### Post date: [November 19, 2018, 4:31pm UTC](https://forum.duplicati.com/t/critical-issues-with-the-current-canary-2-0-3-9/4283/19 "2018-11-19T16:31:18Z")

</div>

This thread is a bit stale - can you confirm what canary version you’re seeing this on and I’ll look at starting a new topic.

---

<div class="post-metadata">

### Author: ![mikaelmello](https://forum.duplicati.com/user_avatar/forum.duplicati.com/mikaelmello/32/2097_2.png) [@mikaelmello](https://forum.duplicati.com/u/mikaelmello)
#### Post date: [November 20, 2018, 10:14am UTC](https://forum.duplicati.com/t/critical-issues-with-the-current-canary-2-0-3-9/4283/20 "2018-11-20T10:14:05Z")

</div>

All of them since 2.0.3.6, will test again on latest just to be sure

Edit: I was already testing on 2.0.4.4 without having realized

[Next page](https://forum.duplicati.com/t/critical-issues-with-the-current-canary-2-0-3-9/4283.md?page=2)
