Today I had another backup job to Anazon Cloud Drive fail. This time, at least the reason was logged (I double checked the logs for the one from 30 nov in the screenshot above but there is definitely nothing logged at 15:40). In fact, I suppose this failure went quite smoothely, since the backup job quit with an error message and started the next backup as scheduled. I suppose this is how it’s supposed to work.
Nevertheless, I think duplicati should be able to handle this situation better, i.e. without asking me to run repair. I’m not sure what might have led to a missing file in the backend, but since this was the first and only time this backup ran, it must have happened during that run and so I think duplicati should be able to handle this without user intervention.
So here are the logs:
4 Dec 2017 03:36: Message
Fatal error
Duplicati.Library.Interface.UserInformationException: Found 1 files that are missing from the remote storage, please run repair
at Duplicati.Library.Main.Operation.FilelistProcessor.VerifyRemoteList(BackendManager backend, Options options, LocalDatabase database, IBackendWriter log, String protectedfile)
at Duplicati.Library.Main.Operation.BackupHandler.PostBackupVerification()
at Duplicati.Library.Main.Operation.BackupHandler.Run(String[] sources, IFilter filter)
4 Dec 2017 03:36: Message
Found 1 files that are missing from the remote storage, please run repair
4 Dec 2017 03:36: Message
Missing file: duplicati-20171203T131457Z.dlist.zip.aes
4 Dec 2017 03:36: Message
removing file listed as Deleting: duplicati-b7511cf4d558d4349bf7787c0a1df19f7.dblock.zip.aes
4 Dec 2017 03:36: Message
removing file listed as Deleting: duplicati-b6f493bcf388149e1aca3e988c6fc4cbf.dblock.zip.aes
4 Dec 2017 03:36: Message
removing file listed as Deleting: duplicati-ieff8d69a2e5e4ff08bf97eb9b2d91816.dindex.zip.aes
4 Dec 2017 03:36: Message
removing file listed as Deleting: duplicati-b7fd0cb0f23e741ebb56fbacb15e3c674.dblock.zip.aes
4 Dec 2017 03:36: Message
Renaming "duplicati-b7511cf4d558d4349bf7787c0a1df19f7.dblock.zip.aes" to "duplicati-b54d9f447feed4a9990082df177a100b2.dblock.zip.aes"
4 Dec 2017 03:36: Retry
Operation Put with file duplicati-b7511cf4d558d4349bf7787c0a1df19f7.dblock.zip.aes attempt 1 of 5 failed with message: The remote server returned an error: (500) Internal Server Error.
System.Net.WebException: The remote server returned an error: (500) Internal Server Error.
at Duplicati.Library.Utility.AsyncHttpRequest.AsyncWrapper.GetResponseOrStream()
at Duplicati.Library.Utility.AsyncHttpRequest.GetResponse()
at Duplicati.Library.JSONWebHelper.GetResponse(AsyncHttpRequest req, Object requestdata)
at Duplicati.Library.JSONWebHelper.PostMultipart(String url, Action`1 setup, MultipartItem[] parts)
at Duplicati.Library.JSONWebHelper.PostMultipartAndGetJSONData[T](String url, Action`1 setup, MultipartItem[] parts)
at Duplicati.Library.Backend.AmazonCloudDrive.AmzCD.Put(String remotename, Stream stream)
at Duplicati.Library.Main.BackendManager.DoPut(FileEntryItem item)
at Duplicati.Library.Main.BackendManager.ThreadRun()
4 Dec 2017 03:36: Message
Renaming "duplicati-b6f493bcf388149e1aca3e988c6fc4cbf.dblock.zip.aes" to "duplicati-ba709046aacb647d3873989852428df99.dblock.zip.aes"
4 Dec 2017 03:36: Retry
Operation Put with file duplicati-b6f493bcf388149e1aca3e988c6fc4cbf.dblock.zip.aes attempt 1 of 5 failed with message: Unable to write data to the transport connection: An existing connection was forcibly closed by the remote host.
System.IO.IOException: Unable to write data to the transport connection: An existing connection was forcibly closed by the remote host. ---> System.Net.Sockets.SocketException: An existing connection was forcibly closed by the remote host
at System.Net.Sockets.Socket.Send(Byte[] buffer, Int32 offset, Int32 size, SocketFlags socketFlags)
at System.Net.Sockets.NetworkStream.Write(Byte[] buffer, Int32 offset, Int32 size)
--- End of inner exception stack trace ---
at System.Net.Sockets.NetworkStream.Write(Byte[] buffer, Int32 offset, Int32 size)
at System.Net.Security._SslStream.StartWriting(Byte[] buffer, Int32 offset, Int32 count, AsyncProtocolRequest asyncRequest)
at System.Net.Security._SslStream.ProcessWrite(Byte[] buffer, Int32 offset, Int32 count, AsyncProtocolRequest asyncRequest)
at System.Net.TlsStream.Write(Byte[] buffer, Int32 offset, Int32 size)
at System.Net.ConnectStream.InternalWrite(Boolean async, Byte[] buffer, Int32 offset, Int32 size, AsyncCallback callback, Object state)
at System.Net.ConnectStream.Write(Byte[] buffer, Int32 offset, Int32 size)
at Duplicati.Library.Utility.Utility.CopyStream(Stream source, Stream target, Boolean tryRewindSource, Byte[] buf)
at Duplicati.Library.JSONWebHelper.PostMultipart(String url, Action`1 setup, MultipartItem[] parts)
at Duplicati.Library.JSONWebHelper.PostMultipartAndGetJSONData[T](String url, Action`1 setup, MultipartItem[] parts)
at Duplicati.Library.Backend.AmazonCloudDrive.AmzCD.Put(String remotename, Stream stream)
at Duplicati.Library.Main.BackendManager.DoPut(FileEntryItem item)
at Duplicati.Library.Main.BackendManager.ThreadRun()
4 Dec 2017 03:36: Message
Renaming "duplicati-ieff8d69a2e5e4ff08bf97eb9b2d91816.dindex.zip.aes" to "duplicati-iec7e0b0aa3da4850afc82ea6034f74a9.dindex.zip.aes"
4 Dec 2017 03:36: Retry
Operation Put with file duplicati-ieff8d69a2e5e4ff08bf97eb9b2d91816.dindex.zip.aes attempt 1 of 5 failed with message: The remote server returned an error: (429) Too Many Requests.
System.Net.WebException: The remote server returned an error: (429) Too Many Requests.
at Duplicati.Library.Utility.AsyncHttpRequest.AsyncWrapper.GetResponseOrStream()
at Duplicati.Library.Utility.AsyncHttpRequest.GetResponse()
at Duplicati.Library.JSONWebHelper.GetResponse(AsyncHttpRequest req, Object requestdata)
at Duplicati.Library.JSONWebHelper.PostMultipart(String url, Action`1 setup, MultipartItem[] parts)
at Duplicati.Library.JSONWebHelper.PostMultipartAndGetJSONData[T](String url, Action`1 setup, MultipartItem[] parts)
at Duplicati.Library.Backend.AmazonCloudDrive.AmzCD.Put(String remotename, Stream stream)
at Duplicati.Library.Main.BackendManager.DoPut(FileEntryItem item)
at Duplicati.Library.Main.BackendManager.ThreadRun()
4 Dec 2017 03:36: Message
Renaming "duplicati-b7fd0cb0f23e741ebb56fbacb15e3c674.dblock.zip.aes" to "duplicati-b8ee2c189153349b98f9de2eed5900ab5.dblock.zip.aes"
4 Dec 2017 03:36: Retry
Operation Put with file duplicati-b7fd0cb0f23e741ebb56fbacb15e3c674.dblock.zip.aes attempt 1 of 5 failed with message: The stream does not support concurrent IO read or write operations.
System.NotSupportedException: The stream does not support concurrent IO read or write operations.
at System.Net.ConnectStream.InternalWrite(Boolean async, Byte[] buffer, Int32 offset, Int32 size, AsyncCallback callback, Object state)
at System.Net.ConnectStream.Write(Byte[] buffer, Int32 offset, Int32 size)
at Duplicati.Library.Utility.Utility.CopyStream(Stream source, Stream target, Boolean tryRewindSource, Byte[] buf)
at Duplicati.Library.JSONWebHelper.PostMultipart(String url, Action`1 setup, MultipartItem[] parts)
at Duplicati.Library.JSONWebHelper.PostMultipartAndGetJSONData[T](String url, Action`1 setup, MultipartItem[] parts)
at Duplicati.Library.Backend.AmazonCloudDrive.AmzCD.Put(String remotename, Stream stream)
at Duplicati.Library.Main.BackendManager.DoPut(FileEntryItem item)
at Duplicati.Library.Main.BackendManager.ThreadRun()