DST shift and duplicate time stamps

Marc_Neiger · November 5, 2017, 10:13pm

The daylight saving time seems to have triggered duplicate backup time stamps.
The backup now complains about duplicate time stamp since 29/10/17 02:00, whand DST changed in France. Backup was every hour.

System is windows 7 x64.

Nov 5, 2017 10:08 PM: Failed while executing "Backup" with id: 3
System.Exception: List of backup timestamps contains duplicates: 05/11/2017 20:58:09, 05/11/2017 19:00:00, 05/11/2017 18:00:00, 05/11/2017 17:00:00, 05/11/2017 16:00:00, 05/11/2017 15:00:00, 05/11/2017 14:00:00, 05/11/2017 13:45:32, 05/11/2017 13:34:30, 05/11/2017 12:58:59, 05/11/2017 11:00:00, 05/11/2017 10:00:00, 05/11/2017 09:00:00, 05/11/2017 08:00:00, 05/11/2017 07:00:00, 05/11/2017 06:00:00, 05/11/2017 05:00:00, 05/11/2017 04:00:00, 05/11/2017 03:00:00, 05/11/2017 02:00:00, 05/11/2017 01:00:00, 05/11/2017 00:00:00, 04/11/2017 23:00:00, 04/11/2017 22:36:11, 04/11/2017 22:01:08, 04/11/2017 20:29:38, 04/11/2017 20:14:05, 02/11/2017 23:00:00, 02/11/2017 22:00:00, 02/11/2017 21:00:00, 02/11/2017 20:00:00, 02/11/2017 19:00:00, 02/11/2017 18:00:00, 02/11/2017 17:00:00, 02/11/2017 16:00:00, 02/11/2017 15:00:00, 02/11/2017 14:00:00, 02/11/2017 13:00:00, 02/11/2017 12:00:00, 02/11/2017 11:00:00, 02/11/2017 10:00:00, 02/11/2017 09:00:00, 02/11/2017 08:00:00, 02/11/2017 07:00:00, 02/11/2017 06:00:00, 02/11/2017 05:00:00, 02/11/2017 04:00:00, 02/11/2017 03:00:00, 02/11/2017 02:00:00, 02/11/2017 01:00:00, 02/11/2017 00:02:25, 01/11/2017 23:00:00, 01/11/2017 22:00:00, 01/11/2017 21:00:00, 01/11/2017 20:00:00, 01/11/2017 19:00:00, 01/11/2017 18:00:00, 01/11/2017 17:00:00, 01/11/2017 16:00:00, 01/11/2017 15:00:00, 01/11/2017 14:00:00, 01/11/2017 13:00:00, 01/11/2017 12:00:00, 01/11/2017 11:00:00, 01/11/2017 10:00:00, 01/11/2017 09:00:00, 01/11/2017 08:00:00, 01/11/2017 07:00:00, 01/11/2017 06:00:00, 01/11/2017 05:00:00, 01/11/2017 04:00:00, 01/11/2017 03:00:00, 01/11/2017 02:00:00, 01/11/2017 01:00:00, 01/11/2017 00:02:43, 31/10/2017 23:00:00, 31/10/2017 22:00:00, 31/10/2017 21:00:00, 31/10/2017 20:00:00, 31/10/2017 19:00:00, 31/10/2017 18:00:00, 31/10/2017 17:00:00, 31/10/2017 16:00:00, 31/10/2017 15:00:00, 31/10/2017 14:00:00, 31/10/2017 13:00:00, 31/10/2017 12:00:00, 31/10/2017 11:00:00, 31/10/2017 10:00:00, 31/10/2017 09:00:00, 31/10/2017 08:00:00, 31/10/2017 07:00:00, 31/10/2017 06:00:00, 31/10/2017 05:00:00, 31/10/2017 04:00:00, 31/10/2017 03:00:00, 31/10/2017 02:00:00, 31/10/2017 01:00:00, 31/10/2017 00:02:26, 30/10/2017 23:00:00, 30/10/2017 22:00:00, 30/10/2017 21:00:00, 30/10/2017 20:00:00, 30/10/2017 19:00:00, 30/10/2017 18:00:00, 30/10/2017 17:00:00, 30/10/2017 16:00:00, 30/10/2017 15:00:00, 30/10/2017 14:00:00, 30/10/2017 13:00:00, 30/10/2017 12:00:00, 30/10/2017 11:00:00, 30/10/2017 10:00:00, 30/10/2017 09:00:00, 30/10/2017 08:00:00, 30/10/2017 07:00:00, 30/10/2017 06:00:00, 30/10/2017 05:00:00, 30/10/2017 04:00:00, 30/10/2017 03:00:00, 30/10/2017 02:00:00, 30/10/2017 01:00:00, 30/10/2017 00:03:50, 29/10/2017 23:00:00, 29/10/2017 22:00:00, 29/10/2017 21:00:00, 29/10/2017 20:00:00, 29/10/2017 19:00:00, 29/10/2017 18:00:00, 29/10/2017 17:00:00, 29/10/2017 16:00:00, 29/10/2017 15:00:00, 29/10/2017 14:00:00, 29/10/2017 13:00:00, 29/10/2017 12:00:00, 29/10/2017 11:00:00, 29/10/2017 10:00:00, 29/10/2017 09:00:00, 29/10/2017 08:00:00, 29/10/2017 07:00:00, 29/10/2017 06:00:00, 29/10/2017 05:00:00, 29/10/2017 04:00:00, 29/10/2017 03:00:00, 29/10/2017 02:00:00, 29/10/2017 02:00:00, 29/10/2017 01:02:44, 29/10/2017 00:00:00, 28/10/2017 23:00:00, 28/10/2017 22:00:00, 28/10/2017 21:00:00, 28/10/2017 20:00:00, 28/10/2017 19:00:00, 28/10/2017 18:00:00, 28/10/2017 17:00:00, 28/10/2017 16:00:01, 28/10/2017 15:00:00, 28/10/2017 14:00:00, 28/10/2017 13:00:00, 28/10/2017 12:00:00, 28/10/2017 11:00:00, 28/10/2017 10:00:00, 28/10/2017 09:00:00, 28/10/2017 08:00:00, 28/10/2017 07:00:00, 28/10/2017 06:00:00, 28/10/2017 05:00:00, 28/10/2017 04:00:00, 28/10/2017 03:00:00, 28/10/2017 02:00:00, 28/10/2017 01:02:15, 28/10/2017 00:00:00, 27/10/2017 23:00:00, 27/10/2017 22:00:00, 27/10/2017 21:00:00, 27/10/2017 20:00:00, 27/10/2017 19:00:00, 27/10/2017 18:00:00, 27/10/2017 17:00:00, 27/10/2017 16:00:00, 27/10/2017 15:00:00, 27/10/2017 14:00:00, 27/10/2017 13:00:00, 27/10/2017 12:00:00, 27/10/2017 11:00:00, 27/10/2017 10:00:00, 27/10/2017 09:00:00, 27/10/2017 08:00:00, 27/10/2017 07:00:00, 27/10/2017 06:00:00, 27/10/2017 05:00:00, 27/10/2017 04:00:00, 27/10/2017 03:00:00, 27/10/2017 02:00:00, 27/10/2017 01:02:16, 27/10/2017 00:00:00, 26/10/2017 23:00:00, 26/10/2017 22:00:00, 26/10/2017 20:00:00, 26/10/2017 19:00:00, 26/10/2017 18:00:00, 26/10/2017 17:00:00, 26/10/2017 16:00:00, 26/10/2017 15:00:00, 26/10/2017 14:00:00, 26/10/2017 13:00:00, 26/10/2017 12:00:00, 26/10/2017 11:00:00, 26/10/2017 10:00:00, 26/10/2017 09:00:00, 26/10/2017 08:00:00, 26/10/2017 07:00:00, 26/10/2017 06:00:00, 26/10/2017 05:00:00, 26/10/2017 04:00:00, 26/10/2017 03:00:00, 26/10/2017 02:00:00, 26/10/2017 01:02:20, 26/10/2017 00:00:00, 25/10/2017 23:00:00, 25/10/2017 22:00:00, 25/10/2017 21:00:00, 25/10/2017 20:00:00, 25/10/2017 19:00:00, 25/10/2017 18:00:00, 25/10/2017 17:00:00, 25/10/2017 16:00:00, 25/10/2017 15:00:00, 25/10/2017 14:00:00, 25/10/2017 13:00:00, 25/10/2017 12:00:00, 25/10/2017 11:00:00, 25/10/2017 10:00:00, 25/10/2017 09:00:00, 25/10/2017 08:00:00, 25/10/2017 07:00:00, 25/10/2017 06:00:00, 25/10/2017 05:00:00, 25/10/2017 04:00:00, 25/10/2017 03:00:00, 25/10/2017 02:00:00, 25/10/2017 01:02:57, 25/10/2017 00:00:00, 24/10/2017 23:00:00, 24/10/2017 22:00:00, 24/10/2017 21:00:00, 24/10/2017 20:00:00, 24/10/2017 19:00:00, 24/10/2017 18:00:00, 24/10/2017 17:00:00, 24/10/2017 16:00:00, 24/10/2017 15:00:00, 24/10/2017 14:00:00, 24/10/2017 13:00:00, 24/10/2017 12:00:00, 24/10/2017 11:00:00, 24/10/2017 10:00:00, 24/10/2017 09:00:00, 24/10/2017 08:00:00, 24/10/2017 07:00:00, 24/10/2017 06:00:00, 24/10/2017 05:00:00, 24/10/2017 04:00:00, 24/10/2017 03:00:00, 24/10/2017 02:00:00, 24/10/2017 01:01:35, 24/10/2017 00:00:00, 23/10/2017 23:00:00, 23/10/2017 22:00:00, 23/10/2017 21:00:00, 23/10/2017 20:00:00, 23/10/2017 19:00:00, 23/10/2017 18:00:00, 23/10/2017 17:00:00, 23/10/2017 16:00:00, 23/10/2017 15:00:00, 23/10/2017 14:00:00, 23/10/2017 13:00:00, 23/10/2017 12:00:00, 23/10/2017 11:00:00, 23/10/2017 10:00:00, 23/10/2017 09:00:00, 23/10/2017 08:00:00, 23/10/2017 07:00:00, 23/10/2017 06:00:00, 23/10/2017 05:00:00, 23/10/2017 04:00:00, 23/10/2017 03:00:00, 23/10/2017 02:00:00, 23/10/2017 01:02:39, 23/10/2017 00:00:00, 22/10/2017 23:00:00, 22/10/2017 22:00:01, 22/10/2017 21:00:00, 22/10/2017 20:00:00, 22/10/2017 19:00:00, 22/10/2017 18:00:00, 22/10/2017 17:00:00, 22/10/2017 16:00:00, 22/10/2017 15:00:00, 22/10/2017 14:00:00, 22/10/2017 13:00:00, 22/10/2017 12:00:00, 22/10/2017 11:00:00, 22/10/2017 10:30:17, 22/10/2017 10:23:57, 18/10/2017 15:48:54, 18/10/2017 15:46:01
   à Duplicati.Library.Main.Options.GetFilesetsToDelete(DateTime[] backups)
   à Duplicati.Library.Main.Operation.DeleteHandler.DoRun(LocalDeleteDatabase db, IDbTransaction& transaction, Boolean hasVerifiedBacked, Boolean forceCompact)
   à Duplicati.Library.Main.Operation.BackupHandler.CompactIfRequired(BackendManager backend, Int64 lastVolumeSize)
   à Duplicati.Library.Main.Operation.BackupHandler.Run(String[] sources, IFilter filter)
   à Duplicati.Library.Main.Controller.<>c__DisplayClass16_0.<Backup>b__0(BackupResults result)
   à Duplicati.Library.Main.Controller.RunAction[T](T result, String[]& paths, IFilter& filter, Action`1 method)
   à Duplicati.Library.Main.Controller.Backup(String[] inputsources, IFilter filter)
   à Duplicati.Server.Runner.Run(IRunnerData data, Boolean fromQueue)

tophee · November 5, 2017, 11:56pm

I edited your post to improve the formating. (Just added ~~~ before and after the output you pasted, please see here for details).

kenkendk · November 10, 2017, 11:46am

Did you recover from this?

The remote timestamps (the filenames) are in UTC so they are not affected by DST, but the internal checking converts them to local times first, which causes the problem.

Marc_Neiger · November 10, 2017, 1:10pm

Hi @tophee, thanks for the reformatting, I’ll pay attention next time.
Kenken, thanks for enquiring.
As I’m in the early deployment process, I first tried to repair and rebuild but since it did not work I simply did a new backup.
Cheers