Tywin
September 25, 2018, 5:30pm
1
Could I please get a second (third, fourth, etc.) set of eyes on this custom retention policy before I put it in place? I am currently keeping all versions, but I have been successfully running Duplicati for several months and would like to start thinning out old backups.
1M:U,1Y:1W,U:1M
I would like to keep all snapshots for one month, weekly snapshots for one year, and monthly snapshots forever. The schedule for this job is once daily in the wee hours of the morning. I am running 2.0.3.3_beta_2018-04-02.
ts678
September 25, 2018, 6:47pm
2
Looks right to these eyes, provided you know that timeframes are nested not sequential. 1Y ends at 1Y age. Rather than rely on reviewers, you can use the –dry-run option plus a high logging level to see its plan, e.g.
2018-09-16 08:21:57 -04 - [Information-Duplicati.Library.Main.Operation.DeleteHandler:RetentionPolicy-StartCheck]: Start checking if backups can be removed
2018-09-16 08:21:57 -04 - [Information-Duplicati.Library.Main.Operation.DeleteHandler:RetentionPolicy-FramesAndIntervals]: Time frames and intervals pairs: Unlimited / 1.00:00:00
2018-09-16 08:21:57 -04 - [Information-Duplicati.Library.Main.Operation.DeleteHandler:RetentionPolicy-BackupList]: Backups to consider: 9/14/2018 5:58:58 PM, 9/14/2018 5:51:03 PM, 9/14/2018 5:33:21 PM, 9/14/2018 5:11:09 PM, 9/14/2018 5:07:55 PM, 9/14/2018 5:00:34 PM, 9/14/2018 4:59:33 PM, 9/14/2018 4:53:42 PM, 9/13/2018 11:40:28 AM, 9/13/2018 11:36:28 AM, 9/13/2018 8:08:40 AM, 9/11/2018 10:03:48 PM
2018-09-16 08:21:57 -04 - [Profiling-Duplicati.Library.Main.Operation.DeleteHandler:RetentionPolicy-NextTimeAndFrame]: Next time frame and interval pair: Unlimited / 1.00:00:00
2018-09-16 08:21:57 -04 - [Profiling-Duplicati.Library.Main.Operation.DeleteHandler:RetentionPolicy-BackupsInFrame]: Backups in this time frame: 9/11/2018 10:03:48 PM, 9/13/2018 8:08:40 AM, 9/13/2018 11:36:28 AM, 9/13/2018 11:40:28 AM, 9/14/2018 4:53:42 PM, 9/14/2018 4:59:33 PM, 9/14/2018 5:00:34 PM, 9/14/2018 5:07:55 PM, 9/14/2018 5:11:09 PM, 9/14/2018 5:33:21 PM, 9/14/2018 5:51:03 PM, 9/14/2018 5:58:58 PM
2018-09-16 08:21:57 -04 - [Profiling-Duplicati.Library.Main.Operation.DeleteHandler:RetentionPolicy-KeepBackups]: Keeping backup: 9/11/2018 10:03:48 PM
2018-09-16 08:21:57 -04 - [Profiling-Duplicati.Library.Main.Operation.DeleteHandler:RetentionPolicy-KeepBackups]: Keeping backup: 9/13/2018 8:08:40 AM
2018-09-16 08:21:57 -04 - [Profiling-Duplicati.Library.Main.Operation.DeleteHandler:RetentionPolicy-DeletingBackups]: Deleting backup: 9/13/2018 11:36:28 AM
2018-09-16 08:21:57 -04 - [Profiling-Duplicati.Library.Main.Operation.DeleteHandler:RetentionPolicy-DeletingBackups]: Deleting backup: 9/13/2018 11:40:28 AM
2018-09-16 08:21:57 -04 - [Profiling-Duplicati.Library.Main.Operation.DeleteHandler:RetentionPolicy-KeepBackups]: Keeping backup: 9/14/2018 4:53:42 PM
2018-09-16 08:21:57 -04 - [Profiling-Duplicati.Library.Main.Operation.DeleteHandler:RetentionPolicy-DeletingBackups]: Deleting backup: 9/14/2018 4:59:33 PM
2018-09-16 08:21:57 -04 - [Profiling-Duplicati.Library.Main.Operation.DeleteHandler:RetentionPolicy-DeletingBackups]: Deleting backup: 9/14/2018 5:00:34 PM
2018-09-16 08:21:57 -04 - [Profiling-Duplicati.Library.Main.Operation.DeleteHandler:RetentionPolicy-DeletingBackups]: Deleting backup: 9/14/2018 5:07:55 PM
2018-09-16 08:21:57 -04 - [Profiling-Duplicati.Library.Main.Operation.DeleteHandler:RetentionPolicy-DeletingBackups]: Deleting backup: 9/14/2018 5:11:09 PM
2018-09-16 08:21:57 -04 - [Profiling-Duplicati.Library.Main.Operation.DeleteHandler:RetentionPolicy-DeletingBackups]: Deleting backup: 9/14/2018 5:33:21 PM
2018-09-16 08:21:57 -04 - [Profiling-Duplicati.Library.Main.Operation.DeleteHandler:RetentionPolicy-DeletingBackups]: Deleting backup: 9/14/2018 5:51:03 PM
2018-09-16 08:21:57 -04 - [Profiling-Duplicati.Library.Main.Operation.DeleteHandler:RetentionPolicy-DeletingBackups]: Deleting backup: 9/14/2018 5:58:58 PM
2018-09-16 08:21:57 -04 - [Information-Duplicati.Library.Main.Operation.DeleteHandler:RetentionPolicy-BackupsToDelete]: Backups outside of all time frames and thus getting deleted:
2018-09-16 08:21:57 -04 - [Information-Duplicati.Library.Main.Operation.DeleteHandler:RetentionPolicy-AllBackupsToDelete]: All backups to delete: 9/14/2018 5:58:58 PM, 9/14/2018 5:51:03 PM, 9/14/2018 5:33:21 PM, 9/14/2018 5:11:09 PM, 9/14/2018 5:07:55 PM, 9/14/2018 5:00:34 PM, 9/14/2018 4:59:33 PM, 9/13/2018 11:40:28 AM, 9/13/2018 11:36:28 AM
2018-09-16 08:21:57 -04 - [Information-Duplicati.Library.Main.Operation.DeleteHandler-DeleteRemoteFileset]: Deleting 9 remote fileset(s) ...
...
2018-09-16 08:21:57 -04 - [DryRun-Duplicati.Library.Main.Operation.DeleteHandler-WouldDeleteRemoteFileset]: Would delete remote fileset: duplicati-20180913T153628Z.dlist.zip
2018-09-16 08:21:57 -04 - [DryRun-Duplicati.Library.Main.Operation.DeleteHandler-WouldDeleteRemoteFileset]: Would delete remote fileset: duplicati-20180913T154028Z.dlist.zip
2018-09-16 08:21:57 -04 - [DryRun-Duplicati.Library.Main.Operation.DeleteHandler-WouldDeleteRemoteFileset]: Would delete remote fileset: duplicati-20180914T205933Z.dlist.zip
2018-09-16 08:21:57 -04 - [DryRun-Duplicati.Library.Main.Operation.DeleteHandler-WouldDeleteRemoteFileset]: Would delete remote fileset: duplicati-20180914T210034Z.dlist.zip
2018-09-16 08:21:57 -04 - [DryRun-Duplicati.Library.Main.Operation.DeleteHandler-WouldDeleteRemoteFileset]: Would delete remote fileset: duplicati-20180914T210755Z.dlist.zip
2018-09-16 08:21:57 -04 - [DryRun-Duplicati.Library.Main.Operation.DeleteHandler-WouldDeleteRemoteFileset]: Would delete remote fileset: duplicati-20180914T211109Z.dlist.zip
2018-09-16 08:21:57 -04 - [DryRun-Duplicati.Library.Main.Operation.DeleteHandler-WouldDeleteRemoteFileset]: Would delete remote fileset: duplicati-20180914T213321Z.dlist.zip
2018-09-16 08:21:57 -04 - [DryRun-Duplicati.Library.Main.Operation.DeleteHandler-WouldDeleteRemoteFileset]: Would delete remote fileset: duplicati-20180914T215103Z.dlist.zip
2018-09-16 08:21:57 -04 - [DryRun-Duplicati.Library.Main.Operation.DeleteHandler-WouldDeleteRemoteFileset]: Would delete remote fileset: duplicati-20180914T215858Z.dlist.zip
2018-09-16 08:21:57 -04 - [Profiling-Timer.Begin-Duplicati.Library.Main.BackendManager-RemoteOperationTerminate]: Starting - RemoteOperationTerminate
2018-09-16 08:21:57 -04 - [Profiling-Timer.Finished-Duplicati.Library.Main.BackendManager-RemoteOperationTerminate]: RemoteOperationTerminate took 0:00:00:00.000
2018-09-16 08:21:57 -04 - [DryRun-Duplicati.Library.Main.Operation.DeleteHandler-WouldDeleteResults]: 9 remote fileset(s) would be deleted
2018-09-16 08:21:57 -04 - [DryRun-Duplicati.Library.Main.Operation.DeleteHandler-WouldDeleteHelp]: Remove --dry-run to actually delete files
Unless you want to go all the way to Profiling (which can be very wordy), an Information level server log can be viewed using MENU --> About --> Show log --> Live --> Information. For Profiling, –log-file may be better.