Problem with my retention policy: 2M:1D,12M:1M,U:1Y . Every week one of backup was deleted

Support
1

Hello!

I setuped such retention policy: “2M:1D,12M:1M,U:1Y”. But unfortunately this backup sometimes deleted backup. I expects that I’ll have every day backup due 2 months.

There is my improvement day-by-day log:

16.11.2021:
0	: 15.11.2021 23:00:05 (121502 files, 145,86 GB)
1	: 12.11.2021 23:00:04 (121487 files, 145,83 GB)
2	: 11.11.2021 23:00:02 (121828 files, 145,70 GB)
3	: 07.11.2021 23:00:02 (121263 files, 145,23 GB)
4	: 30.10.2021 23:00:04 (121181 files, 145,12 GB)
5	: 23.10.2021 23:00:02 (120884 files, 144,82 GB)
6	: 16.10.2021 23:00:02 (120846 files, 144,72 GB)
7	: 09.10.2021 23:00:02 (121213 files, 144,29 GB)
8	: 02.10.2021 23:00:02 (120613 files, 143,26 GB)
9	: 25.09.2021 23:00:02 (119884 files, 140,61 GB)
10	: 14.09.2021 23:00:03 (119725 files, 140,45 GB)
11	: 19.08.2021 9:14:30 (108518 files, 146,32 GB)
12	: 18.07.2021 23:00:05 (108620 files, 138,29 GB)
13	: 10.06.2021 23:00:04 (108372 files, 138,18 GB)
14	: 04.05.2021 23:00:03 (106882 files, 137,40 GB)
15	: 29.03.2021 23:00:04 (106294 files, 137,05 GB)
16	: 20.02.2021 23:00:07 (91221 files, 118,55 GB)
17	: 14.01.2021 23:00:04 (98695 files, 156,23 GB)
18	: 07.12.2020 23:00:04 (98236 files, 152,63 GB)
19	: 18.08.2020 23:00:01 (98262 files, 130,92 GB)

17.11.2021
0	: 16.11.2021 23:00:05 (121542 files, 146,31 GB)
1	: 15.11.2021 23:00:05 (121502 files, 145,86 GB)
2	: 12.11.2021 23:00:04 (121487 files, 145,83 GB)
3	: 11.11.2021 23:00:02 (121828 files, 145,70 GB)
4	: 07.11.2021 23:00:02 (121263 files, 145,23 GB)
5	: 30.10.2021 23:00:04 (121181 files, 145,12 GB)
6	: 23.10.2021 23:00:02 (120884 files, 144,82 GB)
7	: 16.10.2021 23:00:02 (120846 files, 144,72 GB)
8	: 09.10.2021 23:00:02 (121213 files, 144,29 GB)
9	: 02.10.2021 23:00:02 (120613 files, 143,26 GB)
10	: 25.09.2021 23:00:02 (119884 files, 140,61 GB)
11	: 14.09.2021 23:00:03 (119725 files, 140,45 GB)
12	: 19.08.2021 9:14:30 (108518 files, 146,32 GB)
13	: 18.07.2021 23:00:05 (108620 files, 138,29 GB)
14	: 10.06.2021 23:00:04 (108372 files, 138,18 GB)
15	: 04.05.2021 23:00:03 (106882 files, 137,40 GB)
16	: 29.03.2021 23:00:04 (106294 files, 137,05 GB)
17	: 20.02.2021 23:00:07 (91221 files, 118,55 GB)
18	: 14.01.2021 23:00:04 (98695 files, 156,23 GB)
19	: 07.12.2020 23:00:04 (98236 files, 152,63 GB)
20	: 18.08.2020 23:00:01 (98262 files, 130,92 GB)

18.11.2021
0	: 17.11.2021 23:00:04 (121598 files, 146,32 GB)
1	: 16.11.2021 23:00:05 (121542 files, 146,31 GB)
2	: 15.11.2021 23:00:05 (121502 files, 145,86 GB)
3	: 12.11.2021 23:00:04 (121487 files, 145,83 GB)
4	: 11.11.2021 23:00:02 (121828 files, 145,70 GB)
5	: 07.11.2021 23:00:02 (121263 files, 145,23 GB)
6	: 30.10.2021 23:00:04 (121181 files, 145,12 GB)
7	: 23.10.2021 23:00:02 (120884 files, 144,82 GB)
8	: 16.10.2021 23:00:02 (120846 files, 144,72 GB)
9	: 09.10.2021 23:00:02 (121213 files, 144,29 GB)
10	: 02.10.2021 23:00:02 (120613 files, 143,26 GB)
11	: 25.09.2021 23:00:02 (119884 files, 140,61 GB)
12	: 14.09.2021 23:00:03 (119725 files, 140,45 GB)
13	: 19.08.2021 9:14:30 (108518 files, 146,32 GB)
14	: 18.07.2021 23:00:05 (108620 files, 138,29 GB)
15	: 10.06.2021 23:00:04 (108372 files, 138,18 GB)
16	: 04.05.2021 23:00:03 (106882 files, 137,40 GB)
17	: 29.03.2021 23:00:04 (106294 files, 137,05 GB)
18	: 20.02.2021 23:00:07 (91221 files, 118,55 GB)
19	: 14.01.2021 23:00:04 (98695 files, 156,23 GB)
20	: 07.12.2020 23:00:04 (98236 files, 152,63 GB)
21	: 18.08.2020 23:00:01 (98262 files, 130,92 GB)

19.11.2021
0	: 18.11.2021 23:00:04 (121624 files, 146,63 GB)
1	: 16.11.2021 23:00:05 (121542 files, 146,31 GB)
2	: 15.11.2021 23:00:05 (121502 files, 145,86 GB)
3	: 12.11.2021 23:00:04 (121487 files, 145,83 GB)
4	: 11.11.2021 23:00:02 (121828 files, 145,70 GB)
5	: 07.11.2021 23:00:02 (121263 files, 145,23 GB)
6	: 30.10.2021 23:00:04 (121181 files, 145,12 GB)
7	: 23.10.2021 23:00:02 (120884 files, 144,82 GB)
8	: 16.10.2021 23:00:02 (120846 files, 144,72 GB)
9	: 09.10.2021 23:00:02 (121213 files, 144,29 GB)
10	: 02.10.2021 23:00:02 (120613 files, 143,26 GB)
11	: 25.09.2021 23:00:02 (119884 files, 140,61 GB)
12	: 14.09.2021 23:00:03 (119725 files, 140,45 GB)
13	: 19.08.2021 9:14:30 (108518 files, 146,32 GB)
14	: 18.07.2021 23:00:05 (108620 files, 138,29 GB)
15	: 10.06.2021 23:00:04 (108372 files, 138,18 GB)
16	: 04.05.2021 23:00:03 (106882 files, 137,40 GB)
17	: 29.03.2021 23:00:04 (106294 files, 137,05 GB)
18	: 20.02.2021 23:00:07 (91221 files, 118,55 GB)
19	: 14.01.2021 23:00:04 (98695 files, 156,23 GB)
20	: 07.12.2020 23:00:04 (98236 files, 152,63 GB)
21	: 18.08.2020 23:00:01 (98262 files, 130,92 GB)

20.11.2021
0	: 19.11.2021 23:00:04 (121644 files, 147,03 GB)
1	: 18.11.2021 23:00:04 (121624 files, 146,63 GB)
2	: 16.11.2021 23:00:05 (121542 files, 146,31 GB)
3	: 15.11.2021 23:00:05 (121502 files, 145,86 GB)
4	: 12.11.2021 23:00:04 (121487 files, 145,83 GB)
5	: 11.11.2021 23:00:02 (121828 files, 145,70 GB)
6	: 07.11.2021 23:00:02 (121263 files, 145,23 GB)
7	: 30.10.2021 23:00:04 (121181 files, 145,12 GB)
8	: 23.10.2021 23:00:02 (120884 files, 144,82 GB)
9	: 16.10.2021 23:00:02 (120846 files, 144,72 GB)
10	: 09.10.2021 23:00:02 (121213 files, 144,29 GB)
11	: 02.10.2021 23:00:02 (120613 files, 143,26 GB)
12	: 25.09.2021 23:00:02 (119884 files, 140,61 GB)
13	: 14.09.2021 23:00:03 (119725 files, 140,45 GB)
14	: 19.08.2021 9:14:30 (108518 files, 146,32 GB)
15	: 18.07.2021 23:00:05 (108620 files, 138,29 GB)
16	: 10.06.2021 23:00:04 (108372 files, 138,18 GB)
17	: 04.05.2021 23:00:03 (106882 files, 137,40 GB)
18	: 29.03.2021 23:00:04 (106294 files, 137,05 GB)
19	: 20.02.2021 23:00:07 (91221 files, 118,55 GB)
20	: 14.01.2021 23:00:04 (98695 files, 156,23 GB)
21	: 07.12.2020 23:00:04 (98236 files, 152,63 GB)
22	: 18.08.2020 23:00:01 (98262 files, 130,92 GB)

21.11.2021
0	: 20.11.2021 23:00:04 (121649 files, 147,03 GB)
1	: 19.11.2021 23:00:04 (121644 files, 147,03 GB)
2	: 18.11.2021 23:00:04 (121624 files, 146,63 GB)
3	: 16.11.2021 23:00:05 (121542 files, 146,31 GB)
4	: 15.11.2021 23:00:05 (121502 files, 145,86 GB)
5	: 12.11.2021 23:00:04 (121487 files, 145,83 GB)
6	: 11.11.2021 23:00:02 (121828 files, 145,70 GB)
7	: 07.11.2021 23:00:02 (121263 files, 145,23 GB)
8	: 30.10.2021 23:00:04 (121181 files, 145,12 GB)
9	: 23.10.2021 23:00:02 (120884 files, 144,82 GB)
10	: 16.10.2021 23:00:02 (120846 files, 144,72 GB)
11	: 09.10.2021 23:00:02 (121213 files, 144,29 GB)
12	: 02.10.2021 23:00:02 (120613 files, 143,26 GB)
13	: 25.09.2021 23:00:02 (119884 files, 140,61 GB)
14	: 14.09.2021 23:00:03 (119725 files, 140,45 GB)
15	: 19.08.2021 9:14:30 (108518 files, 146,32 GB)
16	: 18.07.2021 23:00:05 (108620 files, 138,29 GB)
17	: 10.06.2021 23:00:04 (108372 files, 138,18 GB)
18	: 04.05.2021 23:00:03 (106882 files, 137,40 GB)
19	: 29.03.2021 23:00:04 (106294 files, 137,05 GB)
20	: 20.02.2021 23:00:07 (91221 files, 118,55 GB)
21	: 14.01.2021 23:00:04 (98695 files, 156,23 GB)
22	: 07.12.2020 23:00:04 (98236 files, 152,63 GB)
23	: 18.08.2020 23:00:01 (98262 files, 130,92 GB)

22.11.2021
0	: 21.11.2021 23:00:12 (121653 files, 147,03 GB)
1	: 20.11.2021 23:00:04 (121649 files, 147,03 GB)
2	: 19.11.2021 23:00:04 (121644 files, 147,03 GB)
3	: 18.11.2021 23:00:04 (121624 files, 146,63 GB)
4	: 16.11.2021 23:00:05 (121542 files, 146,31 GB)
5	: 15.11.2021 23:00:05 (121502 files, 145,86 GB)
6	: 12.11.2021 23:00:04 (121487 files, 145,83 GB)
7	: 11.11.2021 23:00:02 (121828 files, 145,70 GB)
8	: 07.11.2021 23:00:02 (121263 files, 145,23 GB)
9	: 30.10.2021 23:00:04 (121181 files, 145,12 GB)
10	: 23.10.2021 23:00:02 (120884 files, 144,82 GB)
11	: 16.10.2021 23:00:02 (120846 files, 144,72 GB)
12	: 09.10.2021 23:00:02 (121213 files, 144,29 GB)
13	: 02.10.2021 23:00:02 (120613 files, 143,26 GB)
14	: 25.09.2021 23:00:02 (119884 files, 140,61 GB)
15	: 14.09.2021 23:00:03 (119725 files, 140,45 GB)
16	: 19.08.2021 9:14:30 (108518 files, 146,32 GB)
17	: 18.07.2021 23:00:05 (108620 files, 138,29 GB)
18	: 10.06.2021 23:00:04 (108372 files, 138,18 GB)
19	: 04.05.2021 23:00:03 (106882 files, 137,40 GB)
20	: 29.03.2021 23:00:04 (106294 files, 137,05 GB)
21	: 20.02.2021 23:00:07 (91221 files, 118,55 GB)
22	: 14.01.2021 23:00:04 (98695 files, 156,23 GB)
23	: 07.12.2020 23:00:04 (98236 files, 152,63 GB)
24	: 18.08.2020 23:00:01 (98262 files, 130,92 GB)

23.11.2021
0	: 22.11.2021 23:00:08 (121662 files, 147,03 GB)
1	: 21.11.2021 23:00:12 (121653 files, 147,03 GB)
2	: 20.11.2021 23:00:04 (121649 files, 147,03 GB)
3	: 19.11.2021 23:00:04 (121644 files, 147,03 GB)
4	: 18.11.2021 23:00:04 (121624 files, 146,63 GB)
5	: 16.11.2021 23:00:05 (121542 files, 146,31 GB)
6	: 15.11.2021 23:00:05 (121502 files, 145,86 GB)
7	: 12.11.2021 23:00:04 (121487 files, 145,83 GB)
8	: 11.11.2021 23:00:02 (121828 files, 145,70 GB)
9	: 07.11.2021 23:00:02 (121263 files, 145,23 GB)
10	: 30.10.2021 23:00:04 (121181 files, 145,12 GB)
11	: 23.10.2021 23:00:02 (120884 files, 144,82 GB)
12	: 16.10.2021 23:00:02 (120846 files, 144,72 GB)
13	: 09.10.2021 23:00:02 (121213 files, 144,29 GB)
14	: 02.10.2021 23:00:02 (120613 files, 143,26 GB)
15	: 25.09.2021 23:00:02 (119884 files, 140,61 GB)
16	: 14.09.2021 23:00:03 (119725 files, 140,45 GB)
17	: 19.08.2021 9:14:30 (108518 files, 146,32 GB)
18	: 18.07.2021 23:00:05 (108620 files, 138,29 GB)
19	: 10.06.2021 23:00:04 (108372 files, 138,18 GB)
20	: 04.05.2021 23:00:03 (106882 files, 137,40 GB)
21	: 29.03.2021 23:00:04 (106294 files, 137,05 GB)
22	: 20.02.2021 23:00:07 (91221 files, 118,55 GB)
23	: 14.01.2021 23:00:04 (98695 files, 156,23 GB)
24	: 07.12.2020 23:00:04 (98236 files, 152,63 GB)
25	: 18.08.2020 23:00:01 (98262 files, 130,92 GB)

24.11.2021
0	: 23.11.2021 23:00:08 (121675 files, 147,03 GB)
1	: 21.11.2021 23:00:12 (121653 files, 147,03 GB)
2	: 20.11.2021 23:00:04 (121649 files, 147,03 GB)
3	: 19.11.2021 23:00:04 (121644 files, 147,03 GB)
4	: 18.11.2021 23:00:04 (121624 files, 146,63 GB)
5	: 16.11.2021 23:00:05 (121542 files, 146,31 GB)
6	: 15.11.2021 23:00:05 (121502 files, 145,86 GB)
7	: 12.11.2021 23:00:04 (121487 files, 145,83 GB)
8	: 11.11.2021 23:00:02 (121828 files, 145,70 GB)
9	: 07.11.2021 23:00:02 (121263 files, 145,23 GB)
10	: 30.10.2021 23:00:04 (121181 files, 145,12 GB)
11	: 23.10.2021 23:00:02 (120884 files, 144,82 GB)
12	: 16.10.2021 23:00:02 (120846 files, 144,72 GB)
13	: 09.10.2021 23:00:02 (121213 files, 144,29 GB)
14	: 02.10.2021 23:00:02 (120613 files, 143,26 GB)
15	: 25.09.2021 23:00:02 (119884 files, 140,61 GB)
16	: 14.09.2021 23:00:03 (119725 files, 140,45 GB)
17	: 19.08.2021 9:14:30 (108518 files, 146,32 GB)
18	: 18.07.2021 23:00:05 (108620 files, 138,29 GB)
19	: 10.06.2021 23:00:04 (108372 files, 138,18 GB)
20	: 04.05.2021 23:00:03 (106882 files, 137,40 GB)
21	: 29.03.2021 23:00:04 (106294 files, 137,05 GB)
22	: 20.02.2021 23:00:07 (91221 files, 118,55 GB)
23	: 14.01.2021 23:00:04 (98695 files, 156,23 GB)
24	: 07.12.2020 23:00:04 (98236 files, 152,63 GB)
25	: 18.08.2020 23:00:01 (98262 files, 130,92 GB)
2

Looks like you are running your backups daily. The “2M:1D” part of your retention policy may give you unexpected results due to subtle timing differences between backup runs. Duplicati may detect that more than one backup set exists within the same 1D (24 hour) period and will therefore prune of your backups.

I suggest you use “2M:U” at the start of your retention policy to work around this issue.

Duplicati seems to be keeping one backup per week earlier in November and in October. Since that is less than 2 months ago, I’m going to guess you recently changed your retention policy? It looks like it may have been set to keep only one per week after a couple weeks or something.

1 Like
3

is it unlimited? every year during life?

4

The OP’s retention policy of 2M:1D,12M:1M,U:1Y means:

  • For the most recent 2 months, keep 1 backup per day
  • Beyond that, for the most recent 12 months, keep 1 backup per month
  • Beyond that, for an unlimited amount of time, keep 1 backup per year
2 Likes
5

Thank you. Yes, you’re right. Before I used the Smart backup retention".

Thank you. Of course, I will have a more backups if I’ll run the more than one time per day, but it’s OK.