How to see list of backed up files per version?

As to why this info isn’t making it into the email, that is a good question

Indeed, let’s wait for the answer to THIS question :slight_smile:

–verbose above shows every file looked at.

Well, than it’s not really useful as nowadays folders contain myriads of files.

I’ve got a nice little script on Windows. If you are a scriptor who would like to Linuxify it, I’d be glad ot share.

Regrettably I cannot do that.

Are you wanting to know every file in a version that would be recovered if you were to restore from that version or are you looking for a list of what files were added / updated / deleted in a specific version compared to another (such as the previous) version?

Correct. Actually, I’d like the backup process to be more transparent. Now Duplicati works as a black box. It would be a great chance to check that things goes well if the list of added/updated/deleted files was somehow accessible.

It is indeed available already - it’s just hiding on the --compare command.

It can be run via the “Commandline…” feature of the GUI as shown here:

Or from the command line as discussed here:

In both cases you may find --full-result gives you slightly cleaner results than --verbose.

Let us know if either of these works out for you. :slight_smile:

1 Like

And now you’ve helped me clean up my script. Thanks @JonMikelV!!!

It is indeed available already - it’s just hiding on the --compare command.

Well, not really :slight_smile:

  1. When I open that “commandline” URL for a particular backup job, there is no way to see the database path while it’s compulsory for “compare” command. Could you make it more smart and automatically include “–dbpath=/Users/haron/.config/Duplicati/XXX.sqlite” as the first line in the “Commandline arugments” box? Maybe for all commands (easier for implementation), maybe just for “compare” (easier for users).

  2. After just a couple of seconds I can see A HUGE list of files which ends with some statistics:

  Added files:       56
  Deleted folders:   396
  Deleted files:     7162
  Modified folders:  18
  Modified files:    53

However, I don’t see anything except approx 2000 lines of deleted files. It seems, all the other lines are lost, or maybe there is not a vertical scroller. I suppose. Moreover, the path of each file is so long that it can’t be visible without horizontal scrolling. Which is hardly possible taking into account height of the list.
To sum up, what I’m trying to say is that the output window is too high and too narrow at the same time, and has no vertical scroller. Maybe it’s a good idea to provide an option to export output as a text file. In such a case it would be absolutely easy to open in any viewer and analyse.

  1. Why not just put list of changes into the task log (in case of --verbose=on, of course)?

Yeah, in large delta jobs the change list can be longer than the web buffer.

I’ll see if I can provide something for you in a few hours that can output a text file or email for you. Otherwise a direct Duplicati.CommandLine.exe call may be the only way to go.

Unfortunately, this command line function doesn’t work:

Input command: compare
Input arguments: 
	file:///Volumes/auto/Hermes/?auth-username=backup&auth-password=2A%Try

Input options: 
dbpath: /Users/haron/.config/Duplicati/XXXXX.sqlite
all-versions: false
backup-test-samples: 0
thread-priority: idle
verbose: true
disable-autocreate-folder: true
backup-name: MBP
encryption-module: aes
compression-module: zip
dblock-size: 100MB
passphrase: XXXXXX
keep-time: 1Y
prefix: MBP
exclude-files-attributes: temporary,hidden
disable-module: console-password-input


Mono.Data.Sqlite.SqliteException (0x80004005): SQLite error
near ""."": syntax error
  at Mono.Data.Sqlite.SQLite3.Prepare (Mono.Data.Sqlite.SqliteConnection cnn, System.String strSql, Mono.Data.Sqlite.SqliteStatement previous, System.UInt32 timeoutMS, System.String& strRemain) [0x00236] in <7797d8bb38254a72bf06be6a3048939d>:0 
  at Mono.Data.Sqlite.SqliteCommand.BuildNextCommand () [0x00059] in <7797d8bb38254a72bf06be6a3048939d>:0 
Return code: 100

Welcome to the forum! I edited your post to improve the formating. (Just added ~~~ before and after the output you pasted, please see here for details).

1 Like

Can you include the command that produced those results?

For me, this command works:
Duplicati.CommandLine.exe" compare "file://E:\_Duplicati-Block -Test" --dbpath="E:\_Duplicati-SQLite\NJQGAWWNCA.sqlite" 0 1 --full-result

Including the --dbpath parameter speeds things up as it doesn’t have to pull data from the destination, plus I believe it avoids having to include a password (or the disable password parameter).

No command, just “Commandline” page:

  • Command = ‘compare’
  • Target URL = ‘file:///Volumes/backup/mbp/?auth-username=backup&auth-password=XXXX’ (set automatically)
  • Commandline arguments = ‘–dbpath=/Users/haron/.config/Duplicati/XXXXX.sqlite --full-result’
  • Advanced options:
    ** If I remove them all the command never ends
    ** If I keep them I get the error message above.

I’ve gotten that "error hear ‘.’ error myself and it was always due to something wrong with my parameters.

I’d recommend:

  • make sure dbpath starts with a double dash (could be a copy paste or forum display issue)
  • make sure --full-result is on its own line (it’s not indicated, but each command line argument needs to be its own line)
  • try putting the value of dbpath in quotes (I’ve had times when Duplicati doesn’t parse the path correctly and thinks it’s two parms)
1 Like

It helped, thanks!
Now waiting for a bugfix to be able to observe the whole (long) output…

Too many changes to fit in the browser scroller? You might want to shell / CLI call as shown in this post with a redirect to an output file (add >>C:\DuplicatiOut.txt to the end of line).

While I hope to see output routing added to the GUI based command line, I don’t believe it’s on the short list for the next release. :frowning:

1 Like

As I can see, there is no file sizes in the log. How can I check what files are eating space?

Any ideas how to track (and reduce) backup size?

Not in a simple way, no. You could probably dig into the .sqlite file and get file sizes and the like from that but you’d basically be writing your own SQL to do it.

Reducing backup size pretty much comes down to some combination of:

  • reduce source size
  • increase compression
  • reduce versions / retention

I’d suggest you start with looking at what’s actually being backed up and make sure you’re not grabbing junk you don’t need. I’m not sure what all Macs keep around but on Windows it’s easy to accidentally be backing up temp, paged memory, hibernation, and recycle bin files).

You could set the “Advanced options” --zip-compression-level higher (such as to 9 for maximum compression). Not that this is found in the “Zip compression” section of the “Add advanced option” select list.

You might also want to look at the --retention-policy feature (although it was added to a canary version after your beta, so you’d have to update to that version or wait for the feature to come to your upgrade path).

Not in a simple way, no. You could probably dig into the .sqlite file and get file sizes and the like from that but you’d basically be writing your own SQL to do it.

Could you create a feature request to include file size info into the file log?

Reducing backup size pretty much comes down to some combination of:
• reduce source size
• increase compression
• reduce versions / retention
I’d suggest you start with looking at what’s actually being backed up and make sure you’re not grabbing junk you don’t need.

Right, this is exactly was I’m trying to do. There are around 50’000 files in the profile therefore I’m trying to find the biggest and check whether I really need them.

You could set the “Advanced options” --zip-compression-level higher (such as to 9 for maximum compression). Not that this is found in the “Zip compression” section of the “Add advanced option” select list.

As far as I remember, I did it in general settings as a common rule for all backups.

You might also want to look at the --retention-policy feature (although it was added to a canary version after your beta, so you’d have to update to that version or wait for the feature to come to your upgrade path).

Could you drop me a link to read more about this feature?

I think the above “Maximum backup versions?” link is probably the most succinct description so far of what was implemented.

If you want more detail (along with a history of what was considered) you could check out GitHub:

1 Like

The --verbose command does not affect the email output. You would need some logic to store the log file, and then attach the log file to the email for this to work.