No errors,but no backup for mssql 2005 database

sergey_petrov · February 9, 2019, 10:37am

i have daily backup plan for some mssql 2005 databases, snapshot policy set to required, i know exactly that data in databases modified, by log in Duplicaty for backups reports that nothing to add and noting modified.
Some days all is ok. I tried to delete and created again duplilcaty local database for this backup plan - it helps, backup after than was made with data. But after 2 days situation repeat. Log in duplicaty show NO errors for this backup. What can be reason of this problem and what should i do to fix it

complete log:

{
“DeletedFiles”: 0,
“DeletedFolders”: 0,
“ModifiedFiles”: 0,
“ExaminedFiles”: 16,
“OpenedFiles”: 0,
“AddedFiles”: 0,
“SizeOfModifiedFiles”: 0,
“SizeOfAddedFiles”: 0,
“SizeOfExaminedFiles”: 919164162,
“SizeOfOpenedFiles”: 0,
“NotProcessedFiles”: 0,
“AddedFolders”: 0,
“TooLargeFiles”: 0,
“FilesWithError”: 0,
“ModifiedFolders”: 0,
“ModifiedSymlinks”: 0,
“AddedSymlinks”: 0,
“DeletedSymlinks”: 0,
“PartialBackup”: false,
“Dryrun”: false,
“MainOperation”: “Backup”,
“CompactResults”: null,
“DeleteResults”: null,
“RepairResults”: null,
“TestResults”: {
“MainOperation”: “Test”,
“VerificationsActualLength”: 3,
“Verifications”: [
{
“Key”: “duplicati-20190130T022457Z.dlist.zip.aes”,
“Value”:
},
{
“Key”: “duplicati-iff559eeb0ee64f6ab684d9d4d5662472.dindex.zip.aes”,
“Value”:
},
{
“Key”: “duplicati-b4f58f73c26304b75b47b40f2cdc63c24.dblock.zip.aes”,
“Value”:
}
],
“ParsedResult”: “Success”,
“Version”: “2.0.4.15 (2.0.4.15_canary_2019-02-06)”,
“EndTime”: “2019-02-09T03:00:38.9775781Z”,
“BeginTime”: “2019-02-09T03:00:34.8428125Z”,
“Duration”: “00:00:04.1347656”,
“MessagesActualLength”: 0,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: null,
“Warnings”: null,
“Errors”: null,
“BackendStatistics”: {
“RemoteCalls”: 5,
“BytesUploaded”: 0,
“BytesDownloaded”: 18612135,
“FilesUploaded”: 0,
“FilesDownloaded”: 3,
“FilesDeleted”: 0,
“FoldersCreated”: 0,
“RetryAttempts”: 0,
“UnknownFileSize”: 0,
“UnknownFileCount”: 0,
“KnownFileCount”: 32,
“KnownFileSize”: 337367520,
“LastBackupDate”: “2019-02-08T05:00:00+02:00”,
“BackupListCount”: 8,
“TotalQuotaSpace”: 16106127360,
“FreeQuotaSpace”: 15768759840,
“AssignedQuotaSpace”: -1,
“ReportedQuotaError”: false,
“ReportedQuotaWarning”: false,
“MainOperation”: “Backup”,
“ParsedResult”: “Success”,
“Version”: “2.0.4.15 (2.0.4.15_canary_2019-02-06)”,
“EndTime”: “0001-01-01T00:00:00”,
“BeginTime”: “2019-02-09T03:00:00.013711Z”,
“Duration”: “00:00:00”,
“MessagesActualLength”: 0,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: null,
“Warnings”: null,
“Errors”: null
}
},
“ParsedResult”: “Success”,
“Version”: “2.0.4.15 (2.0.4.15_canary_2019-02-06)”,
“EndTime”: “2019-02-09T03:00:38.9775781Z”,
“BeginTime”: “2019-02-09T03:00:00.013711Z”,
“Duration”: “00:00:38.9638671”,
“MessagesActualLength”: 17,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: [
“2019-02-09 05:00:00 +02 - [Information-Duplicati.Library.Modules.Builtin.MSSQLOptions-StartingMsSqlQuery]: Starting to gather Microsoft SQL Server information”,
“2019-02-09 05:00:00 +02 - [Information-Duplicati.Library.Modules.Builtin.MSSQLOptions-MsSqlDatabaseCount]: Found 39 databases on Microsoft SQL Server”,
“2019-02-09 05:00:00 +02 - [Information-Duplicati.Library.Modules.Builtin.MSSQLOptions-IncludeDatabase]: For DB finbase - adding C:\Program Files\Microsoft SQL Server\MSSQL.1\MSSQL\DATA\finbase.mdf”,
“2019-02-09 05:00:00 +02 - [Information-Duplicati.Library.Modules.Builtin.MSSQLOptions-IncludeDatabase]: For DB finbase - adding C:\Program Files\Microsoft SQL Server\MSSQL.1\MSSQL\DATA\finbase_log.LDF”,
“2019-02-09 05:00:00 +02 - [Information-Duplicati.Library.Modules.Builtin.MSSQLOptions-IncludeDatabase]: For DB pension_buh - adding D:\sql\pension_buh.mdf”,
“2019-02-09 05:00:00 +02 - [Information-Duplicati.Library.Modules.Builtin.MSSQLOptions-IncludeDatabase]: For DB pension_buh - adding D:\sql\pension_buh_log.LDF”,
“2019-02-09 05:00:00 +02 - [Information-Duplicati.Library.Main.Controller-StartingOperation]: Началась операция Backup”,
“2019-02-09 05:00:15 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started: ()”,
“2019-02-09 05:00:20 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed: (32 байт)”,
“2019-02-09 05:00:21 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Started: ()”,
“2019-02-09 05:00:33 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: List - Completed: (32 байт)”,
“2019-02-09 05:00:34 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-20190130T022457Z.dlist.zip.aes (2,31 КБ)”,
“2019-02-09 05:00:36 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Completed: duplicati-20190130T022457Z.dlist.zip.aes (2,31 КБ)”,
“2019-02-09 05:00:36 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-iff559eeb0ee64f6ab684d9d4d5662472.dindex.zip.aes (66,45 КБ)”,
“2019-02-09 05:00:36 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Completed: duplicati-iff559eeb0ee64f6ab684d9d4d5662472.dindex.zip.aes (66,45 КБ)”,
“2019-02-09 05:00:36 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Started: duplicati-b4f58f73c26304b75b47b40f2cdc63c24.dblock.zip.aes (17,68 МБ)”,
“2019-02-09 05:00:38 +02 - [Information-Duplicati.Library.Main.BasicResults-BackendEvent]: Backend event: Get - Completed: duplicati-b4f58f73c26304b75b47b40f2cdc63c24.dblock.zip.aes (17,68 МБ)”
],
“Warnings”: ,
“Errors”: ,
“BackendStatistics”: {
“RemoteCalls”: 5,
“BytesUploaded”: 0,
“BytesDownloaded”: 18612135,
“FilesUploaded”: 0,
“FilesDownloaded”: 3,
“FilesDeleted”: 0,
“FoldersCreated”: 0,
“RetryAttempts”: 0,
“UnknownFileSize”: 0,
“UnknownFileCount”: 0,
“KnownFileCount”: 32,
“KnownFileSize”: 337367520,
“LastBackupDate”: “2019-02-08T05:00:00+02:00”,
“BackupListCount”: 8,
“TotalQuotaSpace”: 16106127360,
“FreeQuotaSpace”: 15768759840,
“AssignedQuotaSpace”: -1,
“ReportedQuotaError”: false,
“ReportedQuotaWarning”: false,
“MainOperation”: “Backup”,
“ParsedResult”: “Success”,
“Version”: “2.0.4.15 (2.0.4.15_canary_2019-02-06)”,
“EndTime”: “0001-01-01T00:00:00”,
“BeginTime”: “2019-02-09T03:00:00.013711Z”,
“Duration”: “00:00:00”,
“MessagesActualLength”: 0,
“WarningsActualLength”: 0,
“ErrorsActualLength”: 0,
“Messages”: null,
“Warnings”: null,
“Errors”: null
}
}

sergey_petrov · February 9, 2019, 10:16pm

at windows application log i see VSS error

Volume Shadow Copy Service error: Unexpected error querying for the IVssWriterCallback interface. hr = 0x80070005, Access is denied.
. This is often caused by incorrect security settings in either the writer or requestor process.

Operation:
Gathering Writer Data

Context:
Writer Class Id: {5382579c-98df-47a7-ac6c-98a6d7106e09}
Writer Name: TermServLicensing
Writer Instance ID: {36cb8dd3-dbb1-4e80-a9b1-0088a4fa9c47}

tried to fix it as shown here

not backup pcoceed but duplicaty still say “SQL logic error or missing database near “)”: syntax error”
if i click on “Create bug report …” button

and in application log still:

Volume Shadow Copy Service error: Unexpected error querying for the IVssWriterCallback interface. hr = 0x80070005, Access is denied.
. This is often caused by incorrect security settings in either the writer or requestor process.

Operation:
Gathering Writer Data

Context:
Writer Class Id: {5382579c-98df-47a7-ac6c-98a6d7106e09}
Writer Name: TermServLicensing
Writer Instance ID: {36cb8dd3-dbb1-4e80-a9b1-0088a4fa9c47}

sergey_petrov · February 9, 2019, 11:20pm

from duplicati log

Log data from the server

Stored
Live
Feb 10, 2019 1:01 AM: Failed while executing “CreateReport” with id: 6

System.Data.SQLite.SQLiteException (0x80004005): SQL logic error or missing database near “)”: syntax error at System.Data.SQLite.SQLite3.Prepare(SQLiteConnection cnn, String strSql, SQLiteStatement previous, UInt32 timeoutMS, String& strRemain) at System.Data.SQLite.SQLiteCommand.BuildNextCommand() at System.Data.SQLite.SQLiteDataReader.NextResult() at System.Data.SQLite.SQLiteDataReader…ctor(SQLiteCommand cmd, CommandBehavior behave) at System.Data.SQLite.SQLiteCommand.ExecuteReader(CommandBehavior behavior) at System.Data.SQLite.SQLiteCommand.ExecuteNonQuery(CommandBehavior behavior) at Duplicati.Library.Main.Database.ExtensionMethods.ExecuteNonQuery(IDbCommand self, Boolean writeLog, String cmd, Object values) at Duplicati.Library.Main.Database.LocalBugReportDatabase.Fix() at Duplicati.Library.Main.Operation.CreateBugReportHandler.Run() at Duplicati.Library.Main.Controller.RunAction[T](T result, String& paths, IFilter& filter, Action`1 method) at Duplicati.Library.Main.Controller.CreateLogDatabase(String targetpath) at Duplicati.Server.Runner.Run(IRunnerData data, Boolean fromQueue)

ts678 · February 11, 2019, 7:09pm

Hello @sergey_petrov and welcome to the forum!

Your original Windows issue has extensive information on the Internet, so please also check beyond here.

For the Duplicati solution involving –vss-exclude-writers, use 5382579c-98df-47a7-ac6c-98a6d7106e09 instead of the one used in the issue (which involved a different writer, so used a different GUID to exclude).

Remote Desktop Services (Terminal Services) Gateway VSS Writer says what you’re not backing up now. You could look at it to see if you care, and if you’d even be backing up the data if VSS was working better…

Volume Shadow Copy Service error: Unexpected error calling routine RegOpenKeyExW (on all 2012 R2 servers with AD DS and DHCP) is one of a large number of articles about fixing problems similar to yours. Probably before changing things you can look at your VssAccessControl and see if it looks possibly wrong.

Was the initial not meant to be now? For continuing VSS errors, please also check you excluded the class.

As for what sounds like your remaining error with the bug report, that’s probably Duplicati’s new bug below:

V2.0.4.14: Create-Report fails

The bug report you’re making is just a sanitized dump of the local database, and I’m not sure why VSS got involved. The SQL error was possibly introduced in a recent change to database code for canary recently:

*broken* Release: 2.0.4.13 (canary) 2019-01-29

Changed the internal storage of paths to use a prefix method. This should reduce the size of the database significantly and enable much faster database queries later on

would you be willing to file an issue so it can be tracked, preferably after the rest of the backup is working?

sergey_petrov · February 15, 2019, 1:52am

problem was because size and modification datetime of mssql database files (*.mdf and *.ldf) not changed by sql server if activity in database is low. And Duplicaty in standart settings can’t track modification of these files and don’t add them to archive.
Problem was solved by adding key to duplicaty settings
–disable-filetime-check=true

samw · February 17, 2019, 3:40am

In addition feel free to use the exclude VSS writers that are causing the errors in your logs using the “vss-exclude-writers” option. You’ll need to supply the writer IDs seperated by semicolon.