Error running backup to S3 bucket

Support
1

Hi,

I’m trying to backup about 10TB of documents from an AWS FSx FileShare to S3. I’m trying to find the best setup in terms of block size and volume size. Right know, the config is 32MB for block size and 2GB for Volume size (should I go bigger).

The main issue is that after about 25 to 30 hours into the inital backup, the backup will fail with the error below. Everytime I try the backup, it gives me this error with a different document after roughly the same amount of time.

User for backup has Admin priviliges on the FileShare and all filles.
Size of the document in error is 1.8MB.

Any help would be appreciated!

Thank you

System.IO.IOException: (87) The parameter is incorrect: [\amznfsxpxxxxxxxxz1.DLXE.local\share\FSxENT\xxxxxxxxxxxxxxxxxxxxxxxxx\196\124688\d8d52b6c-fa81-42f3-9b7a-50bad0d04f71]
at Alphaleonis.Win32.NativeError.ThrowException(UInt32 errorCode, String readPath, String writePath)
at Alphaleonis.Win32.Filesystem.Device.GetLinkTargetData(SafeFileHandle safeHandle, String reparsePath)
at Alphaleonis.Win32.Filesystem.Device.GetLinkTargetInfo(SafeFileHandle safeHandle, String reparsePath)
at Alphaleonis.Win32.Filesystem.File.GetLinkTargetInfoCore(KernelTransaction transaction, String reparsePath, Boolean continueOnException, PathFormat pathFormat)
at Duplicati.Library.Common.IO.SystemIOWindows.GetSymlinkTarget(String file)
at Duplicati.Library.Snapshots.SnapshotUtility.IsSymlink(ISnapshotService snapshot, String path, FileAttributes attributes)
at Duplicati.Library.Main.Operation.Backup.MetadataPreProcess.d__3.MoveNext()
— End of stack trace from previous location where exception was thrown —
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at Duplicati.Library.Main.Operation.Backup.MetadataPreProcess.<>c__DisplayClass2_0.<b__0>d.MoveNext()
— End of stack trace from previous location where exception was thrown —
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at CoCoL.AutomationExtensions.d__101.MoveNext() --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) at Duplicati.Library.Main.Operation.BackupHandler.<RunMainOperation>d__13.MoveNext() --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) at Duplicati.Library.Main.Operation.BackupHandler.<RunAsync>d__20.MoveNext() --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() at CoCoL.ChannelExtensions.WaitForTaskOrThrow(Task task) at Duplicati.Library.Main.Controller.<>c__DisplayClass14_0.<Backup>b__0(BackupResults result) at Duplicati.Library.Main.Controller.RunAction[T](T result, String[]& paths, IFilter& filter, Action1 method)
at Duplicati.Library.Main.Controller.Backup(String[] inputsources, IFilter filter)
at Duplicati.Server.Runner.Run(IRunnerData data, Boolean fromQueue)

2

Hello

what you are trying to do is basically unsupported. As stated in the nice manual (Introduction - Duplicati 2 User's Manual):

Duplicati is not:
(...)
    A Backup software for the files that are located in the cloud.
    Duplicati can not make a backup of remotely stored files. Duplicati needs to be installed on the host where source files for the backup are located. Optionally files and folders on locations in the local network can be selected for backup by using UNC paths.

There is from time to time posts in this forum from people trying to workaround it by using a cloud host mapped to a local drive by some software baked by the host provider. I don’t remember a report of success though, as these software are usually failing at doing all that is necessary to fully emulate a local drive. In your case, it seems that symbolic links are not supported from what you post.
The ‘backup to S3 bucket’ should work fine, what is not working is ‘backuping a software emulated local resource’.

3

Hi,

Thanks for you’re response, but the backup works just fine if don’t try to backup the full folder. Duplicati is installed on an ec2 instance that has acces to the file share of the FSx service via UNC path.