The initial check is just a listing of the remote files, and should be pretty fast.
There is another verification at the end, where it downloads a random volume and checks it for consistency, which can be slow due to the network transfer.
There is more on how to fiddle with this here: