So it seems that you’ve been having similar experiences than I’ve had.
Yet, I assume that in my case the situation is much worse than just time spent rebuilding the database. My observation is that there are I/O patterns which probably are making this process around 20 times slower than it would be without those adverse patterns at least in my case.