It’s unoptimized queries in the database 
And they only get worse the larger the database grows. It’s fairly manageable with 300-600MB databases usually.
We have a thread on it here Optimizing load speed on the restore page where we identified some performance problems on the restore page and ways of dealing with it.
Sadly I haven’t gotten around to implementing any of the solutions yet