A recent issue reported in the 2.4 release thread reminded me of this issue.
The issue is that during the delete of old filesets, the memory usage can grow significantly if there are many files in a fileset. There will be a fix for this in the next canary.