I am using Wasabi S3 as my host and I have a script which dumps the database into a file and backs it up using restic. It’s been working perfectly well for the first two weeks but every since then when I try to run restic snapshots It takes too long to load. I have around 30+ databases (each one is treated as a separate path) and they’re around 500GB in size. Wasabi has really good restore speed and restic works really well with importing the backups directly into local db when deploying local environments.
The problem became that after almost two months of running, twice a day for all databases there’s just too many snapshots. I’m doing a ‘restic prune’ command at the moment and it’s been running for 45 hours and is only at 66% completion.
100.00% 12402 / 12402 snapshots
found 358902 of 376415 data blobs still in use, removing 17513 blobs
will remove 0 invalid files
will delete 266 packs and rewrite 11986 packs, this frees 33.823 GiB
Is there a way to increase the speed of this? I have a grunty connection and the server is also grunty.