Running restic v.0.9.4 on Mac OS/X HighSierra in a MacPro 2013 with quad-xeon CPU and 64GB of ECC RAM.
EDIT: Backend is ‘plain’ (non-encrypted) Google Drive with an unlimited GSuite business account.
I’m using restic to backup a 33M files / 23 TiB directory tree. After the initial backup having taken over a month (long story, thanks @fd0 for all the assistance on restic’s IRC channel during that time), I’m now taking care of the daily backups, which are (to my great surprise) also taking a lot of time.
Case in point: yesterday’s backup took over 16h – and I can find no bottleneck on the machine or the internet connection: it’s a fast quad-core Xeon with 64GB of RAM and a ZFS 8-disk RAIDZ2 array which, according to
zpool iostats, stays the entire time a long way from being saturated either CPU-, memory- or disk/network bandwidth-wise; and the internet link is 50Mbps and went the entire time under 10Mbps utilization.
What’s worse, according to the restic’s own output on stderr, is that restic seems to be spending minutes at a time doing absolutely nothing, see for example:
[3:15:24] 0.78% 103832 files 182.084 GiB, total 32916091 files 22.897 TiB, 0 errors ETA 416:06:18 [3:16:13] 0.78% 103832 files 182.084 GiB, total 32916091 files 22.897 TiB, 0 errors ETA 417:50:39
Adding to the fact that the “103832 files 182.084 GiB” doesn’t change during almost a full minute as shown above, and the ETA skyrockets almost 2 more hours from one line to the next (which shows restic’s own understanding of how little progress is being made), there’s the fact that a
dtruss -p on the restic PID shows restic made absolutely no system calls during that same period:
# ps aux | grep restic root 93731 [REDACTED] restic [REDACTED] # dtruss -p 43991 SYSCALL(args) = return (and nothing else is shown) until I interrupt it with ^C, so no system calls are being made)
top shows the restic process above using a lot of CPU, about 161% if memory serves (didn’t copy that screen).
Can someone help me understand what is going on, and more important, how I can fix this?
Thanks in advance,
– Durval Menezes.