I consistently get slow speeds of ~4 MB/s (half of my line speed) when backing up to Google Drive through restic and rclone. I suspect it’s because restic uploads a lot of tiny files, which is a worst-case scenario for drive. I’ve tried increasing the number of connections with
-o rclone.connections=64, but it doesn’t seem to help: restic doesn’t appear to use the concurrency.
uploaded intermediate index 22eec63b rclone: 2018/07/19 08:25:45 INFO : B, total 954025 files 74.757 GiB, 0 errors ETA 5:03:09 rclone: Transferred: 4.748 GBytes (3.855 MBytes/s)cache2/entries/0FA7A2B0F525620566B2938FD1C43145A1BF19F2 rclone: Errors: 63x/skjg6wyp.default/cache2/entries/15B94C4B35FCC61F2A91B8FDA57BA307EA519E1E rclone: Checks: 0 rclone: Transferred: 1046 rclone: Elapsed time: 21m1.3s rclone: Transferring: rclone: * ...5dffca30caa684cda850fd33dd39f063da539a78: 100% /4.003M, 4.003M/s, 0s rclone: * ...afdc8c1e78c90208c09d3b0cc67454b50a30b1d0: 100% /4.089M, 4.089M/s, 0s rclone:
(only 2 transferred at once)
I’ve also tried making a Google Drive API key as recommended here, but it didn’t seem to help.
Does anyone know of a way to potentially speed up restic here?