Recommended rclone flags not to hit dropbox / google drive limits

Getting Help
1

Guys hi,

Title says it, want to learn what flags one should use to keep it safe with free dropbox / google drive accounts.

Today i hit 403 and 500 errors after initializing repo and backing up 250mb file. After research i found that i should’ve used --tpslimit flag. (1)

Wonder if there are any other flags i should set to avoid problems in future. I don’t mind it being a bit slower, just reliable.
(i am light user, with daily incremental backups of just several megabytes, and occasional 150-250mb single tmp file)

Errors i got:

restic -r rclone:gdrive_my:GdriveBups-Tmp init

created restic repository f565997120 at rclone:gdrive_my:GdriveBups-Tmp

Please note that knowledge of your password is required to access

the repository. Losing your password means that your data is

irrecoverably lost.

restic -r rclone:gdrive_my:GdriveBups-Tmp backup --tag tmp-a k:/tmp/tmp-a

repository f5659971 opened successfully, password is correct

created new cache in C:\Users\xxx\AppData\Local\restic

no parent snapshot found, will read all files

rclone: 2022/01/24 09:35:29 ERROR : data/57/57a388a7151b0bc771904c22081113992f7dc4d01afc7799faa9670e2b88b8cd: Post request put error: googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded

rclone: 2022/01/24 09:35:29 ERROR : data/57/57a388a7151b0bc771904c22081113992f7dc4d01afc7799faa9670e2b88b8cd: Post request rcat error: googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded

rclone: 2022/01/24 09:35:29 ERROR : data/8d/8d1113493d323a3083c871866f3c95ccb6d2d13868248b00855821421fef7d08: Post request put error: googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded

rclone: 2022/01/24 09:35:29 ERROR : data/8d/8d1113493d323a3083c871866f3c95ccb6d2d13868248b00855821421fef7d08: Post request rcat error: googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded

Save(<data/8d1113493d>) returned error, retrying after 720.254544ms: server response unexpected: 500 Internal Server Error (500)

Save(<data/57a388a715>) returned error, retrying after 582.280027ms: server response unexpected: 500 Internal Server Error (500)

Files: 1 new, 0 changed, 0 unmodified

Dirs: 2 new, 0 changed, 0 unmodified

Added to the repo: 250.012 MiB

processed 1 files, 250.000 MiB in 1:22

snapshot 3932fc0e saved

I found several example of flags used for gdrive (1, 2)

2

Sorry, but wouldn’t it make more sense to ask this in the rclone forum? Or have you done that and got pointed here.

3

Hi, no worries, i see your point. I posted on rclone sub and got some suggestions, but from my experience asking different user demographics (only small portion of rclone users are restic users) most of the time result in better suggestions. (like doscott`s advice here, in rclones sub i received opposite recommendation)

First step to learn smng new often starts with stupid question.

4

After a bit of research i ended up with following:

restic -r rclone:gdrive_my:GdriveBups-Tmp -o rclone.args="serve restic --stdio --tpslimit=10 --drive-chunk-size=256M --drive-use-trash=false --fast-list" -v backup --tag tmp-b k:/tmp/tmp-b

comments and links:
–stdio to run an HTTP2 connection over stdin/stdout i
–tpslimit to limit query rate (default unlimited) i, i
–drive-chunk-size (default 8M) matters for large files i
–drive-use-trash to bypass trash when deleting i
–fast-list i, i

Maybe it will be useful to other newbies like me.

Above command plus creating own google app id solved the errors, now works great.

2 Likes