Should we discourage users from using Google Drive?

The docs on restic.readthedocs.io are generated from the files in the doc/ directory using Sphinx, there’s a helpful Makefile so installing Sphinx and running make html in the doc/ directory should build everything. Please create an issue on GitHub so we can improve the process if you get stuck.

I’d love to switch to something different (preferably Hugo) and hosting the docs myself instead of using Sphinx and ReadTheDocs, but I don’t have the time. If anybody wants to give this a try please let me know!

I’m not sure what you’re trying to say, did that sentence get truncated when posting? The linked page only lists pricing, so your post reads as “You should pay Google if you want to use features of their services”, is that what you wanted to say? :slight_smile:

If I look at my own backups I see an average pack size of 4.7MiB. The largest ones are about 11MiB.

I’d argue that this is too small for any cloud storage system as the round trip times will really be eating into the upload bandwidth. Uploading multiple packs at once will help with this of course. However smaller packs also cost more transactions which cost actual money on some storage platforms (eg s3, b2).

So an option to increase the pack size would

  • increase transfer speeds on remote backends (especially on google drive)
  • decrease costs (on all backends which charge per transaction)
  • produce fewer files (so less likely to breach the 400,000 file limit on team drives for example)

I’m not sure what the downsides would be though. More memory use for definite.

What do you think @fd0 could we make this a parameter to restic?

3 Likes

I believe the point is that, many organizations already use GSuite, which comes with unlimited storage. Users under such organizations have a strong incentive to use a backup solution that can utilize their (practically free) unlimited Google Drive storage. Supporting Google Drive (rather than discouraging it) can target these users for restic.

I myself am such a user (unlimited GD through university alumni account). Supporting Google Drive was a high priority when I was looking for a backup solution.

Full agree with you. My case is just like that.

Custom pack sizes are supported since 0.14.0 :

https://restic.readthedocs.io/en/latest/047_tuning_backup_parameters.html#pack-size

1 Like