Hetzner Storage Box experiences?

Hmmm yeah, it’s definitely going a little slow for you then. I wonder if the Finland servers would be faster for you than Germany (or vice-versa if you already went with Finland)?

Geographically, Finland is closer and results from below servers also reflect that,
http://fsn1-speed.hetzner.com/
http://hel1-speed.hetzner.com/

I was trying to automate the backup using script, but it seems it is really hard when a fatal error occurs. It doesn’t let me continue the rest of the script!

Backups over SFTP should be much, much faster starting from restic 0.17.0.

The reported speed was tested with restic 0.16.2. I don’t know, maybe it’s a Hetzner issue.

Slow sftp upload performance in restic before 0.17.0 was a bug in restic Slow SFTP transfer rate since 0.12.1 · Issue #4209 · restic/restic · GitHub .

1 Like

Thanks for link. Just tested and now the avg upload speed is 2.24MiBps. I guess it’s a Hetzner issue.

My experience after using my Hetzner storage box in Finland (from Sweden so I’m close) for a couple of days now. My connection speed is 500/500 and that’s what fast.com tells me.
As of now, I use
Backrest (docker on Linux: garethgeorge/backrest:latest)
Included in the container as of now:
backrest 1.6.1
restic 0.17.1
rclone 1.66.0-DEV

So this is using SFTP via rclone.

First initial backup, brand new repo
102.21 GiB in 35m40s.
Files Added 16216.
All media files.

Acceptable. :slight_smile:

Backing up the same source using Duplicati to OneDrive (using the native implementation takes about 1h 30m)

1 Like

I’d be curious to see the native implementation of SFTP compared, and Rcllone+WebDAV, if you’re up to it?

This is for rclone/WebDAV
Files Added:
16252
Bytes Added:
102.91 GiB
Time:
34m36s

I can try native sftp later today.

1 Like

For me, from fastest to slowest, it’s…

  1. Rclone+WebDAV
  2. Rclone+SFTP
  3. Native SFTP

@akrabu Using which restic version? How fast is each variant?

Shoot, I totally did a test earlier and must have forgotten to put it here lol

I would have been on 0.17.1 when I first tested. I’m on 0.17.3 now. All my scripts call restic self-update so it’s pretty rare for me to not be running the latest (only when I’ve found a bug that impacts me, really).

Here’s a comparison of just “restic diff --no-cache” with two ~65MiB snapshots:

Rclone+WebDAV:
16.80s user 1.83s system 15% cpu 1:58.44 total

Rclone+SFTP:
16.49s user 1.40s system 4% cpu 6:35.34 total

Rclone+SMB:
17.27s user 1.80s system 3% cpu 9:26.69 total

Restic native SFTP:
18.03s user 1.74s system 9% cpu 3:39.28 total

@MichaelEischer Looks like 0.17.3 is much faster! Probably still going to stick with Rclone+WebDAV, but that’s good to know :slight_smile:

I still wish Restic did WebDAV natively, but I get not reinventing the wheel when Rclone already does it. Just seems to be a much more efficient protocol, though.