Compression tested on Windows. Excellent results

I performed a test of the Beta compression version of restic, restic_v0.13.0-124-gfb5b9370_windows_amd64.exe, with compression off, auto and max on my Windows workstation. The results were perfect.

In each case the backup of the ssd C:\ excluding a whole bunch of windows related directories was done and put to a spinning internal disk.
A complete restore of each backup was done to a different subdirectory.
Restored files were compared to the originals. To ensure a quality test the current production version of restic, restic_0.13.1_windows_amd64.exe, was put the same test and of course passed.

I’m not sure that anyone needs any additional details but the workstation is AMD Ryzen 9 5900X 12-Core Processor 3.70 GHz, 64.0 GB memory, Windows 10. I was still using the workstation slightly while the backup was being done so there were some differences between some files but those were all the ones I caused changes to happen.

prod:
Files:       315749 new,     0 changed,     0 unmodified
Dirs:        35788 new,     0 changed,     0 unmodified
Data Blobs:  290869 new
Tree Blobs:  30846 new
Added to the repo: 106.994 GiB
processed 315749 files, 128.026 GiB in 29:13
Windows reports size on disk as 107 Gb

Beta compression off:
Files:       315067 new,     0 changed,     0 unmodified
Dirs:        35724 new,     0 changed,     0 unmodified
Data Blobs:  290274 new
Tree Blobs:  30805 new
Added to the repo: 106.754 GiB
processed 315067 files, 127.587 GiB in 33:28
Windows reports size on disk as 106 Gb

Beta compression auto:
Files:       315643 new,     0 changed,     0 unmodified
Dirs:        35776 new,     0 changed,     0 unmodified
Data Blobs:  291088 new
Tree Blobs:  30839 new
Added to the repo: 106.849 GiB
processed 315643 files, 127.810 GiB in 19:47
Windows reports size on disk as 65.6 Gb

Beta compression max:
Files:       315671 new,     0 changed,     0 unmodified
Dirs:        35807 new,     0 changed,     0 unmodified
Data Blobs:  290987 new
Tree Blobs:  30865 new
Added to the repo: 106.928 GiB
processed 315671 files, 127.811 GiB in 36:37
Windows reports size on disk as 63.9 Gb

Notes:

  • There was a slight increase in backup time from production to beta compression off. Changing from compression off to auto dropped the time by 1/3!. The decrease in size written to disk meant that the backup waited less for the spinning disk to respond to the writes. Changing from compression auto to max increased the backup time by more
    than 50% while decreasing the size on disk very little.

personal notes:

  • I find the words “off, auto, max” easier to understand than typical technical words compression level 1-9 because I cannot remember what 1 or 9 means.

  • Using directory names such as prod, betaoff, betaauto, betamax gave me a startle because Betamax was a failed product some time ago.
    Thank you all for restic.

8 Likes

Sounds like the story of my nickname. SCNR

Thank you for sharing your results. Very impressive.

2 Likes

Hello, I’m new and learning restic.
Thanks for the info!

Do you have a standard setup or list of folders to exclude on Windows?

Note: I found Restic on Windows: Another user trying to exclude directories from you too!! :smiley: