Hello.
For quite some time I’m trying to figure out the problem with the prune. It looks it is failing for quite some time, so I have a lot of data to be remove from the repository.
Running prune I’m getting:
Load(<data/b059672eda>, 233152, 1165760) returned error, retrying after 1.207566507s: <data/b059672eda> does not exist
for multiple packs.
I’ve tried to run:
restic checkrestic check --read-datarestic repair indexrestic repair index --read-all-packsrestic repair snapshots --forget
None of them find any problem.
Prune fails giving me 4 packs with issues. I parse index (restic cat index) to get full pack IDs and then try to fix them with restic repair packs. I hope it fixes something, but the next prune fails with another pack IDs. Prune suggests it needs to repack 27817 packs and to delete 312638 of them, so figuring out 4 packs a time will take a lot of time. And I’m not sure if it actually fixes anything.
So, first of all why only prune faces a problem?
Is there a faster way to find out packs that require repair? I was thinking restic repair packs with all the pack IDs at a time, but it is terabytes of data that it has to download, store locally and process.
Is there any better way to repair the whole repo?
I’m running restic 0.18.0 compiled with go1.24.1 on linux/amd64
Backend is FTP (on Synology NAS) via rclone:
# rclone config redacted
[scarlett]
type = ftp
host = XXX
user = XXX
pass = XXX
explicit_tls = true
### Double check the config for sensitive info before posting publicly
Env vars:
export RCLONE_FTP_DISABLE_TLS13=true
export TMPDIR="/var/tmp"
export RESTIC_CACHE_DIR=/var/cache/restic
export RESTIC_REPOSITORY="rclone:scarlett:/backups/restic"
I’m running just restic prune --verbose
The relevant output:
loading indexes...
loading all snapshots...
finding data that is still in use for 1394 snapshots
[0:25] 100.00% 1394 / 1394 snapshots
searching used packs...
collecting packs for deletion and repacking
[0:30] 100.00% 393221 / 393221 packs processed
used: 2033150 blobs / 709.961 GiB
duplicates: 8338 blobs / 6.254 GiB
unused: 12959596 blobs / 4.958 TiB
total: 15001084 blobs / 5.658 TiB
unused size: 87.75% of total size
to repack: 2285803 blobs / 360.050 GiB
this removes: 1638166 blobs / 323.773 GiB
to delete: 11196596 blobs / 4.612 TiB
total prune: 12834762 blobs / 4.928 TiB
remaining: 2166322 blobs / 747.326 GiB
unused size after prune: 37.365 GiB (5.00% of remaining size)
totally used packs: 44471
partly used packs: 36112
unused packs: 312638
to keep: 52766 packs
to repack: 27817 packs
to delete: 312638 packs
repacking packs
Load(<data/b059672eda>, 233152, 1165760) returned error, retrying after 1.207566507s: <data/b059672eda> does not exist
Load(<data/e045c0986a>, 682838, 3769352) returned error, retrying after 993.328584ms: <data/e045c0986a> does not exist
Load(<data/30cb3f36ba>, 1167280, 6873928) returned error, retrying after 927.008466ms: <data/30cb3f36ba> does not exist
Load(<data/4078953642>, 881064, 15052942) returned error, retrying after 1.383918211s: <data/4078953642> does not exist
Load(<data/b059672eda>, 233152, 1165760) returned error, retrying after 1.148595338s: <data/b059672eda> does not exist
Load(<data/e045c0986a>, 682838, 3769352) returned error, retrying after 1.588664257s: <data/e045c0986a> does not exist
rclone: 2025/12/07 10:41:09 ERROR : locks/ac46c142d5b1b4cbd6c308776908dbe75df1ecf5d870de81f78bee021fce9ef4: Post request put error: Put mkParentDir failed: mkdir "/backups/restic/locks" failed: write tcp 192.168.236.9:36208->192.168.236.6:21: write: broken pipe
rclone: 2025/12/07 10:41:09 ERROR : locks/ac46c142d5b1b4cbd6c308776908dbe75df1ecf5d870de81f78bee021fce9ef4: Post request rcat error: Put mkParentDir failed: mkdir "/backups/restic/locks" failed: write tcp 192.168.236.9:36208->192.168.236.6:21: write: broken pipe
Save(<lock/ac46c142d5>) returned error, retrying after 1.475517982s: unexpected HTTP response (500): 500 Internal Server Error
rclone: 2025/12/07 10:41:10 ERROR : locks/ac46c142d5b1b4cbd6c308776908dbe75df1ecf5d870de81f78bee021fce9ef4: Post request put error: Put mkParentDir failed: mkdir "/backups/restic/locks" failed: write tcp 192.168.236.9:36264->192.168.236.6:21: write: broken pipe
rclone: 2025/12/07 10:41:10 ERROR : locks/ac46c142d5b1b4cbd6c308776908dbe75df1ecf5d870de81f78bee021fce9ef4: Post request rcat error: Put mkParentDir failed: mkdir "/backups/restic/locks" failed: write tcp 192.168.236.9:36264->192.168.236.6:21: write: broken pipe
Save(<lock/ac46c142d5>) returned error, retrying after 1.252361351s: unexpected HTTP response (500): 500 Internal Server Error
rclone: 2025/12/07 10:41:12 ERROR : locks/ac46c142d5b1b4cbd6c308776908dbe75df1ecf5d870de81f78bee021fce9ef4: Post request put error: Put mkParentDir failed: mkdir "/backups/restic/locks" failed: write tcp 192.168.236.9:36234->192.168.236.6:21: write: broken pipe
rclone: 2025/12/07 10:41:12 ERROR : locks/ac46c142d5b1b4cbd6c308776908dbe75df1ecf5d870de81f78bee021fce9ef4: Post request rcat error: Put mkParentDir failed: mkdir "/backups/restic/locks" failed: write tcp 192.168.236.9:36234->192.168.236.6:21: write: broken pipe
Save(<lock/ac46c142d5>) returned error, retrying after 5.489723326s: unexpected HTTP response (500): 500 Internal Server Error
Load(<data/30cb3f36ba>, 1167280, 6873928) returned error, retrying after 2.574942038s: <data/30cb3f36ba> does not exist
<...>
[19:35] 0.05% 14 / 27817 packs repacked
rclone: 2025/12/07 10:57:54 ERROR : locks/6106a399278b52db33553d64b94287a2028f114808b220fc323b2ddf36ec8c29: Post request put error: Put mkParentDir failed: mkdir "/backups/restic/locks" failed: write tcp 192.168.236.9:36224->192.168.236.6:21: write: broken pipe
rclone: 2025/12/07 10:57:54 ERROR : locks/6106a399278b52db33553d64b94287a2028f114808b220fc323b2ddf36ec8c29: Post request rcat error: Put mkParentDir failed: mkdir "/backups/restic/locks" failed: write tcp 192.168.236.9:36224->192.168.236.6:21: write: broken pipe
Save(<lock/6106a39927>) returned error, retrying after 1m0.666395081s: unexpected HTTP response (500): 500 Internal Server Error
rclone: 2025/12/07 10:58:55 ERROR : locks/6106a399278b52db33553d64b94287a2028f114808b220fc323b2ddf36ec8c29: Post request put error: Put mkParentDir failed: mkdir "/backups/restic/locks" failed: write tcp 192.168.236.9:36236->192.168.236.6:21: write: broken pipe
rclone: 2025/12/07 10:58:55 ERROR : locks/6106a399278b52db33553d64b94287a2028f114808b220fc323b2ddf36ec8c29: Post request rcat error: Put mkParentDir failed: mkdir "/backups/restic/locks" failed: write tcp 192.168.236.9:36236->192.168.236.6:21: write: broken pipe
Save(<lock/6106a39927>) returned error, retrying after 1m4.713436168s: unexpected HTTP response (500): 500 Internal Server Error
Save(<lock/6106a39927>) operation successful after 9 retries
Fatal: StreamPack: ReadFull(<data/b059672eda>): <data/b059672eda> does not exist