Multiple errors after restic check cmd

Getting Help
1

Hi,

i got multiple errors after restic check command.

restic --cache-dir . -r backup/@restic check --read-data

Output:

using temporary cache in ./restic-check-cache-2455635441
enter password for repository: 
repository 322f3669 opened successfully, password is correct
created new cache in ./restic-check-cache-2455635441
create exclusive lock for repository
load indexes
check all packs
pack 46a9a645: not referenced in any index
pack 9e4b4aa0: not referenced in any index
...
pack 16f7f828: not referenced in any index
pack 0e43e9d0: not referenced in any index
1432 additional files were found in the repo, which likely contain duplicate data.
You can run `restic prune` to correct this.
check snapshots, trees and blobs
error for tree 69ace179:pshots
  invalid character '3' after object key:value pair
error for tree fc5de7b9:apshots
  invalid character '\a' in string literal
error for tree 59f0c843:napshots
  decrypting blob 59f0c84370422df1e1696f425278959cf2ba2aa5e21ae055111c938b9b1c5a49 failed: ciphertext verification failed
error for tree 4de1ea43:napshots
  blob 4de1ea4399a38a03582efd3f5ed4f568f67cc92be4a56d6b3d7be65cfb7505b9 returned invalid hash
read all data%  40 / 40 snapshots
[6:54] 100.00%  40 / 40 snapshots
Pack ID does not match, want ce2e2b5b, got ada9eb54
pack a92e007b contains 1 errors: [Blob ID does not match, want 4de1ea43, got 005805bc]
Pack ID does not match, want f887af1a, got 5d1f35b9
Pack ID does not match, want 7d56b6e0, got faf47a55
Pack ID does not match, want 63301a12, got d38fd490
Pack ID does not match, want 03ec7535, got 257ffd24
pack cea4dd87 contains 1 errors: [Blob ID does not match, want 41cf98cc, got cf303a6b]
Pack ID does not match, want 3e46bbde, got ad10b81c
Pack ID does not match, want 1dffb1ab, got d643ba3f
Pack ID does not match, want 36016915, got cdd798da
Pack ID does not match, want b37d59b7, got 625521ba
[44:03] 45.41%  53922 / 118736 packs
Pack ID does not match, want efd91098, got fd649f39
Pack ID does not match, want 2bc7ed01, got 89e34ac0
Pack ID does not match, want 941120a5, got 542c5e8f
pack b869fe8a contains 1 errors: [Blob ID does not match, want 701035a9, got 7f399c2a]
Pack ID does not match, want ce45c843, got 8f71c940
Pack ID does not match, want 78c90d7b, got 70a6f5a9
Pack ID does not match, want 3b13630b, got 38d4f9f8
Pack ID does not match, want 5f994b2b, got d16f7f63
Pack ID does not match, want 5083ad2b, got 2ff5040b
[1:32:20] 100.00%  118736 / 118736 packs
Fatal: repository contains errors

Thank you for helping!

2

That doesn’t look good. Can you run restic check a second time, possibly on a different host? Are the errors the same or completely different?

The errors show that either the host creating the backup or the host running check (are these identical?) is massively corrupting data. Please run a memory/CPU stress test to ensure that the hardware works properly, for example memtest and prime95.

3

I already checked the backup on a different host, same errors there.
But you were right, I ran a memtest and got thousands of errors.
Figuered out, which one it was and opened a RMS case.
Unfortunatley this is my Kubernetes cluster and the sqlite Database is also corrupted.

I think I have to check if my second offsite backup is still ok to recover everything.

Thank you for your hint with memtest.

1 Like