<data/xxxxx> does not exist when check every week

Getting Help
1
  • The output of restic version.
    0.17.1
  • The complete commands that you ran (leading up to the problem or to reproduce the problem).
    restic check -o sftp.args=-oBatchMode=yes
  • Any environment variables relevant to those commands (including their values, of course).
    No
  • The complete output of those commands (except any repeated output when obvious it’s not needed for debugging).
    ERROR of one repo
command: /root/.local/share/backrest/restic-0.17.1 check -o sftp.args=-oBatchMode=yes

using temporary cache in /tmp/restic-check-cache-920499070

create exclusive lock for repository

load indexes

pack 4333e25cce84e2667ddcdd876317b6345170e0572d1d8707676df6a9a59ae1d4 contained in several indexes: {3ed3beb5 5cfe9dbe}

pack 70985ced31fe6394f1a409691dd9dc249f452011bb4d871c1eb9020feb3dd9ab contained in several indexes: {5b4bdd84 76cd1dc1}
.....
pack 2d7f467599ce369df3b6dfa3feed885dac2cb13e36ce0d639852639bc22c5c5b contained in several indexes: {5cfe9dbe 8156f002}

pack 48e5b0cd523a2661d02f1abeb5fe3f48c801f5a2030d299a9d7999430a4480ce contained in several indexes: {5b4bdd84 76cd1dc1}

pack ef33acedcbac3a048ab6f10612097726b2f72f2ab1b957862c97f94847539672 contained in several indexes: {5b4bdd84 76cd1dc1}

pack 9f763a29113ca6050d05125d483f90f71b67db382d44fa56f1da93149a5fa1e5 contained in several indexes: {5cfe9dbe 67faf6cc}

Duplicate packs are non-critical, you can run `restic repair index' to correct this.

check all packs

pack d748d50ab6be79f0655f8d98ae8ffc27ed1765400f951c9fbf3c12b36df484f0: does not exist

check snapshots, trees and blobs

[3:26] 100.00% 26 / 26 snapshots

The repository is damaged and must be repaired. Please follow the troubleshooting guide at https://restic.readthedocs.io/en/stable/077_troubleshooting.html .

Fatal: repository contains errors

ERROR of another repo

command: /root/.local/share/backrest/restic-0.17.1 check --read-data -o sftp.args=-oBatchMode=yes
using temporary cache in /tmp/restic-check-cache-826539207
create exclusive lock for repository
Load(<key/4b45338a7f>, 0, 0) failed: <key/4b45338a7f> does not exist
load indexes
pack b0172284a187eaceb8b65f6391a308a079e5a696673bb43566c2ff16890bc7f6 contained in several indexes: {07165a59 d9a6ad4c}
pack 466ece47e2c69227698db3ed5b4fd518abfdbeb1c6d551219fe720e83012907e contained in several indexes: {0500935b d9a6ad4c}
...
pack a988101f55d3117328a40fe8042e04609f1cc495b415b0591f10e180455467a7 contained in several indexes: {401c5831 d9a6ad4c}
pack d0d4255ca22fbf7fffa77ca1bc9e4654fd5b515fc5103767e6d8ef796394f8ca contained in several indexes: {1efc5968 d9a6ad4c}
pack f423fc792a53ec9f57abc36f2465be6ddc0cbd20c408bfffd6a5218cc1315c3b contained in several indexes: {0500935b d9a6ad4c}
Duplicate packs are non-critical, you can run `restic repair index' to correct this.
check all packs
pack d5fd54a9bac69ec91b9cddd55e40541a6baa49e2df5a2fd81b43bc39e7f0809b: does not exist
pack f0246ddf48d97570bcf7ef1c6ff5a7e95203900c4c5df860ff0184d165b51313: does not exist
check snapshots, trees and blobs
[0:03] 100.00%  24 / 24 snapshots
read all data
Load(<data/f0246ddf48>, 2679, 0) failed: <data/f0246ddf48> does not exist
Load(<data/f0246ddf48>, 2679, 0) failed: <data/f0246ddf48> does not exist
download error: <data/f0246ddf48> does not exist
Load(<data/d5fd54a9ba>, 26012, 0) failed: <data/d5fd54a9ba> does not exist
Load(<data/d5fd54a9ba>, 26012, 0) failed: <data/d5fd54a9ba> does not exist
download error: <data/d5fd54a9ba> does not exist
[18:49] 100.00%  403 / 403 packs
The repository is damaged and must be repaired. Please follow the troubleshooting guide at https://restic.readthedocs.io/en/stable/077_troubleshooting.html .
Fatal: repository contains errors

I have two restic repositories, use reclone:webdav as upstream. I run restic check every week, this error occurs every time, and the error packs are always f0246ddf48d97570bcf7ef1c6ff5a7e95203900c4c5df860ff0184d165b51313, d5fd54a9bac69ec91b9cddd55e40541a6baa49e2df5a2fd81b43bc39e7f0809b and d748d50ab6be79f0655f8d98ae8ffc27ed1765400f951c9fbf3c12b36df484f0. I can run repair index to repair it, but I don’t is it right or it will damage the data.
If anyone can help me I’d be very grateful

2

There seems to be something wrong with the webdav storage.

Does a file with a name starting with 4b45338a7f exist in the keys folder of the repository?

Apparently the webdav storage lost those two files. You can follow the Troubleshooting — restic 0.17.3 documentation guide to repair the repository. Although the important question is to find out what caused those files to disappear. Do you have logs of the restic runs shortly before the error occurred? Were there any errors reported?

3

This options hasn’t any effect as you’re using the rclone backend.

4

Thanks for your reply.

  1. I don’t know if there is a problem with the webdav storage, but I have used it in other places without any problems.
  2. There is no file with a name starting with 4b45338a7f exist in the keys folder of the repository.
  3. There is no other error occurred before this error.

I can fix it by repair index every time, by I don’t know why.

5

Yes, but because I use backrest to manage restic, it is added automatically by backrest and can be ignored.

6

It should never be necessary to run repair index unless the repository gets damaged. We need to find out why, otherwise the repository may miss data when you have to restore something.

Does that error persist?