Invalid repo: id 00...00 not found in repository

fd0 · December 6, 2020, 8:36pm

Interesting, we’ve recently received a very similar report here:

Can you try the same steps described there?

We’re tracking this as the following issue:

github.com/restic/restic

Receiving error "error for tree [null]

opened 05:17PM - 06 Dec 20 UTC

closed 04:03PM - 29 Dec 20 UTC

msmafra

type: bug category: backup

Output of `restic version` ❯ restic version `restic 0.11.0 compiled with go1….15.3 on linux/amd64` How did you run restic exactly? From my script, backup works but stats and prune don't. ``` export RESTIC_REPOSITORY="/run/media/marcelo/THEGREY/BACKUPS/tars_linux/" && export RESTIC_PASSWORD_COMMAND="\gpg --quiet --decrypt /home/marcelo/Projects/rest-o/pwd.restic.txt.gpg" \restic backup --repo "${RESTIC_REPOSITORY}" --force --verbose --exclude-file="${RESTIC_EXCLUDED:-}" --files-from "${RESTIC_INCLUDED}" "${RESTIC_USER_HOME:-}" restic prune [breaks] restic stats [breaks] ``` What backend/server/service did you use to store the repository? `export RESTIC_REPOSITORY="/run/media/marcelo/THEGREY/BACKUPS/tars_linux/" && export RESTIC_PASSWORD_COMMAND="\gpg --quiet --decrypt /home/marcelo/Projects/rest-o/pwd.restic.txt.gpg" ` Expected behaviour Removal of unneeded data with the usage of prune command and get statistics from the repository with the stats command. The check command is returning various blobs errors Actual behaviour ``` ❯ restic prune --verbose 3 repository 6d9f087d opened successfully, password is correct counting files in repo building new index for repo [0:00] 100.00% 11878 / 11878 packs repository contains 11878 packs (408993 blobs) with 58.120 GiB processed 408993 blobs: 0 duplicate blobs, 0 B duplicate load all snapshots find data that is still in use for 51 snapshots [0:21] 64.71% 33 / 51 snapshots id 0000000000000000000000000000000000000000000000000000000000000000 not found in repository github.com/restic/restic/internal/repository.(*Repository).LoadBlob /restic/internal/repository/repository.go:156 github.com/restic/restic/internal/repository.(*Repository).LoadTree /restic/internal/repository/repository.go:723 github.com/restic/restic/internal/restic.FindUsedBlobs /restic/internal/restic/find.go:19 main.getUsedBlobs /restic/cmd/restic/cmd_prune.go:276 main.pruneRepository /restic/cmd/restic/cmd_prune.go:158 main.runPrune /restic/cmd/restic/cmd_prune.go:62 main.glob..func19 /restic/cmd/restic/cmd_prune.go:27 github.com/spf13/cobra.(*Command).execute /home/build/go/pkg/mod/github.com/spf13/cobra@v0.0.5/command.go:826 github.com/spf13/cobra.(*Command).ExecuteC /home/build/go/pkg/mod/github.com/spf13/cobra@v0.0.5/command.go:914 github.com/spf13/cobra.(*Command).Execute /home/build/go/pkg/mod/github.com/spf13/cobra@v0.0.5/command.go:864 main.main /restic/cmd/restic/main.go:98 runtime.main /usr/local/go/src/runtime/proc.go:204 runtime.goexit /usr/local/go/src/runtime/asm_amd64.s:1374 ``` ``` ❯ restic stats repository 6d9f087d opened successfully, password is correct scanning... error walking snapshot: walking tree 0000000000000000000000000000000000000000000000000000000000000000: id 0000000000000000000000000000000000000000000000000000000000000000 not found in repository ``` ``` ❯ restic check using temporary cache in /tmp/restic-check-cache-801153215 repository 6d9f087d opened successfully, password is correct created new cache in /tmp/restic-check-cache-801153215 create exclusive lock for repository load indexes check all packs check snapshots, trees and blobs error for tree [null]: id 0000000000000000000000000000000000000000000000000000000000000000 not found in repository Fatal: repository contains errors ``` _restic check --check-unused_ finds various blobs, more than my terminal can show me without a less/more piped. And issues an error at the end: ... ``` unused blob <data/63a863fd> unused blob <data/66d14b00> unused blob <data/dcc78d75> unused blob <tree/20c594fa> unused blob <data/158204f3> unused blob <data/3ff78ad6> unused blob <data/7e6034c5> unused blob <data/d3110c55> unused blob <data/9a1e75c9> unused blob <tree/49b7fcff> unused blob <data/3c41fe3e> unused blob <data/5420f020> unused blob <data/fab494e9> unused blob <data/39e39119> unused blob <data/feb2cec1> unused blob <data/bcd2e562> unused blob <data/cdc2d274> unused blob <data/36e113dd> unused blob <data/a10905b9> unused blob <tree/9331a7b5> unused blob <data/3ecaa4e5> unused blob <data/56769a41> unused blob <data/685b08db> unused blob <data/c34fdde0> unused blob <data/06dc8a71> unused blob <tree/ef06d66d> Fatal: repository contains errors ``` Steps to reproduce the behaviour Do a backup, run stats, run prune, run check Running from my script or manually the backup command works. The mount, find, rebuild-index commands also work. Mounting and copying some random files from different snapshots from different months worked. Do you have any idea what may have caused this? Not really. Just noticed it after updating to 0.11.0. I use a script to back up, prune, check and get the stats before and after the backup, but I do not check the report every time. I think I checked once when I updated to 0.10. Running it manually also shows the errors. I checked both my system filesystem and the external USB 3 HDD, both with BTRFS. Check with _btrfs scrub_ and _btrfs filesystem usage_ Do you have an idea how to solve the issue? No Did restic help you today? Did it make you happy in any way? ...