This issue is documented on the forum and on github.
Thank you for your response. I have noticed the same error when I tried doing the self-update in my Linux VM. Restic was installed using the APT package manager.
Were you running the command as root?
It would be wise not to self-update a binary installed using your package manager.
1 Like
Hi yes, I tried it as root and got the error.
Noted on this. I will wait for the update to come via the package managers then. Thank you.
1 Like
Hmm, the error message should be different on Linux. “Access is denied” isn’t a Linux error. I’m curious if the error you got was “permission denied” or “operation not permitted” as those two messages show up in different circumstances.
Even root can’t modify files that are chattr +i without removing the attribute first, for example – you’d get “operation not permitted” in this case.
Hi the error in Linux bash and Windows powershell where the same / very similar. Please find the output text below
Linux Bash:
user@user-VirtualBox:~$ sudo restic self-update
[sudo] password for user:
writing restic to /snap/restic/12/bin/restic
find latest release of restic at GitHub
latest version is 0.9.5
download SHA256SUMS
download SHA256SUMS.asc
GPG signature verification succeeded
download restic_0.9.5_linux_amd64.bz2
downloaded restic_0.9.5_linux_amd64.bz2
Fatal: unable to update restic: unable to remove target file: remove /snap/restic/12/bin/restic: read-only file system
Windows Powershell:
PS C:\Users\user> restic self-update
writing restic to C:\Users\user\scoop\apps\restic\current\restic.exe
find latest release of restic at GitHub
latest version is 0.9.5
download SHA256SUMS
download SHA256SUMS.asc
GPG signature verification succeeded
download restic_0.9.5_windows_amd64.zip
downloaded restic_0.9.5_windows_amd64.zip
Fatal: unable to update restic: unable to remove target file: remove C:\Users\user\scoop\apps\restic\current\restic.exe: Access is denied.
Thanks.
1 Like
This error message is pretty self-explanatory: the filesystem where the restic binary lives is mounted read-only, therefore restic is unable to write the new binary to the filesystem. This is not a bug in restic.
1 Like
Thanks, understood. I will wait for the respective package managers to update their repositories and will apply the updates accordingly.
Thank you for all your help.
2 Likes
Hi @cdhowie ,
I have just had the chance to update my restic version and for some reason I am still facing difficulty pruning my data.
I have rebuilt the index, applied the forget policy and did a prune but the process throws an error in the end.
I have created another topic on the forget policy behaving differently from what I expected it to be, though I am not sure if it is related to this. That topic is here: Curious case of the Forget policy
Please find the output of my rebuild index and prune jobs below:
Rebuild Index:
PS C:\Users\User> restic -r W:\restic\ rebuild-index
enter password for repository:
repository a6a81653 opened successfully, password is correct
counting files in repo
[40:01] 100.00% 67383 / 67383 packs
finding old index files
saved new indexes as [86c92da0 e3f05f6b 17a41a56 b9902f3f 053d414d 6d70fba5 d000c05d 9123c6e1 7aa3246c cbb56b38 3363c07e df46b774 2872fd68 3a911386 6bec4400 fafebbb6 159f9309 fb39d64b 5527f315 e5065eba 4bfa6943 b7ecb72f 684f5e8d]
remove 89 old index files
Forget and Prune:
PS C:\Users\User> restic -r W:\restic\ forget --keep-within 0y1m --prune
enter password for repository:
repository a6a81653 opened successfully, password is correct
Applying Policy: all snapshots within 1m of the newest
keep 1 snapshots:
ID Time Host Tags Reasons Paths
------------------------------------------------------------------------------------------
7e1f669e 2019-02-26 16:13:36 Toblerone FEB,END within 1m C:\Users\User\Documents
------------------------------------------------------------------------------------------
1 snapshots
keep 22 snapshots:
ID Time Host Tags Reasons Paths
------------------------------------------------------------------------------------------
707e4723 2019-04-23 15:23:51 Toblerone within 1m C:\Users\User\Documents
C:\Users\User\Downloads
C:\Users\User\Pictures
D:\
019ef9b0 2019-04-24 10:30:01 Toblerone within 1m C:\Users\User\Documents
C:\Users\User\Downloads
C:\Users\User\Pictures
D:\
cdd72eeb 2019-04-25 15:45:54 Toblerone within 1m C:\Users\User\Documents
C:\Users\User\Downloads
C:\Users\User\Pictures
D:\
bfb5a87f 2019-04-26 13:24:55 Toblerone within 1m C:\Users\User\Documents
C:\Users\User\Downloads
C:\Users\User\Pictures
D:\
351fb28f 2019-04-29 09:55:17 Toblerone within 1m C:\Users\User\Documents
C:\Users\User\Downloads
C:\Users\User\Pictures
D:\
e10b2206 2019-04-29 10:30:01 Toblerone within 1m C:\Users\User\Documents
C:\Users\User\Downloads
C:\Users\User\Pictures
D:\
d1a5e093 2019-04-30 14:14:54 Toblerone within 1m C:\Users\User\Documents
C:\Users\User\Downloads
C:\Users\User\Pictures
D:\
4f30bec7 2019-05-02 09:49:10 Toblerone within 1m C:\Users\User\Documents
C:\Users\User\Downloads
C:\Users\User\Pictures
D:\
9198acd2 2019-05-02 10:30:00 Toblerone within 1m C:\Users\User\Documents
C:\Users\User\Downloads
C:\Users\User\Pictures
D:\
3e0dd2a2 2019-05-03 17:16:31 Toblerone within 1m C:\Users\User\Documents
C:\Users\User\Downloads
C:\Users\User\Pictures
D:\
ec592370 2019-05-06 09:46:45 Toblerone within 1m C:\Users\User\Documents
C:\Users\User\Downloads
C:\Users\User\Pictures
D:\
cd019f73 2019-05-06 10:30:01 Toblerone within 1m C:\Users\User\Documents
C:\Users\User\Downloads
C:\Users\User\Pictures
D:\
29acc393 2019-05-07 10:30:06 Toblerone within 1m C:\Users\User\Documents
C:\Users\User\Downloads
C:\Users\User\Pictures
D:\
8583575b 2019-05-08 10:30:03 Toblerone within 1m C:\Users\User\Documents
C:\Users\User\Downloads
C:\Users\User\Pictures
D:\
77e2f4de 2019-05-09 10:30:03 Toblerone within 1m C:\Users\User\Documents
C:\Users\User\Downloads
C:\Users\User\Pictures
D:\
79035c32 2019-05-10 10:30:09 Toblerone within 1m C:\Users\User\Documents
C:\Users\User\Downloads
C:\Users\User\Pictures
D:\
86783039 2019-05-14 10:30:04 Toblerone within 1m C:\Users\User\Documents
C:\Users\User\Downloads
C:\Users\User\Pictures
D:\
9fc58c7c 2019-05-15 10:30:04 Toblerone within 1m C:\Users\User\Documents
C:\Users\User\Downloads
C:\Users\User\Pictures
D:\
11fcb6c3 2019-05-17 09:57:15 Toblerone within 1m C:\Users\User\Documents
C:\Users\User\Downloads
C:\Users\User\Pictures
D:\
77845734 2019-05-21 10:30:01 Toblerone within 1m C:\Users\User\Documents
C:\Users\User\Downloads
C:\Users\User\Pictures
D:\
65a677a3 2019-05-22 10:30:16 Toblerone within 1m C:\Users\User\Documents
C:\Users\User\Downloads
C:\Users\User\Pictures
D:\
f73b541b 2019-05-23 10:30:04 Toblerone within 1m C:\Users\User\Documents
C:\Users\User\Downloads
C:\Users\User\Pictures
D:\
------------------------------------------------------------------------------------------
22 snapshots
remove 22 snapshots:
ID Time Host Tags Paths
-------------------------------------------------------------------------------
c9faa05c 2019-02-28 12:23:31 Toblerone FEB,END C:\Users\User\Documents
C:\Users\User\Downloads
C:\Users\User\Pictures
D:\
e3ffd381 2019-03-01 15:10:57 Toblerone MAR,START C:\Users\User\Documents
C:\Users\User\Downloads
C:\Users\User\Pictures
D:\
afb1c018 2019-03-11 10:34:53 Toblerone MAR,MID C:\Users\User\Documents
C:\Users\User\Downloads
C:\Users\User\Pictures
D:\
26898663 2019-03-12 14:47:05 Toblerone MAR,MID C:\Users\User\Documents
C:\Users\User\Downloads
C:\Users\User\Pictures
D:\
90400685 2019-03-13 16:53:41 Toblerone MAR,MID C:\Users\User\Documents
C:\Users\User\Downloads
C:\Users\User\Pictures
D:\
fa2f2685 2019-03-19 16:30:26 Toblerone MAR,MID C:\Users\User\Documents
C:\Users\User\Downloads
C:\Users\User\Pictures
D:\
e4a084b3 2019-03-28 12:11:38 Toblerone C:\Users\User\Documents
C:\Users\User\Downloads
C:\Users\User\Pictures
D:\
ea18e631 2019-04-02 10:30:01 Toblerone C:\Users\User\Documents
C:\Users\User\Downloads
C:\Users\User\Pictures
D:\
4d978c64 2019-04-03 10:30:02 Toblerone C:\Users\User\Documents
C:\Users\User\Downloads
C:\Users\User\Pictures
D:\
8f669003 2019-04-04 10:30:02 Toblerone C:\Users\User\Documents
C:\Users\User\Downloads
C:\Users\User\Pictures
D:\
e14acf8d 2019-04-05 14:07:42 Toblerone C:\Users\User\Documents
C:\Users\User\Downloads
C:\Users\User\Pictures
D:\
e49a19ec 2019-04-08 10:30:00 Toblerone C:\Users\User\Documents
C:\Users\User\Downloads
C:\Users\User\Pictures
D:\
c948dcfa 2019-04-09 12:43:09 Toblerone C:\Users\User\Documents
C:\Users\User\Downloads
C:\Users\User\Pictures
D:\
d9d344df 2019-04-10 10:30:03 Toblerone C:\Users\User\Documents
C:\Users\User\Downloads
C:\Users\User\Pictures
D:\
6911cf59 2019-04-11 10:30:04 Toblerone C:\Users\User\Documents
C:\Users\User\Downloads
C:\Users\User\Pictures
D:\
ffd1ab70 2019-04-12 10:30:04 Toblerone C:\Users\User\Documents
C:\Users\User\Downloads
C:\Users\User\Pictures
D:\
15a63807 2019-04-15 09:41:51 Toblerone C:\Users\User\Documents
C:\Users\User\Downloads
C:\Users\User\Pictures
D:\
6fba037c 2019-04-15 10:30:01 Toblerone C:\Users\User\Documents
C:\Users\User\Downloads
C:\Users\User\Pictures
D:\
b1782998 2019-04-16 12:40:12 Toblerone C:\Users\User\Documents
C:\Users\User\Downloads
C:\Users\User\Pictures
D:\
db51cd43 2019-04-17 10:30:04 Toblerone C:\Users\User\Documents
C:\Users\User\Downloads
C:\Users\User\Pictures
D:\
29cfa4b8 2019-04-18 10:30:03 Toblerone C:\Users\User\Documents
C:\Users\User\Downloads
C:\Users\User\Pictures
D:\
cf5a4fc7 2019-04-22 09:52:12 Toblerone C:\Users\User\Documents
C:\Users\User\Downloads
C:\Users\User\Pictures
D:\
-------------------------------------------------------------------------------
22 snapshots
keep 1 snapshots:
ID Time Host Tags Reasons Paths
-----------------------------------------------------------------------
464d7afb 2019-02-22 10:05:07 Toblerone FEB,END within 1m d:\
-----------------------------------------------------------------------
1 snapshots
22 snapshots have been removed, running prune
counting files in repo
building new index for repo
[37:56] 100.00% 67383 / 67383 packs
incomplete pack file (will be removed): 00b95d3dbe2837cea815ea7a581b67076beffaaa38086a61242080aed2ed98c9
incomplete pack file (will be removed): 01adbbb734c69f44edc28a6eb9ae32af12066c88a051c0d1373fb0b6e31394b5
incomplete pack file (will be removed): 05f8b33c3cf34b810674ef1ba74aed7b1a8bac124b7ac66c68acb317668698ae
incomplete pack file (will be removed): 08471b76322a1eec5ac4a449b2a85268acf0ad9fa87710ce513b2273d67a6a77
incomplete pack file (will be removed): 091334c8820e89a95b842cb79c56c1b1ef412e010e982c658ed3da626e57fa42
incomplete pack file (will be removed): 0d8532d83351f32da5148fb4c4f29f6b2c3ab89eea8f45ab402f39a49dacff43
incomplete pack file (will be removed): 103bf3d9f8bcc693cfac4594321986025022457bd99be0ca29c510fe291f784a
incomplete pack file (will be removed): 122680b08d3ead87b0cbf7b8eba6578d3d41862f409941715177a1ab697dcc30
incomplete pack file (will be removed): 149dc4a7cb1e16eda5c6ef85d9a76603b49212341f724966587eb5547a92772a
incomplete pack file (will be removed): 16a6efecf06212578d93da2eff64beccda74689419502653669e1b8aa71ba198
incomplete pack file (will be removed): 1702154a54cea939550c9c17fa207bbdda2c87e1cc7e4a130edf94ccd87ecb15
incomplete pack file (will be removed): 1c361b7eee246326fa056a15a2f68b3e44cecdcee5db5dd76add962e991e5217
incomplete pack file (will be removed): 1cfb083bdeeacc4f965c9b2f13ed2a52bb734f14130f3cc2b4a8ac96069ea676
incomplete pack file (will be removed): 1d3e916030782a9d0f436dc427e452686445d5d4ddb8f0e23f7cdbcea367e501
incomplete pack file (will be removed): 1f2ed678442e84d9e3b6753b5b0d3d7fdb84881938ce66aa30c4644c1f11fdd1
incomplete pack file (will be removed): 23ae6618800394d18cf2eafecc6e71d0593123969c29efd0f326a9248df9972e
incomplete pack file (will be removed): 2540d81237718850dcfdbfdef81db763a1da29549352635807a163bbc33297ba
incomplete pack file (will be removed): 27ff0640ea75473b585afdc75375d7230b0d2218cced41b40adc325207e02c0b
incomplete pack file (will be removed): 2d35df290b871691a4cfe1b2af19c3550e01a61143d2a47af451c1444f028222
incomplete pack file (will be removed): 31c1d8ef61bef45f25f99b613c911bcc0fd143e94ea6a140c299b98e2da3c93a
incomplete pack file (will be removed): 31feca6b44962504cc79875f1c9156f1a6e19bdb7db358e1a84c15be8069a514
incomplete pack file (will be removed): 331f37c65819e6de9eb338ae06dbffb0553721f8d148cb65893f861ef6cfa374
incomplete pack file (will be removed): 3ac7a7ec55cf416b9b6278858dea32e849576820d126b4228cad6d7079e4463b
incomplete pack file (will be removed): 41fda4863e93a36b4dc7ab8e4937d67ac68b192c361845b6d630a8496beb3626
incomplete pack file (will be removed): 4554c51ef9ea179ce950161e4d8b8e8f4c134992a23cc87fe3d6ea9b282d03ca
incomplete pack file (will be removed): 48ea114a1c24c6878fbc1dec4e5fa2cbc69cab9058240ad1164d13fa72daf1ec
incomplete pack file (will be removed): 4b3f7eea4a3bd9eb3a8f9096e5021ae15d9e58749f69ff0db92723a32e524649
incomplete pack file (will be removed): 4d80f03c54b26d9c9fa8743d25ea10fdb925d3e83cf790549fe674ef1bb30e82
incomplete pack file (will be removed): 51fa1fd047bcd77c20e47c082043c0fdad5ca9a89a778ec8db73f505d317c552
incomplete pack file (will be removed): 5556bcc838f471a93987253496287387149efa838274cec4e80b669ac35a808e
incomplete pack file (will be removed): 56c046eb5ef2bba09e97fcfdacf93a6e067b4312bcb175143f3173c72056f294
incomplete pack file (will be removed): 5dde82825ef1bec64e0025af8267a88c4cbed71991adf2ddb9314732bf1bcc57
incomplete pack file (will be removed): 5e5ea8738178f87eaf2c8ffbae98be76813c4fab01e2d449b448fabd8f25a328
incomplete pack file (will be removed): 67a05027f14cffe1d7c4c3443aa2a24b06ba2b1795119a6140ad711a46d2b611
incomplete pack file (will be removed): 69d9348fbec7d9ec6b379cfa68f9454cf6d5a6e883fb4d803a089c6cf8dc8511
incomplete pack file (will be removed): 6e0c006c6a110f2552091488338510ba4dd775cdf6b6c286f798f0c1cd5f7641
incomplete pack file (will be removed): 6fe06bb089f13b35228b9c4d4f7ef81b56eb23a2e4cf3324e7c75e2cfe6fbd99
incomplete pack file (will be removed): 78bb3b5675accd8d9580330ac335201c11b1a7c37e9f9570a0e697a2b6db16a0
incomplete pack file (will be removed): 7a9b3f06db315b20544118d62f6ba23b2c7d2853d416399c6dcc695b99f494bf
incomplete pack file (will be removed): 7b60c70cf6fbcd50f3e8341d06b9febf63e7930c5c03b0a67863f54b246bdf0f
incomplete pack file (will be removed): 7c21d7e4fddb9796825b702d3ecfb175cd093537e3c144853f688b13f896c303
incomplete pack file (will be removed): 7cd8f4fff312b94f25770213c1d200acc85fc429daba4e23559a73c382d4f9e9
incomplete pack file (will be removed): 8120af861f6ad0b61a65c10708611b2fc7c75f46d2c3e817ca165c174a6da23a
incomplete pack file (will be removed): 825576997d32a386a8119e70d593cddfa635589663c0a5dcd1a89e406181bef9
incomplete pack file (will be removed): 835de546094f9a107130f6fc1598c528d934d559047fc91a83c0a0bb5699fce1
incomplete pack file (will be removed): 85969c439487d0e9cb44708a0e451efe2cf790e0592d8748d08e53fe2d226c54
incomplete pack file (will be removed): 8685761e6fcd64e864ed57d303a0b7985684a9c94e1cfe580dc144b700baaffe
incomplete pack file (will be removed): 86b9090107be47b6521facebcb0024494113f4fd0355723f87165013168f5879
incomplete pack file (will be removed): 93b600d37de0a53206a77ac5899050ffeb967f3332271d70f82f72b63e59b9a1
incomplete pack file (will be removed): 9511f6f2f05cb3b7b20f08ca7695e771ad90e44d2515454f47c7b13fbce643fe
incomplete pack file (will be removed): 965bc56924f4e565d4c8a73ae3a5021c0b01f8c77dc0fb3d620651e198d89a8b
incomplete pack file (will be removed): 97ef14e114bcb55e9a7e6adddc7a36de63fa49b130498d52fd9602dd5a370a92
incomplete pack file (will be removed): 995885fea4bb26ab2a35a91c4f42971b72f56cf5a5973a40505efd08e529f5e5
incomplete pack file (will be removed): 99fe6b74cd2f049a4716a11a98019435559fe5458cf4b3ce931a819df38f629e
incomplete pack file (will be removed): 9a9bd04992db9abc35af55271bdc462569085bc5f557e98607218d55f940f9f2
incomplete pack file (will be removed): a5e3e96591d5b8f1ff664fcb9f392d6a8d3f2a68817807b449b6b2d5cd44807e
incomplete pack file (will be removed): a9b83d2a53b85971fce6b932cb12fe138d8c678c61aa744e3ccf1776f2da5582
incomplete pack file (will be removed): ad2ed096fb20b70c5b6c812bb015527792e3fd1c68813fa1d1b11b28c9330f40
incomplete pack file (will be removed): ad52757676f09b5f2732781842b41662f3a01f530e4df50596e7b424f9598036
incomplete pack file (will be removed): aebd964cee68b4674aad7925eba7fc50f215aa660fb4400fa93f1bfb21f5c510
incomplete pack file (will be removed): b0414e75396f94d12403f4490d1ed7854af207177f92f09f6c78cd727ce47a16
incomplete pack file (will be removed): b05ad6cefd9c710b77f17eb3494e6bea307326a2fab5e575c3a8fc9d8b0c6598
incomplete pack file (will be removed): b06bf9ac571fe1a54a515892374066758d8c0e4f2482c9908d8c100ff2e09d79
incomplete pack file (will be removed): b6a2c0c9a7199771323a45e1363d853685ee37660353f04d37beefe06058749f
incomplete pack file (will be removed): b9c6de31ba78b5e2650e4b8c4a9305971b3bc2988768f72cf78835b0044b5ede
incomplete pack file (will be removed): ba6600fc4d825050f9f1e5069be38b4f29777dface814ba69e0e00a8d2b528a3
incomplete pack file (will be removed): bd603a5cbe7c5b7b87b06b88cf20f4365f8dd634962d8a16fc1b7fdcdb418f8a
incomplete pack file (will be removed): bef22a509ca90dc80e2dabe8a79919b9f9c378d3b622254723c870759d17e451
incomplete pack file (will be removed): c00ec8e9d4bb4e93806c05cc1e9668491b3a4fe766a884ce48f706458002f952
incomplete pack file (will be removed): c55e90f54991a13ed43dfcdab457ec9bcf2256918ae2a53fa3872771af60719d
incomplete pack file (will be removed): c624c276eb0cac9e1512fe7c30d264af6b042d4bc380f50f6d42e339fc39fd17
incomplete pack file (will be removed): c82de5147626bcf7ce8a1178e622a16a3ffd667ed3b2e0b77d4352652d967460
incomplete pack file (will be removed): c83d92fd41b97d912dba4e90ff51d0e95d70e8ca71c14bf7e9ebd4741de11d87
incomplete pack file (will be removed): ca621978fc0a083acd278bf95c1be48a25705fbcb4baf47aa9a784f2e6315d97
incomplete pack file (will be removed): ce1afa1c0576f6dae99cbe36344acf13a127b8095fe17a3c3561ab8f4c015386
incomplete pack file (will be removed): ced34237b107bc26076a937e41fe2f4fa911f9debf6b924cf89ce44ef14e6d04
incomplete pack file (will be removed): cf85c61c18318a7bc347c3045108f1fdd40a34e45c0bb5b95c27bdb6c921371a
incomplete pack file (will be removed): cfef28e401d10422993c9884395eae3b9cd4f8c816e3ee2f73c074f2be90dee4
incomplete pack file (will be removed): d3a121f0c1f5eecba14c32fafee91224cfbbfa5e3d826cad9c8cd7aefb634311
incomplete pack file (will be removed): d3c7028122173d4462b962c2be49e48d3396f30aad36eef212f92e8c53f1038b
incomplete pack file (will be removed): d4e812d2344ac29ab4b82cddc3ec4935804564a2d1d8066e7a7bd0a49d0fa1cc
incomplete pack file (will be removed): d95c020f105758092bdc73078944c4d7d8a9bd686179324d16d0e411862cdcc4
incomplete pack file (will be removed): db66193dda16bcfb78d35a15e20e39be8231cc2cce96af95f22cd69868c438da
incomplete pack file (will be removed): e0b47850d43116edaeca994fb443ec160d53477ef5bdd6b156364b17829333e8
incomplete pack file (will be removed): e54aefa0b5ef8a5ab4f8ecf545d570b109f464ec6121b317f5ad43e33a05d334
incomplete pack file (will be removed): e557ec3e88ab92c58e28d8a478a77d2efdcb2b4d5034a8d9ed64d362598d47e8
incomplete pack file (will be removed): e5f78dad87c3fc331e929c11f394462dbbc169b3d1437e2d50c392d6096a4c70
incomplete pack file (will be removed): e71ecf47281e22a8c6fcca8a633b7c6188d3aceedbb091ffee6b8ceacf81e2d4
incomplete pack file (will be removed): ede001dd9775b1c71b11b2213fc403a8c99e9f5c49d4d22403f545b74f125efb
incomplete pack file (will be removed): ef2a027877e8f5db99e2c0afc0b57124dfa51847e885ff5d3edd2826c9bda2fb
incomplete pack file (will be removed): effefee986681b22caedeb9d4d58b4445bd3bdaec85fe4dc7b6080bbcab0567f
incomplete pack file (will be removed): f0df0919bb95f3f7724bd0f72639bf2ff11d814c079e5830c39a21dbcbba72f4
incomplete pack file (will be removed): f46c080b08a4f0a028b121f1daa374f2b4f31ea81daeece259cc9efac61a3264
incomplete pack file (will be removed): f5f8e9a53ced05ed7e3ee5368fdfed10b3db232b5e35219d2002d8ae5480629e
incomplete pack file (will be removed): fb3efd073b85c21717461aa626135e47e1c005f4fbc441d462bd427749670a1c
incomplete pack file (will be removed): fe74838f41ec8aed7777b95a4f043218a22fed6098be633797482128f4d8c21f
repository contains 67287 packs (509507 blobs) with 316.854 GiB
processed 509507 blobs: 4171 duplicate blobs, 4.262 GiB duplicate
load all snapshots
find data that is still in use for 24 snapshots
tree cee759a90802904dcdbe733403dd452f8d709dc637d8fc97b966fc7c07838476 not found in repository
github.com/restic/restic/internal/repository.(*Repository).LoadTree
/restic/internal/repository/repository.go:709
github.com/restic/restic/internal/restic.FindUsedBlobs
/restic/internal/restic/find.go:11
github.com/restic/restic/internal/restic.FindUsedBlobs
/restic/internal/restic/find.go:31
github.com/restic/restic/internal/restic.FindUsedBlobs
/restic/internal/restic/find.go:31
github.com/restic/restic/internal/restic.FindUsedBlobs
/restic/internal/restic/find.go:31
github.com/restic/restic/internal/restic.FindUsedBlobs
/restic/internal/restic/find.go:31
github.com/restic/restic/internal/restic.FindUsedBlobs
/restic/internal/restic/find.go:31
main.pruneRepository
/restic/cmd/restic/cmd_prune.go:191
main.runForget
/restic/cmd/restic/cmd_forget.go:215
main.glob..func10
/restic/cmd/restic/cmd_forget.go:22
github.com/spf13/cobra.(*Command).execute
/restic/vendor/github.com/spf13/cobra/command.go:762
github.com/spf13/cobra.(*Command).ExecuteC
/restic/vendor/github.com/spf13/cobra/command.go:852
github.com/spf13/cobra.(*Command).Execute
/restic/vendor/github.com/spf13/cobra/command.go:800
main.main
/restic/cmd/restic/main.go:86
runtime.main
/usr/local/go/src/runtime/proc.go:200
runtime.goexit
/usr/local/go/src/runtime/asm_amd64.s:1337
Thank you.
This means that some directory can’t be found. The PR I submitted allows restic find to properly determine which snapshots reference this tree. Run restic find --tree cee759a90802904dcdbe733403dd452f8d709dc637d8fc97b966fc7c07838476 and report the results.
Hi @cdhowie
Please find the output from the find command below
PS C:\Users\User> restic -r W:\restic\ find --tree cee759a90802904dcdbe733403dd452f8d709dc637d8fc97b966fc7c07838476
enter password for repository:
repository a6a81653 opened successfully, password is correct
Unable to load tree 1863bb3b262cd010c472dcd2603b1b223296b9ac1c2eef60d05c0b6e59b62b5b
... which belongs to snapshot 464d7afb4d1769329d017bfe61094e00b1e0d6f0745e5aecef82474ae4eb0c01.
Unable to load tree 93633a45a99b8d9b32db7a5dbdd29f2335e066bab97e96cea422027d6f721c4b
... which belongs to snapshot 464d7afb4d1769329d017bfe61094e00b1e0d6f0745e5aecef82474ae4eb0c01.
Unable to load tree 93633a45a99b8d9b32db7a5dbdd29f2335e066bab97e96cea422027d6f721c4b
... which belongs to snapshot 464d7afb4d1769329d017bfe61094e00b1e0d6f0745e5aecef82474ae4eb0c01.
Unable to load tree 93633a45a99b8d9b32db7a5dbdd29f2335e066bab97e96cea422027d6f721c4b
... which belongs to snapshot 464d7afb4d1769329d017bfe61094e00b1e0d6f0745e5aecef82474ae4eb0c01.
Unable to load tree 93633a45a99b8d9b32db7a5dbdd29f2335e066bab97e96cea422027d6f721c4b
... which belongs to snapshot 464d7afb4d1769329d017bfe61094e00b1e0d6f0745e5aecef82474ae4eb0c01.
Unable to load tree 93633a45a99b8d9b32db7a5dbdd29f2335e066bab97e96cea422027d6f721c4b
... which belongs to snapshot 464d7afb4d1769329d017bfe61094e00b1e0d6f0745e5aecef82474ae4eb0c01.
Unable to load tree fd5a2197e3af5857c8040244f671e484329237e62d0e15ce0d6e5fc6bb5d9cb1
... which belongs to snapshot 464d7afb4d1769329d017bfe61094e00b1e0d6f0745e5aecef82474ae4eb0c01.
Unable to load tree fd5a2197e3af5857c8040244f671e484329237e62d0e15ce0d6e5fc6bb5d9cb1
... which belongs to snapshot 464d7afb4d1769329d017bfe61094e00b1e0d6f0745e5aecef82474ae4eb0c01.
Unable to load tree fd5a2197e3af5857c8040244f671e484329237e62d0e15ce0d6e5fc6bb5d9cb1
... which belongs to snapshot 464d7afb4d1769329d017bfe61094e00b1e0d6f0745e5aecef82474ae4eb0c01.
Unable to load tree fd5a2197e3af5857c8040244f671e484329237e62d0e15ce0d6e5fc6bb5d9cb1
... which belongs to snapshot 464d7afb4d1769329d017bfe61094e00b1e0d6f0745e5aecef82474ae4eb0c01.
Unable to load tree 93633a45a99b8d9b32db7a5dbdd29f2335e066bab97e96cea422027d6f721c4b
... which belongs to snapshot 464d7afb4d1769329d017bfe61094e00b1e0d6f0745e5aecef82474ae4eb0c01.
Unable to load tree 93633a45a99b8d9b32db7a5dbdd29f2335e066bab97e96cea422027d6f721c4b
... which belongs to snapshot 464d7afb4d1769329d017bfe61094e00b1e0d6f0745e5aecef82474ae4eb0c01.
Unable to load tree 93633a45a99b8d9b32db7a5dbdd29f2335e066bab97e96cea422027d6f721c4b
... which belongs to snapshot 464d7afb4d1769329d017bfe61094e00b1e0d6f0745e5aecef82474ae4eb0c01.
Unable to load tree 93633a45a99b8d9b32db7a5dbdd29f2335e066bab97e96cea422027d6f721c4b
... which belongs to snapshot 464d7afb4d1769329d017bfe61094e00b1e0d6f0745e5aecef82474ae4eb0c01.
Unable to load tree 93633a45a99b8d9b32db7a5dbdd29f2335e066bab97e96cea422027d6f721c4b
... which belongs to snapshot 464d7afb4d1769329d017bfe61094e00b1e0d6f0745e5aecef82474ae4eb0c01.
Unable to load tree 93633a45a99b8d9b32db7a5dbdd29f2335e066bab97e96cea422027d6f721c4b
... which belongs to snapshot 464d7afb4d1769329d017bfe61094e00b1e0d6f0745e5aecef82474ae4eb0c01.
Unable to load tree 93633a45a99b8d9b32db7a5dbdd29f2335e066bab97e96cea422027d6f721c4b
... which belongs to snapshot 464d7afb4d1769329d017bfe61094e00b1e0d6f0745e5aecef82474ae4eb0c01.
Unable to load tree 93633a45a99b8d9b32db7a5dbdd29f2335e066bab97e96cea422027d6f721c4b
... which belongs to snapshot 464d7afb4d1769329d017bfe61094e00b1e0d6f0745e5aecef82474ae4eb0c01.
Unable to load tree 1776df451f4e24bc0f3ec78b96c4700a7d3c398a7f42194498c3d5cc862373b9
... which belongs to snapshot 464d7afb4d1769329d017bfe61094e00b1e0d6f0745e5aecef82474ae4eb0c01.
Unable to load tree 2a0f82b818b5d5a10e7372a33ea1bfdbf38d5c2fde2e14d7327a1c5251671eaf
... which belongs to snapshot 464d7afb4d1769329d017bfe61094e00b1e0d6f0745e5aecef82474ae4eb0c01.This is the snapshot ID that the missing trees belong to. If you are willing to forget this snapshot, that should repair the repository.
Thank you, I will give that a try and update you.
I have forgotten the snapshot ID and performing the prune operation now. Will keep you posted once done. Thank you.
Hi, I was just wondering if Prune can be done in parts similar to the Check function? I am unable to complete the prune job in one go.
Thanks.
No, this is not currently possible. The prune operation as a whole relies on the repository not changing while it works, which is why it requires an exclusive lock. Any support for resuming a prune operation would require that the repository has not changed since the operation was paused, which ultimately defeats the purpose of pausing in the first place.
Thank you for the update.
Just wondering what happens when the network disconnects during a prune job or of the PC goes to sleep? Since in my case the job seemed to have continued was wondering if it works differently from say when a prune job is terminated?
If the job is able to resume from network disconnections or system sleep, is there a way to trigger a state where the job terminates under the assumption that the system is at sleep or disconnected while being able to resume upon start? Even if this can be done (theoretically) in combination with a third party application would be useful.
E.g. What happens if I put a VM running this job to sleep and resume the VM when I am back at my desk?
I haven’t tried this out yet since the thought just occurred to me but I can test it out when my current prune job completes. What are the risks I should be aware of other than me forcefully unlocking the repository to perform new backups?
Hi @cdhowie I have finally managed to perform the prune operations. It did throw some errors but it didn’t quit on me so that is a good sign.
PS C:\Users\User> restic -r W:\restic\ prune
enter password for repository:
repository a6a81653 opened successfully, password is correct
counting files in repo
building new index for repo
pack file cannot be listed c73f7907ec431081ea9fc6b28a13b898e9c6fd59bc14d863e785b241da671106: read \\?\W:\restic\data\c7\c73f7907ec431081ea9fc6b28a13b898e9c6fd59bc14d863e785b241da671106: The specified network name is no longer available.
[22:46:39] 100.00% 67453 / 67453 packs
incomplete pack file (will be removed): 00b95d3dbe2837cea815ea7a581b67076beffaaa38086a61242080aed2ed98c9
incomplete pack file (will be removed): 01adbbb734c69f44edc28a6eb9ae32af12066c88a051c0d1373fb0b6e31394b5
incomplete pack file (will be removed): 05f8b33c3cf34b810674ef1ba74aed7b1a8bac124b7ac66c68acb317668698ae
incomplete pack file (will be removed): 08471b76322a1eec5ac4a449b2a85268acf0ad9fa87710ce513b2273d67a6a77
incomplete pack file (will be removed): 091334c8820e89a95b842cb79c56c1b1ef412e010e982c658ed3da626e57fa42
incomplete pack file (will be removed): 0d8532d83351f32da5148fb4c4f29f6b2c3ab89eea8f45ab402f39a49dacff43
incomplete pack file (will be removed): 103bf3d9f8bcc693cfac4594321986025022457bd99be0ca29c510fe291f784a
incomplete pack file (will be removed): 122680b08d3ead87b0cbf7b8eba6578d3d41862f409941715177a1ab697dcc30
incomplete pack file (will be removed): 149dc4a7cb1e16eda5c6ef85d9a76603b49212341f724966587eb5547a92772a
incomplete pack file (will be removed): 16a6efecf06212578d93da2eff64beccda74689419502653669e1b8aa71ba198
incomplete pack file (will be removed): 1702154a54cea939550c9c17fa207bbdda2c87e1cc7e4a130edf94ccd87ecb15
incomplete pack file (will be removed): 1c361b7eee246326fa056a15a2f68b3e44cecdcee5db5dd76add962e991e5217
incomplete pack file (will be removed): 1cfb083bdeeacc4f965c9b2f13ed2a52bb734f14130f3cc2b4a8ac96069ea676
incomplete pack file (will be removed): 1d3e916030782a9d0f436dc427e452686445d5d4ddb8f0e23f7cdbcea367e501
incomplete pack file (will be removed): 1f2ed678442e84d9e3b6753b5b0d3d7fdb84881938ce66aa30c4644c1f11fdd1
incomplete pack file (will be removed): 23ae6618800394d18cf2eafecc6e71d0593123969c29efd0f326a9248df9972e
incomplete pack file (will be removed): 2540d81237718850dcfdbfdef81db763a1da29549352635807a163bbc33297ba
incomplete pack file (will be removed): 27ff0640ea75473b585afdc75375d7230b0d2218cced41b40adc325207e02c0b
incomplete pack file (will be removed): 2d35df290b871691a4cfe1b2af19c3550e01a61143d2a47af451c1444f028222
incomplete pack file (will be removed): 31c1d8ef61bef45f25f99b613c911bcc0fd143e94ea6a140c299b98e2da3c93a
incomplete pack file (will be removed): 31feca6b44962504cc79875f1c9156f1a6e19bdb7db358e1a84c15be8069a514
incomplete pack file (will be removed): 331f37c65819e6de9eb338ae06dbffb0553721f8d148cb65893f861ef6cfa374
incomplete pack file (will be removed): 3ac7a7ec55cf416b9b6278858dea32e849576820d126b4228cad6d7079e4463b
incomplete pack file (will be removed): 41fda4863e93a36b4dc7ab8e4937d67ac68b192c361845b6d630a8496beb3626
incomplete pack file (will be removed): 4554c51ef9ea179ce950161e4d8b8e8f4c134992a23cc87fe3d6ea9b282d03ca
incomplete pack file (will be removed): 48ea114a1c24c6878fbc1dec4e5fa2cbc69cab9058240ad1164d13fa72daf1ec
incomplete pack file (will be removed): 4b3f7eea4a3bd9eb3a8f9096e5021ae15d9e58749f69ff0db92723a32e524649
incomplete pack file (will be removed): 4d80f03c54b26d9c9fa8743d25ea10fdb925d3e83cf790549fe674ef1bb30e82
incomplete pack file (will be removed): 51fa1fd047bcd77c20e47c082043c0fdad5ca9a89a778ec8db73f505d317c552
incomplete pack file (will be removed): 5556bcc838f471a93987253496287387149efa838274cec4e80b669ac35a808e
incomplete pack file (will be removed): 56c046eb5ef2bba09e97fcfdacf93a6e067b4312bcb175143f3173c72056f294
incomplete pack file (will be removed): 5dde82825ef1bec64e0025af8267a88c4cbed71991adf2ddb9314732bf1bcc57
incomplete pack file (will be removed): 5e5ea8738178f87eaf2c8ffbae98be76813c4fab01e2d449b448fabd8f25a328
incomplete pack file (will be removed): 67a05027f14cffe1d7c4c3443aa2a24b06ba2b1795119a6140ad711a46d2b611
incomplete pack file (will be removed): 69d9348fbec7d9ec6b379cfa68f9454cf6d5a6e883fb4d803a089c6cf8dc8511
incomplete pack file (will be removed): 6e0c006c6a110f2552091488338510ba4dd775cdf6b6c286f798f0c1cd5f7641
incomplete pack file (will be removed): 6fe06bb089f13b35228b9c4d4f7ef81b56eb23a2e4cf3324e7c75e2cfe6fbd99
incomplete pack file (will be removed): 78bb3b5675accd8d9580330ac335201c11b1a7c37e9f9570a0e697a2b6db16a0
incomplete pack file (will be removed): 7a9b3f06db315b20544118d62f6ba23b2c7d2853d416399c6dcc695b99f494bf
incomplete pack file (will be removed): 7b60c70cf6fbcd50f3e8341d06b9febf63e7930c5c03b0a67863f54b246bdf0f
incomplete pack file (will be removed): 7c21d7e4fddb9796825b702d3ecfb175cd093537e3c144853f688b13f896c303
incomplete pack file (will be removed): 7cd8f4fff312b94f25770213c1d200acc85fc429daba4e23559a73c382d4f9e9
incomplete pack file (will be removed): 8120af861f6ad0b61a65c10708611b2fc7c75f46d2c3e817ca165c174a6da23a
incomplete pack file (will be removed): 825576997d32a386a8119e70d593cddfa635589663c0a5dcd1a89e406181bef9
incomplete pack file (will be removed): 835de546094f9a107130f6fc1598c528d934d559047fc91a83c0a0bb5699fce1
incomplete pack file (will be removed): 85969c439487d0e9cb44708a0e451efe2cf790e0592d8748d08e53fe2d226c54
incomplete pack file (will be removed): 8685761e6fcd64e864ed57d303a0b7985684a9c94e1cfe580dc144b700baaffe
incomplete pack file (will be removed): 86b9090107be47b6521facebcb0024494113f4fd0355723f87165013168f5879
incomplete pack file (will be removed): 93b600d37de0a53206a77ac5899050ffeb967f3332271d70f82f72b63e59b9a1
incomplete pack file (will be removed): 9511f6f2f05cb3b7b20f08ca7695e771ad90e44d2515454f47c7b13fbce643fe
incomplete pack file (will be removed): 965bc56924f4e565d4c8a73ae3a5021c0b01f8c77dc0fb3d620651e198d89a8b
incomplete pack file (will be removed): 97ef14e114bcb55e9a7e6adddc7a36de63fa49b130498d52fd9602dd5a370a92
incomplete pack file (will be removed): 995885fea4bb26ab2a35a91c4f42971b72f56cf5a5973a40505efd08e529f5e5
incomplete pack file (will be removed): 99fe6b74cd2f049a4716a11a98019435559fe5458cf4b3ce931a819df38f629e
incomplete pack file (will be removed): 9a9bd04992db9abc35af55271bdc462569085bc5f557e98607218d55f940f9f2
incomplete pack file (will be removed): a5e3e96591d5b8f1ff664fcb9f392d6a8d3f2a68817807b449b6b2d5cd44807e
incomplete pack file (will be removed): a9b83d2a53b85971fce6b932cb12fe138d8c678c61aa744e3ccf1776f2da5582
incomplete pack file (will be removed): ad2ed096fb20b70c5b6c812bb015527792e3fd1c68813fa1d1b11b28c9330f40
incomplete pack file (will be removed): ad52757676f09b5f2732781842b41662f3a01f530e4df50596e7b424f9598036
incomplete pack file (will be removed): aebd964cee68b4674aad7925eba7fc50f215aa660fb4400fa93f1bfb21f5c510
incomplete pack file (will be removed): b0414e75396f94d12403f4490d1ed7854af207177f92f09f6c78cd727ce47a16
incomplete pack file (will be removed): b05ad6cefd9c710b77f17eb3494e6bea307326a2fab5e575c3a8fc9d8b0c6598
incomplete pack file (will be removed): b06bf9ac571fe1a54a515892374066758d8c0e4f2482c9908d8c100ff2e09d79
incomplete pack file (will be removed): b6a2c0c9a7199771323a45e1363d853685ee37660353f04d37beefe06058749f
incomplete pack file (will be removed): b9c6de31ba78b5e2650e4b8c4a9305971b3bc2988768f72cf78835b0044b5ede
incomplete pack file (will be removed): ba6600fc4d825050f9f1e5069be38b4f29777dface814ba69e0e00a8d2b528a3
incomplete pack file (will be removed): bd603a5cbe7c5b7b87b06b88cf20f4365f8dd634962d8a16fc1b7fdcdb418f8a
incomplete pack file (will be removed): bef22a509ca90dc80e2dabe8a79919b9f9c378d3b622254723c870759d17e451
incomplete pack file (will be removed): c00ec8e9d4bb4e93806c05cc1e9668491b3a4fe766a884ce48f706458002f952
incomplete pack file (will be removed): c55e90f54991a13ed43dfcdab457ec9bcf2256918ae2a53fa3872771af60719d
incomplete pack file (will be removed): c624c276eb0cac9e1512fe7c30d264af6b042d4bc380f50f6d42e339fc39fd17
incomplete pack file (will be removed): c82de5147626bcf7ce8a1178e622a16a3ffd667ed3b2e0b77d4352652d967460
incomplete pack file (will be removed): c83d92fd41b97d912dba4e90ff51d0e95d70e8ca71c14bf7e9ebd4741de11d87
incomplete pack file (will be removed): ca621978fc0a083acd278bf95c1be48a25705fbcb4baf47aa9a784f2e6315d97
incomplete pack file (will be removed): ce1afa1c0576f6dae99cbe36344acf13a127b8095fe17a3c3561ab8f4c015386
incomplete pack file (will be removed): ced34237b107bc26076a937e41fe2f4fa911f9debf6b924cf89ce44ef14e6d04
incomplete pack file (will be removed): cf85c61c18318a7bc347c3045108f1fdd40a34e45c0bb5b95c27bdb6c921371a
incomplete pack file (will be removed): cfef28e401d10422993c9884395eae3b9cd4f8c816e3ee2f73c074f2be90dee4
incomplete pack file (will be removed): d3a121f0c1f5eecba14c32fafee91224cfbbfa5e3d826cad9c8cd7aefb634311
incomplete pack file (will be removed): d3c7028122173d4462b962c2be49e48d3396f30aad36eef212f92e8c53f1038b
incomplete pack file (will be removed): d4e812d2344ac29ab4b82cddc3ec4935804564a2d1d8066e7a7bd0a49d0fa1cc
incomplete pack file (will be removed): d95c020f105758092bdc73078944c4d7d8a9bd686179324d16d0e411862cdcc4
incomplete pack file (will be removed): db66193dda16bcfb78d35a15e20e39be8231cc2cce96af95f22cd69868c438da
incomplete pack file (will be removed): e0b47850d43116edaeca994fb443ec160d53477ef5bdd6b156364b17829333e8
incomplete pack file (will be removed): e54aefa0b5ef8a5ab4f8ecf545d570b109f464ec6121b317f5ad43e33a05d334
incomplete pack file (will be removed): e557ec3e88ab92c58e28d8a478a77d2efdcb2b4d5034a8d9ed64d362598d47e8
incomplete pack file (will be removed): e5f78dad87c3fc331e929c11f394462dbbc169b3d1437e2d50c392d6096a4c70
incomplete pack file (will be removed): e71ecf47281e22a8c6fcca8a633b7c6188d3aceedbb091ffee6b8ceacf81e2d4
incomplete pack file (will be removed): ede001dd9775b1c71b11b2213fc403a8c99e9f5c49d4d22403f545b74f125efb
incomplete pack file (will be removed): ef2a027877e8f5db99e2c0afc0b57124dfa51847e885ff5d3edd2826c9bda2fb
incomplete pack file (will be removed): effefee986681b22caedeb9d4d58b4445bd3bdaec85fe4dc7b6080bbcab0567f
incomplete pack file (will be removed): f0df0919bb95f3f7724bd0f72639bf2ff11d814c079e5830c39a21dbcbba72f4
incomplete pack file (will be removed): f46c080b08a4f0a028b121f1daa374f2b4f31ea81daeece259cc9efac61a3264
incomplete pack file (will be removed): f5f8e9a53ced05ed7e3ee5368fdfed10b3db232b5e35219d2002d8ae5480629e
incomplete pack file (will be removed): fb3efd073b85c21717461aa626135e47e1c005f4fbc441d462bd427749670a1c
incomplete pack file (will be removed): fe74838f41ec8aed7777b95a4f043218a22fed6098be633797482128f4d8c21f
repository contains 67356 packs (509998 blobs) with 317.166 GiB
processed 509998 blobs: 4171 duplicate blobs, 4.262 GiB duplicate
load all snapshots
find data that is still in use for 27 snapshots
[1:12] 100.00% 27 / 27 snapshots
found 466284 of 509998 data blobs still in use, removing 43714 blobs
will remove 96 invalid files
will delete 195 packs and rewrite 5814 packs, this frees 4.955 GiB
[3:55:54] 100.00% 5814 / 5814 packs rewritten
counting files in repo
List(data) returned error, retrying after 552.330144ms: FindNextFile \\?\W:\restic\data\26: The specified network name is no longer available.
[0:00] 0.00% 0 / 4677 packs
finding old index files
saved new indexes as []
remove 0 old index files
Remove(<data/65329d1589>) returned error, retrying after 720.254544ms: Chmod: chmod \\?\W:\restic\data\65\65329d158920a6b499e26c0fad01c6e9b93122462395a4f42611a614c5da541d: The network path was not found.
Remove(<data/65329d1589>) returned error, retrying after 873.42004ms: Chmod: chmod \\?\W:\restic\data\65\65329d158920a6b499e26c0fad01c6e9b93122462395a4f42611a614c5da541d: The network path was not found.
Remove(<data/65329d1589>) returned error, retrying after 1.054928461s: Chmod: chmod \\?\W:\restic\data\65\65329d158920a6b499e26c0fad01c6e9b93122462395a4f42611a614c5da541d: The network path was not found.
Remove(<data/65329d1589>) returned error, retrying after 1.560325776s: Chmod: chmod \\?\W:\restic\data\65\65329d158920a6b499e26c0fad01c6e9b93122462395a4f42611a614c5da541d: The network path was not found.
[22:51] 100.00% 6009 / 6009 packs deleted
doneIt looks like those errors can be ignored. The “incomplete pack file” errors simply indicate where a backup process was in the middle of writing a pack file and was terminated. These incomplete pack files are not used for deduplication; their presence is not an error but simply garbage that prune cleans up.
It does look like it had difficulty deleting a file due to some transient network issue, as evidenced by the error message. However, it retried a few times and eventually succeeded.
Looks like everything is in good shape now!
This is awesome! Thank you for helping me with this!