Hi,
I was wondering if someone could shed some light? As I have a restic script which prunes every day not sure whats the rule of thumb for pruning. As im getting a log from the backup saying this
May 09 2018 23:01:01 -05: backup-script started
open repository
lock repository
load index files
using parent snapshot 5149ccfd
start scan
start backup
scan: Readdirnames: readdirent: no such file or directory
scan: Readdirnames: readdirent: no such file or directory
scan: Readdirnames: readdirent: no such file or directory
scan: Readdirnames: readdirent: no such file or directory
scan: Readdirnames: readdirent: no such file or directory
scan finished in 296.211s
uploaded intermediate index 741fda90
uploaded intermediate index c72aa6f4
uploaded intermediate index 94830a86
processed 422.920 GiB in 18:01
Files: 1604 new, 308 changed, 352688 unmodified
Dirs: 234 new, 26766 changed, 0 unmodified
Added: 1.671 GiB
snapshot e5c4f347 saved
Applying Policy: keep the last 90 snapshots snapshots
snapshots for (host [prometheus2], paths [/media/smb]):
keep 2 snapshots:
ID Date Host Tags Directory
----------------------------------------------------------------------
5149ccfd 2018-05-03 21:42:21 prometheus2 /media/smb
e5c4f347 2018-05-09 23:01:07 prometheus2 /media/smb
----------------------------------------------------------------------
2 snapshots
using temporary cache in /tmp/restic-check-cache-402911612
create exclusive lock for repository
load indexes
check all packs
check snapshots, trees and blobs
no errors were found
-------------------------------------------------------------------------------
May 10 2018 00:25:49 -05: backup-script finished
Interesting, it may have happened because a sub-directory (that was there when the parent directory was listed) suddenly disappeared when restic tried to read it.
Is this reproducible? Can you please create a debug log and have a look what’s going on?
We need to improve the error message here to at least include the file/dir name…
just posting backup still getting the error, here is the log of the backup
May 13 2018 21:09:11 -05: backup-script started
open repository
lock repository
load index files
using parent snapshot cf48e1d0
start scan on [/media/smb]
start backup on [/media/smb]
scan: Readdirnames: readdirent: no such file or directory
scan: Readdirnames: readdirent: no such file or directory
scan: Readdirnames: readdirent: no such file or directory
scan: Readdirnames: readdirent: no such file or directory
scan: Readdirnames: readdirent: no such file or directory
scan finished in 162.915s: 354784 files, 422.989 GiB
Files: 0 new, 2 changed, 354779 unmodified
Dirs: 0 new, 1 changed, 0 unmodified
Data Blobs: 0 new
Tree Blobs: 2 new
Added: 735 B
processed 354781 files, 422.989 GiB in 12:16
snapshot 2372ef89 saved
Applying Policy: keep the last 90 snapshots snapshots
snapshots for (host [prometheus2], paths [/media/smb]):
keep 6 snapshots:
ID Date Host Tags Directory
----------------------------------------------------------------------
5149ccfd 2018-05-03 21:42:21 prometheus2 /media/smb
e5c4f347 2018-05-09 23:01:07 prometheus2 /media/smb
18dfcdaa 2018-05-10 23:01:06 prometheus2 /media/smb
e72b19e8 2018-05-11 21:04:49 prometheus2 /media/smb
cf48e1d0 2018-05-12 21:22:48 prometheus2 /media/smb
2372ef89 2018-05-13 21:09:27 prometheus2 /media/smb
----------------------------------------------------------------------
6 snapshots
counting files in repo
building new index for repo
[31:06] 100.00% 69490 / 69490 packs
repository contains 69490 packs (541434 blobs) with 324.049 GiB
processed 541434 blobs: 0 duplicate blobs, 0B duplicate
load all snapshots
find data that is still in use for 6 snapshots
[0:38] 100.00% 6 / 6 snapshots
found 541434 of 541434 data blobs still in use, removing 0 blobs
will remove 0 invalid files
will delete 0 packs and rewrite 0 packs, this frees 0B
counting files in repo
[31:00] 100.00% 69490 / 69490 packs
finding old index files
saved new indexes as [98516385 d2b36af3 8f964cd5 6ec66a5d 0f200571 199da406 0fb8ae02 1c48d5f7 a28e034f 828b3294 69a4f7af 307a518d 62a17279 fbdad2b0 9e449648 0085b47a 40fec6d2 6fef32e1 1573e29c 505760b6 9d06e048 059a91aa 776f647c 8f5f8db4]
remove 25 old index files
done
using temporary cache in /tmp/restic-check-cache-006233305
create exclusive lock for repository
load indexes
check all packs
check snapshots, trees and blobs
no errors were found
Hm, which version of restic was that? I’ve only just merged the PR to master, so now you can find a binary which includes the improved error message here: https://beta.restic.net/?sort=time&order=desc
May 14 2018 22:00:18 -05: backup-script started
open repository
lock repository
load index files
using parent snapshot 2372ef89
start scan on [/media/smb]
start backup on [/media/smb]
scan: Readdirnames /media/smb/Sistemas de Gestion/DOCUMENTACIĂ“N/GESTIONAR EL TALENTO HUMANO/DOCUMENTACIĂ“N SEGURIDAD Y SALUD EN EL TRABAJO/DOCUMENTACION SST/CONTRATISTAS/SG SST S.A.S./01.PLANEAR failed: readdirent: no such file or directory: readdirent: no such file or directory
scan: Readdirnames /media/smb/Sistemas de Gestion/DOCUMENTACIĂ“N/GESTIONAR EL TALENTO HUMANO/DOCUMENTACIĂ“N SEGURIDAD Y SALUD EN EL TRABAJO/DOCUMENTACION SST/CONTRATISTAS/SG SST S.A.S./02.HACER failed: readdirent: no such file or directory: readdirent: no such file or directory
scan: Readdirnames /media/smb/Sistemas de Gestion/DOCUMENTACIĂ“N/GESTIONAR EL TALENTO HUMANO/DOCUMENTACIĂ“N SEGURIDAD Y SALUD EN EL TRABAJO/DOCUMENTACION SST/CONTRATISTAS/SG SST S.A.S./03.VERIIFICAR failed: readdirent: no such file or directory: readdirent: no such file or directory
scan: Readdirnames /media/smb/Sistemas de Gestion/DOCUMENTACIĂ“N/GESTIONAR EL TALENTO HUMANO/DOCUMENTACIĂ“N SEGURIDAD Y SALUD EN EL TRABAJO/DOCUMENTACION SST/CONTRATISTAS/SG SST S.A.S./04.AJUSTAR failed: readdirent: no such file or directory: readdirent: no such file or directory
scan: Readdirnames /media/smb/Sistemas de Gestion/DOCUMENTACIĂ“N/GESTIONAR EL TALENTO HUMANO/DOCUMENTACIĂ“N SEGURIDAD Y SALUD EN EL TRABAJO/DOCUMENTACION SST/CONTRATISTAS/SG SST S.A.S./05.LEGISLACION failed: readdirent: no such file or directory: readdirent: no such file or directory
scan finished in 241.144s: 354784 files, 422.989 GiB
I checked for the files on the smb share and they were there. Maybe its because it has 01. and so forth?
Then i mounted the snapshot to check if the files were there and they were not.
I’ve got no idea why the readdir failed. How do you run restic? directly on Windows, or via WLS? Can you try listing the directory on the command line?
Thanks for the reply, im using a debian machine to mount the smb share of windows and i mount NAS on which restic backups the information of the windows machine to the NAS all using restic which is hosted on the debian machine
Whats odd is that when i try to cd the location on Debian im getting this
root@prometheus2:/media/smb/Sistemas de Gestion/DOCUMENTACIĂ“N/GESTIONAR EL TALENTO HUMANO/DOCUMENTACIĂ“N SEGURIDAD Y SALUD EN EL TRABAJO/DOCUMENTACION SST/CONTRATISTAS# cd SG\ SST\ S.A.S/0
-bash: cd: SG SST HOMOTEC S.A.S/0: No such file or directory
So odd im going to maybe change the name of the folder
Thanks for the reply, that’s correct i changed the name of the folder and it was fixed, the new update you pushed really did help me find the location of the folder really appreciate it