Input/output error on large image/video files even though I can still open them locally?

Getting Help
1

I’m backing up a nextcloud directory which contains image files / videos that can be ~2-5gb in size. On a few of these I get the following read i/o err - although I can still open them in both the nextcloud web interface of nextcloud as well as my local machine.

using docker-compose, backing up to Azure blob storage and calling

docker compose -f restic.yaml \
    run --rm restic \
    -r azure:nextcloud:/ \
    --verbose backup \
    --files-from ./nextcloud.files \
    --exclude ./exclude.txt 

start scan on [/backup/nextcloud/db /backup/nextcloud/config /backup/nextcloud/nextcloud]
start backup on [/backup/nextcloud/db /backup/nextcloud/config /backup/nextcloud/nextcloud]
scan finished in 11.059s: 143487 files, 215.745 GiB
error: read /backup/**/files_trashbin/files/VID_20220106_113527.mp4.d1689327829: input/output error
error: read /backup/**/files_versions/InstantUpload/Movies/2022/06/VID_20220624_223245.mp4.v1656103048: input/output error
error: read /backup/**/InstantUpload/Movies/2022/06/VID_20220624_173217.mp4: input/output error
error: read /backup/**/InstantUpload/Camera/2021/10/IMG_20211014_163406.jpg: input/output error
error: read /backup/**/InstantUpload/Camera/2021/11/IMG_20211125_135256.jpg: input/output error
error: read /backup/**/InstantUpload/Camera/2021/11/IMG_20211125_135258.jpg: input/output error
error: read /backup/**/InstantUpload/Camera/2022/01/VID_20220125_163337.mp4: input/output error
error: read /backup/**/InstantUpload/Camera/2021/10/VID_20211020_143007.mp4: input/output error
error: read /backup/**/InstantUpload/Camera/2022/03/IMG_20220324_174648.jpg: input/output error
error: read /backup/**/InstantUpload/Camera/2022/03/IMG_20220324_174653.jpg: input/output error
error: read /backup/**/InstantUpload/Camera/2022/03/IMG_20220324_174658.jpg: input/output error
error: read /backup/**/InstantUpload/Camera/2022/04/VID_20220422_114912.mp4: input/output error
error: read /backup/**/InstantUpload/Camera/2022/06/IMG_20220617_220635.jpg: input/output error
error: read /backup/**/InstantUpload/Camera/2022/06/IMG_20220617_220713.jpg: input/output error
error: read /backup/**/InstantUpload/Camera/2022/06/VID_20220605_125920.mp4: input/output error
error: read /backup/**/InstantUpload/Camera/2022/07/VID_20220711_225032986.mp4: input/output error
error: read /backup/**/InstantUpload/Camera/2022/02/VID_20220214_150631.mp4: input/output error
error: read /backup/**/InstantUpload/Camera/2023/04/VID_20230403_140327.mp4: input/output error
error: read /backup/**/InstantUpload/Camera/2023/02/VID_20230218_165506317.mp4: input/output error

Files:           7 new,     5 changed, 143456 unmodified
Dirs:           23 new,    40 changed, 117287 unmodified
Data Blobs:     17 new
Tree Blobs:     59 new
Added to the repository: 20.642 MiB (5.410 MiB stored)
2

How is the nextcloud folder mounted into the restic container? Does restic run on the same host as nextcloud? Which restic version are you using?

3

Hi, thanks for the reply

Folder is mounted in the compose file and after enabling nextcloud maintenance mode using a bind volume mount. Restic is same host, latest version from docker, 0.15.2

4

Hmm, on what filesystem is the nextcloud folder stored? And how is it attached to the host? Are there any errors printed by dmesg -H? With a bind mounted filesystem, an input/output error error usually indicates some problem at the hardware level. As the error only seems to appear for restic, I’m wondering whether maybe an overloaded USB controller is involved?

5

Hi

It’s an EXT4 & sata hdd, no dmesg errs and it only produces this on large files… Its structurally on the same files. Hmm. Good questions!