I would just try it out, podman unshare restic backup ...
You should run restic inside of a modified user namespace in that case and have the right permissions to access the required files.
If there are files unaccessible, you should get a warning.
If you can leverage root on the host, you could try podman mount as well.
Also, there are docs for non root setups, but not specifically for podman.