Thanks for sharing all those details about your approach!
To make sure I created another topic.
To make sure I understand right: You mean filesystem paths?
Did you identify the main reason for the high amount of time? Do you have any guess about the “overhead” caused by the hard links - compared to a single file scenario (without hard links)?