Is there any data about CDC?

[nevermore]

As the title show, restic use the CDC split the file into small files. But why restic use a 64-byte slide window and 1MB average chunk size? Is there any data support this?

[marco-m]

See

• restic · Foundation - Introducing Content Defined Chunking (CDC)
• Dedup only 0.3% efficient on 100% duplicate data
• Is it possible to change/suggest/hint different blob/pack file sizes?

[nevermore]

Thanks a lot. It’s very helpful for me.