Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Zstandard has a dictionary functionality which allows you to pre-train on sample data to achieve higher compression ratios and faster compression on large numbers of small files.


Don't you then need to store that dictionary somewhere out of band? It seems like you would still need a tar-like format to manage that, at which point as an archive format it seems more complicated with a worse separation of concerns.


Interesting - does it fit that automatically or is there a manual step?




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: