Archive Public Hugging Face Models and Datasets as Immutable, Verifiable Trees
1–4 of 4 posts
Re: Archive Public Hugging Face Models and Datasets as Immutable, Verifiable Trees
#2If you have a NAS and want to back up open weight models with a little more structure than just "download and store" I created this toy project. It's actually working quite well for me already.
Re: Archive Public Hugging Face Models and Datasets as Immutable, Verifiable Trees
#3Potentially related: check out https://news.ycombinator.com/item?id=48867720, https://huggingbay.xyz/start was hosting these as torrents but appears to be down now (ssl proto error). Similar to https://academictorrents.com/
Publishing as a torrent solves for hash verification (assuming new torrents vs mutable torrents for underlying changes) and ease of sharing (imho).
Re: Archive Public Hugging Face Models and Datasets as Immutable, Verifiable Trees
#4Potentially related: check out https://news.ycombinator.com/item?id=48867720 , https://huggingbay.xyz/start was hosting these as torrents but appears to be down now (ssl proto error). Similar to https://academictorrents.com/ Publishing as a torrent solves for hash verification (assuming new torrents vs mutable torrents for underlying changes) and ease of sharing (imho).
Torrenting is a great solution as well. For now I just wanted direct download. Thanks for sharing those links!