Soofi: European sovereign LLM trained in 2 months
huggingface.co
Soofi: European sovereign LLM trained in 2 months
1–7 of 7 posts
Re: Soofi: European sovereign LLM trained in 2 months
#2one of the authors here, AMA.
Re: Soofi: European sovereign LLM trained in 2 months
#3one of the authors here, AMA.
What sort of regulations did you run into while gathering training data?
Re: Soofi: European sovereign LLM trained in 2 months
#4[flagged]
Re: Soofi: European sovereign LLM trained in 2 months
#5one of the authors here, AMA.
What sort of regulations did you run into while gathering training data?
The main constraint was licensing rather than regulations like GDPR. To ensure compliance, we restricted ourselves to datasets with permissive licenses.
The one exception was the Genios dataset (a high-quality German corpus), which we used during pretraining under a separate licensing agreement. Beyond that, the growing availability of high-quality permissive datasets meant we could assemble sufficient training data without compromising on quality.
Re: Soofi: European sovereign LLM trained in 2 months
#6[flagged]
I would think it's the fact that there's no secret sauce except data and compute to get to a decent model along with a good team. It's a Nemtron 3 Nano architecture as far as I understand, and of course there seems to be some special data curation for German.
Re: Soofi: European sovereign LLM trained in 2 months
#7one of the authors here, AMA.
[deleted]