Norway's 2 petabytes of Huawei flash storage and LLM training
blocksandfiles.com
Norway's 2 petabytes of Huawei flash storage and LLM training
1–10 of 227 posts
Re: Norway's 2 petabytes of Huawei flash storage and LLM training
#22 PB? They will not come close to training in on that amount. Maybe years from now.
Re: Norway's 2 petabytes of Huawei flash storage and LLM training
#3384 core cpu cluster? 2 petabytes?
Dell just launched a 2U that fits almost 10 petabytes in it. It's probably not 384 core capable but that is very doable right now, Epyc chips are 192 cores each! https://www.techradar.com/pro/dell-launches-record-shatterin...
Re: Norway's 2 petabytes of Huawei flash storage and LLM training
#4> He asserted that any country with its own language that did not have a sovereign LLM trained in that language was at a disadvantage as a globally trained, English-speaking LLM would not know about that country’s history, news and culture that was described in the local language.
I don’t know this is true. But whatever sounds true enough and gets funding seems to be what flies these days.
Re: Norway's 2 petabytes of Huawei flash storage and LLM training
#52 PB? They will not come close to training in on that amount. Maybe years from now.
[dead]
Re: Norway's 2 petabytes of Huawei flash storage and LLM training
#6This is how much storage the average r/datahoarder user has in their basement. Fewer than 100 hard drives.
Re: Norway's 2 petabytes of Huawei flash storage and LLM training
#72 PB? They will not come close to training in on that amount. Maybe years from now.
Could probably LoRA with that
Re: Norway's 2 petabytes of Huawei flash storage and LLM training
#8>As Husnes put it; Norway is a small country solving a problem every non-English-speaking nation will face: how do you build AI that reflects your language, your culture and your history? AI needs custodians, not just builders.
I'm afraid the answer is, mostly you don't.
Such a thing requires strong political will that, at least in my environment, seems basically impossible to align.
The costs are prohibitive, but beyond that, the type of person who cares about local representation like that is either completely fine with letting foreign companies implement it (after all, you can use ChatGPT in Basque if you want to) or is against the idea of AI altogether.
Re: Norway's 2 petabytes of Huawei flash storage and LLM training
#9> He asserted that any country with its own language that did not have a sovereign LLM trained in that language was at a disadvantage as a globally trained, English-speaking LLM would not know about that country’s history, news and culture that was described in the local language. I don’t know this is true. But whatever sounds true enough and gets funding seems to be what flies these days.
They made the cultural case, you have no idea how strong this is in places like quebec, nordics, france, russia etc
Re: Norway's 2 petabytes of Huawei flash storage and LLM training
#10Ad for Huawei?