Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

K2 Horizon: A connected fleet of six open models

ifm.ai

Post reply on HN
Print view View original

81–90 of 144 posts

Re: K2 Horizon: A connected fleet of six open models

#81

Post by culi »

jjordan wrote: post #5

Fully open models really need to be a big part of the AI future. That includes all source code, open training data, how it's organized, fed to the model, processed, etc. Until that becomes a thing you're always going to be left wondering what exactly lies underneath the closed model you are using, leaving open the possibility for societal manipulation.

Other than open training data (currently legally impossible), all of this holds for basically every major Chinese-made model. They not only open the weights but publish detailed methodology papers alongside the models in arXiv and even open source the code.

Re: K2 Horizon: A connected fleet of six open models

#82

Post by culi »

mzmzmzm wrote: post #69
cesarvarela wrote: post #48

I find it funny that while these releases are a technological miracle, the charts in the doc use tiny fonts and are hard to read. Goes with the idea that coding might be solved, but taste isn't.

Accessibility isn't "solved," but there are certainly standards for things like color contrast. Maybe inbetween taste and coding there are better targets still being missed.

In fact, automated a11y checks and tooling is quite advanced nowadays and tragically underutilized by web developers. Now that we have llms to scale all the shitty code of front-end devs at startups, I feel increasingly hopeless about things ever improving

Re: K2 Horizon: A connected fleet of six open models

#83

Post by luciana1u »

adrian_b wrote: post #43
luciana1u wrote: post #37

[flagged]

I just looked on Huggingface.co, and the training data is there. For example, 3.3 Tbyte for code reasoning, 4.5 Tbyte for mathematical reasoning, 8.4 Tbyte of pre-train behaviors, and so on. I did not compute the sum of the dataset sizes, but it appears to be some tens of Tbyte. Nonetheless, I assume that this amount of training data is more than an order of magnitude less than what OpenAI, Anthropic and the like hav…

[flagged]

Re: K2 Horizon: A connected fleet of six open models

#85

Post by theplumber »

jjordan wrote: post #5

Fully open models really need to be a big part of the AI future. That includes all source code, open training data, how it's organized, fed to the model, processed, etc. Until that becomes a thing you're always going to be left wondering what exactly lies underneath the closed model you are using, leaving open the possibility for societal manipulation.

But that would be impossible due copyrights laws. If the law would apply Anthropic and OpenAI executives would be in jail

Re: K2 Horizon: A connected fleet of six open models

#86

Post by throwawayffffas »

While the open approach is commendable. The 32b and 36b models are inferior to qwen 3.8 27b, at least according to benchmark numbers. I would have liked to have seen both compared to 27b, not only the dense one. Also would have liked to see more coding benchmarks in the full table.

Re: K2 Horizon: A connected fleet of six open models

#87

Post by dotancohen »

cogman10 wrote: post #77
dotancohen wrote: post #76

Earlier quoted context omitted.

LLMs have a problem with that type of question? I might try it later at home.

Now a days? No. It's actually getting to be a bad question because they all push out about the exact same answer. But much earlier they did and, apparently, these really small models still do. At this point it serves as more of a smoke test for me. Success means little, failure means a lot.

Terrific, thank you.

Re: K2 Horizon: A connected fleet of six open models

#88

Post by idiotsecant »

dotancohen wrote: post #66
embedding-shape wrote: post #50

Earlier quoted context omitted.

Or, we just need to get this over with and declare any digital data findable via the internet to just be public property of everyone. Everything becomes public, besides stuff you keep locally, and there is no difference anymore, it's all just data anyone can use for whatever. A 1 year grace period for everyone to pull stuff off they don't want to be a part of this bright new open era, then we just scrap everything re…

I respectful disagree. I enjoy reading e.g. Asimov and well-executed journalism. And I completely respect the IP of those people who create these works.

I'm what way does it make sense to respect the intellectual property rights of a dead man?

Re: K2 Horizon: A connected fleet of six open models

#89

Post by idiotsecant »

embedding-shape wrote: post #59
alightsoul wrote: post #52

Earlier quoted context omitted.

Crypto bros took the idea with some blockchain shit and no one takes it seriously anymore so it died

If the LLM/AI ecosystem starts actually needing some Person-To-Person (or maybe Agent-To-Agent?) payment system because things actually get smart enough to be useful autonomously, they're gonna need some way to send money/currency around. Depending on how banks will react to this need, we might see another return of digital currencies from the current winter.

They used to say that cryptocurrency will be the dopamine layer of the first artificial intelligence

Re: K2 Horizon: A connected fleet of six open models

#90

Post by dotancohen »

idiotsecant wrote: post #88
dotancohen wrote: post #66

Earlier quoted context omitted.

I respectful disagree. I enjoy reading e.g. Asimov and well-executed journalism. And I completely respect the IP of those people who create these works.

I'm what way does it make sense to respect the intellectual property rights of a dead man?

That dead man took the risk of not earning much in his lifetime, to continue feeding his family even after his passing. You might as well ask why does someone acquire life insurance.
Post reply on HN