Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Granite 4.1: IBM's 8B Model Matching 32B MoE

firethering.com

Post reply on HN
Print view View original

31–40 of 223 posts

Re: Granite 4.1: IBM's 8B Model Matching 32B MoE

#31

Post by embedding-shape »

Havoc wrote: post #5

Interesting to see a pivot away from MoE by both IBM and mistral while the larger classes of SOTA of models all seem to be sticking to it. Quick vibe check of it- 8B @ Q6 - seems promising. Bit of a clinical tone, but can see that being useful for data processing and similar. You don't really want a LLM that spams you with emojis sometimes...

Makes sense, dense for small models, dense or MoE for larger ones, end up fitting various hardware setups pretty neatly, no need for MoE at smaller scale and dense too heavy at large scale.

Re: Granite 4.1: IBM's 8B Model Matching 32B MoE

#32

Post by vessenes »

2ndorderthought wrote: post #4

I test drove it yesterday. It's pretty impressive at 8b. Runs on commodity hardware quickly. Qwen3.6 35b a3b is still my local champion but I may use this for auto complete and small tasks. Granite has recent training data which is nice. If the other small models got fine tuned on recent data I don't know if I would use this at all, but that alone makes it pretty decent. The 4b they released was not good for my needs…

Have you tried the Gemma 4 series, out of curiosity? I haven’t run a local model in a while, but the benchmarks look good. I’d take a free local tool-use model if it was relatively consistent.

Re: Granite 4.1: IBM's 8B Model Matching 32B MoE

#33

Post by trvz »

bambax wrote: post #22
wewewedxfgdf wrote: post #14

Earlier quoted context omitted.

Third line in to the article: "But there’s one result in the benchmarks I keep coming back to." I hear this sort of thing all the time now on YouTube from media/news personalities: “And that’s the part nobody seems to be talking about.” "And here's what keeps me up at night." “This is where the story gets complicated.” “Here’s the piece that doesn’t quite fit.” “And this is where the usual explanation starts to break…

I notice this very often in LinkedIn posts, and it's annoying, but I had not realized it was LLM-speak? Isn't it possible that people write like this naturally?

Yes. Some people are very trigger happy in attributing human slop to LLMs.

Re: Granite 4.1: IBM's 8B Model Matching 32B MoE

#34

Post by spicyusername »

bambax wrote: post #22
wewewedxfgdf wrote: post #14

Earlier quoted context omitted.

Third line in to the article: "But there’s one result in the benchmarks I keep coming back to." I hear this sort of thing all the time now on YouTube from media/news personalities: “And that’s the part nobody seems to be talking about.” "And here's what keeps me up at night." “This is where the story gets complicated.” “Here’s the piece that doesn’t quite fit.” “And this is where the usual explanation starts to break…

I notice this very often in LinkedIn posts, and it's annoying, but I had not realized it was LLM-speak? Isn't it possible that people write like this naturally?

Arguably it's exactly because it was used naturally so often that the LLMs parrot it so frequently.

Re: Granite 4.1: IBM's 8B Model Matching 32B MoE

#36

Post by wewewedxfgdf »

bambax wrote: post #22
wewewedxfgdf wrote: post #14

Earlier quoted context omitted.

Third line in to the article: "But there’s one result in the benchmarks I keep coming back to." I hear this sort of thing all the time now on YouTube from media/news personalities: “And that’s the part nobody seems to be talking about.” "And here's what keeps me up at night." “This is where the story gets complicated.” “Here’s the piece that doesn’t quite fit.” “And this is where the usual explanation starts to break…

I notice this very often in LinkedIn posts, and it's annoying, but I had not realized it was LLM-speak? Isn't it possible that people write like this naturally?

I think LLM's have that sort of "summarise, wrap it in a bow tie, give a little dramatic punch as a preview to the next few points".

Re: Granite 4.1: IBM's 8B Model Matching 32B MoE

#37

Post by steveharing1 »

bambax wrote: post #22
wewewedxfgdf wrote: post #14

Earlier quoted context omitted.

Third line in to the article: "But there’s one result in the benchmarks I keep coming back to." I hear this sort of thing all the time now on YouTube from media/news personalities: “And that’s the part nobody seems to be talking about.” "And here's what keeps me up at night." “This is where the story gets complicated.” “Here’s the piece that doesn’t quite fit.” “And this is where the usual explanation starts to break…

I notice this very often in LinkedIn posts, and it's annoying, but I had not realized it was LLM-speak? Isn't it possible that people write like this naturally?

[dead]

Re: Granite 4.1: IBM's 8B Model Matching 32B MoE

#38

Post by spicyusername »

cbg0 wrote: post #10
100ms wrote: post #9

> Full stop. Why people don't edit out obvious sloppification and expect to still have readers left

So are we saying it's fine that the article is written by an LLM as long as it doesn't have the tell-tale signs of LLMs?

My opinion is that literature and art will continue pushing the envelope in the places they always pushed the envelope. LLMs will not change this, humans love making art, and they love doing it in new ways.

Corporate announcements were never the places that literature and art were pushing the envelope. They were slop before, and they're slop now.

Re: Granite 4.1: IBM's 8B Model Matching 32B MoE

#39

Post by noodletheworld »

rnadomvirlabe wrote: post #20
steveharing1 wrote: post #16

Earlier quoted context omitted.

Because Qwen 3.6 pushes way above its weight. Granite 8B is impressive, but Qwen still wins on raw capability, especially for coding.

You just asserted the same thing again. Why do you say this is the case?

Having tried it.

Qwen is really good.

Also, generally, it makes sense. 8B models are generally not very good^.

That this 8B model is decent is impressive, but that it could perform on par with a good model 4 times as large is a daydream.

^ - To be polite. The small models + tool use for coding agents are almost universally ass. Proof: my personal experience. Ive tried many of them.

Re: Granite 4.1: IBM's 8B Model Matching 32B MoE

#40

Post by someguyiguess »

cwillu wrote: post #27
frereubu wrote: post #23

Earlier quoted context omitted.

I think this kind of language predates widespread LLM use, and has been picked up from that kind of writing. It's a "and here's where it gets interesting" pattern that people like Malcolm Gladwell and Freakonomics have used, even if the same thing could be said in a way that makes it sound much less intriguing.

There's even a word for it: “cliché”

How banal
Post reply on HN