Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Muse Glimmer: 30B-parameter model optimized for always-on local agent workflows

research.meta.ai

Post reply on HN
Print view View original

641–650 of 680 posts

Re: Muse Glimmer: 30B-parameter model optimized for always-on local agent workflows

#641

Post by gigaritee »

loopmonster wrote: post #616
espeed wrote: post #556

Earlier quoted context omitted.

Help convince Firefox of this: https://news.ycombinator.com/item?id=46294238 Rather than develop its own AI, Firefox should develop a system to pipe your html rendered browsing history in real time so external local services can process it: https://connect.mozilla.org/t5/ideas/archive-your-browser-hi... . Firefox could be the only browser that does this.

The fact that you've been posting this idea into the void for 8 months with no pickup is already your answer

Couldn't this be implemented as a web extension? I imagine modifying singlefile to automatically send html to a local port is much easier than trying to convince a chronically mismanaged organization like mozilla (no offence to mozillians).

Re: Muse Glimmer: 30B-parameter model optimized for always-on local agent workflows

#642

Post by mstkllah »

mmaunder wrote: post #378
plutokras wrote: post #267

Earlier quoted context omitted.

What specific technical signals make you think we're close to a shift like that?

The researchers who published Attention Is All You Need didn’t have the benefit of the LLMs they birthed. Take a look at the prompt that solved the Cycle Double Cover conjecture, and which has been adapted to achieve breakthroughs in cybersecurity. The field is entering a feedback loop that is leading to exponential innovation. We’re at the beginning of the curve. And right now the big iron data center approach is br…

Where can I find more information on the cybersecurity breakthroughs adapted prompt?

Re: Muse Glimmer: 30B-parameter model optimized for always-on local agent workflows

#643

Post by dofm »

bitexploder wrote: post #627
dofm wrote: post #565

Earlier quoted context omitted.

I am very struck by the way open weights LLMs seem to reflect a culture. I don't really enjoy the way Qwen writes prose, and I find its thinking a bit exhausting, though it clearly writes very good code. I like the neutral, clear way the Gemma models write, which I sometimes use to get myself a "getting started" document on something I want to understand; it also summarises well. It is neutral, sensible, un-showy. It…

I ran a 9B over my like 100k photo library — it was very good at it. And extracting any text. All local.

It might be an indication that analysis of photography is something of an ideal discipline for an LLM since so much content online involves discussion of pictures.

A lot of what I am trying to do with my photography is sort of meta-photography. I am really interested in early photographic history, pictorialism and its opponents etc., but I try to avoid reproduction, so I try not to simulate processes too closely or to use vintage tropes in props and settings, but I use simple, undercorrected lenses and some vintage lenses, to gain some of the visual language.

Finding out that LLMs (including Gemma-4 12B with its built-in image encoder) understands a lot of my references and influences, could recommend me my (still semi-obscure) favourite historical photographer and other photographers who clearly engage in the same work, is amazing. And sometimes it says stuff I had not thought of, which is what I am looking for, since my photographic journey is somewhat lonely.

And that is just sort of brushing past the fact that these things can describe the contents of photographs with an accuracy that you can almost take for granted.

Re: Muse Glimmer: 30B-parameter model optimized for always-on local agent workflows

#644

Post by physicsguy »

nbardy wrote: post #343
mmaunder wrote: post #249

Remember when we needed 200 servers for an enterprise website because Apache used one process or thread per connection - and Nginx collapsed that into a single box overnight? That moment for LLMs is near. It’s going to move us from the big iron era of AI to small portable brains. Nature has already proved it’s possible with 20 watts and very little heat generation. And I think the data center buildout will end in car…

Everyone keeps repeating this who doesn’t understand the underlying technology. Small llms are still way more efficiently server on big GPUs. Sharing server capacity takes advantage of the massive parallel throughput and sharing of memory bandwidth. You are sharing the GPUs with thousands of concurrent users.

> Small llms are still way more efficiently server on big GPUs.

Yes, but the privacy aspect means that for many, many applications slower local will still be preferable to faster remote so long as the actual model performance is the same.

Re: Muse Glimmer: 30B-parameter model optimized for always-on local agent workflows

#645

Post by [deleted] »

_kb wrote: post #610
dofm wrote: post #351

Earlier quoted context omitted.

FWIW it is entirely possible to square the notion that small models will still be hosted on cloud hardware with the idea that the data centre buildout will end in tears. Many analysts (and Microsoft) think even now that if everything committed gets built there will be considerable oversupply and there is not the revenue to pay for it. If small models do continue to improve in unusual ways (I think there are limits) t…

When the glut of GPU arrives I'm sure humanity will find a good use for all that excess compute, like finally getting back to signing monkey pictures and excreting endless hash based pyramid schemes.

[deleted]

Re: Muse Glimmer: 30B-parameter model optimized for always-on local agent workflows

#646

Post by [deleted] »

dofm wrote: post #500
pu_pe wrote: post #46

Earlier quoted context omitted.

Based on the benchmarks, it seems that Muse Glimmer barely edges out against Qwen3.6 27B, except for tool-calling skills (MCP, etc.). I wouldn't be surprised if they released it now because they are afraid they wouldn't beat Qwen3.8 27B.

I am glad they released it because I think we need a competitive culture of open weights that isn't just geopolitics. But I have to say, I quite like the way Muse Glimmer thinks and talks. It's a cocky bastard in tone, but it's quite good, and its thinking traces are relatively terse.

[deleted]

Re: Muse Glimmer: 30B-parameter model optimized for always-on local agent workflows

#647

Post by melvinroest »

mmaunder wrote: post #249

Remember when we needed 200 servers for an enterprise website because Apache used one process or thread per connection - and Nginx collapsed that into a single box overnight? That moment for LLMs is near. It’s going to move us from the big iron era of AI to small portable brains. Nature has already proved it’s possible with 20 watts and very little heat generation. And I think the data center buildout will end in car…

> Remember when we needed 200 servers for an enterprise website because Apache used one process or thread per connection

I don't, but holy moly. That sounds insane!

Re: Muse Glimmer: 30B-parameter model optimized for always-on local agent workflows

#648

Post by BoredomIsFun »

rablackburn wrote: post #621
SwellJoe wrote: post #586

Earlier quoted context omitted.

I saw that one in the "Popular models" sort at Hugging Face and tried it on some tasks I do frequently to compare models, and it feels damaged by the fine-tune, to me. It wrote security bugs into the code (probably just sloppy thinking, not intentional), it exhibited looping behavior in some configurations in llama.cpp, configurations I regularly use with the regular 27B, and it failed to write unit tests without bei…

> but way, way better at creative writing than Qwen and even better than Gemma 4 26 and 31b. I suspect this is the only use-case I would consider...and I don't really have a use-case for "creative writing" that I would delegate to an LLM. I suppose for dialogue generation in games? But yes, hard agree. Why on Earth would you ever want to write code with a model that is supposedly "jailbroken"? So it can put great bac…

> I suppose for dialogue generation in games?

I use it to write short sci-fi stories. Life is not only about being an SDE.

> Why on Earth would you ever want to write code with a model that is supposedly "jailbroken"?

I need a model which decent enough at coding to write boilerplate for me, yet I do not need to unload in case I want to write an article or enguage in my writing hobby.Exactly why Gemma 4 are so popular.

> So it can put great backdoors into everything it touches?

What a strange take...

Re: Muse Glimmer: 30B-parameter model optimized for always-on local agent workflows

#650

Post by ajam1507 »

skybrian wrote: post #550
jawiggins wrote: post #538

> Muse Glimmer is a 30-billion-parameter model optimized for always-on local agent workflows. It’s small enough to run on a Mac or PC with a single consumer GPU, enabling use cases that range from local agents and function calling, to local coding, and LLM-as-a-judge evaluation. The next iteration in LLM products is a 24/7 thinking loop where the claude-code like thing gets input continuously from your wearable, noti…

Maybe it's my lack of imagination, but what do you imagine you'd be doing where you'd want to keep a computer busy overnight? It seems like the purpose of humans isn't to keep machines busy. When our phone or laptop is idle, it's fine if it sleeps. And when we do want something, we'd rather not wait. (Also, this new model seems to be designed to keep latency down, which is useful for interactive tasks.)

>It seems like the purpose of humans isn't to keep machines busy. When our phone or laptop is idle, it's fine if it sleeps. And when we do want something, we'd rather not wait.

I'm not sure what the original commenter had in mind, but just because our machines are idle when we aren't using them doesn't mean that, that's how we will use computers in the future.

I think notifications are an example even now of the computer not really being idle when we aren't interacting with it.

Post reply on HN