Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Muse Glimmer: 30B-parameter model optimized for always-on local agent workflows

research.meta.ai

Post reply on HN
Print view View original

131–140 of 682 posts

Re: Muse Glimmer: 30B-parameter model optimized for always-on local agent workflows

#131

Post by flaunf221 »

jurgenburgen wrote: post #87
neuroticnews25 wrote: post #71

Earlier quoted context omitted.

Don't forget about energy usage, you'll probably never break even vs same model on openrouter.

If you can’t do it cheaper on your own hardware it does make you wonder how much of the cost of inference those large LLM providers are eating? Datacenter hardware isn’t magic.

Your personal hardware probably isn't running useful tasks 24/7. If you spend 60% of your 8h work day on full on agentic work, then your hardware is paying off for itself only 20% of available time.

Re: Muse Glimmer: 30B-parameter model optimized for always-on local agent workflows

#132

Post by xscott »

cube00 wrote: post #123
cmiles8 wrote: post #97

With the business model for API based LLMs looking iffy at best it seems like we’re heading back to the “server under your desk” era of IT again.

Considering how all the big players are playing fast [1] and loose [2] with limits, billing [3] and adding undisclosed changes that burn your tokens on autopilot [4], it can't happen soon enough. [1]: Limits may change without notice, including due to capacity constraints. - https://support.google.com/gemini/answer/16275805?sjid=14713... . [2]: "standard limits" are never defined - https://support.google.com/gemini/a…

Not to mention all the other ways they can screw you:

- Middle of the day, servers busy? Swap to Sonnet while pretending it's still Opus. Many people won't notice, and nobody can prove anything if they suspect.

- Middle of the night, server load is light? Put it into extra thinky mode so it burns more tokens to ramp up the bills. Flip the switch where it gets really pedantic about writing lots of extra test cases and verifying against documentation.

- Demand increases, but don't feel like running more hardware? Switch to low bit quants, but have a monitor model swap back to quality if it can tell you're running a benchmark.

Assuming model capability plateaus (I think it will), token providers will be in a race to the bottom to maximize profits at the expense of quality that's very difficult to measure.

Re: Muse Glimmer: 30B-parameter model optimized for always-on local agent workflows

#133

Post by skohan »

michimagdesign wrote: post #83
mycall wrote: post #64

Earlier quoted context omitted.

Do AI companies make release plans based on upcoming other models like this? I would think all the processes that go into the repository and weight infrastructure pre-training, checkpointing, knowledge distillation, model compression, post training pipeline, ecosystem integrations, inference API, benchmarking, human eval/safety/alignment, docs, etc... all that dictates the release schedule.

Yes, not every model release is reactionary to other labs. Either they had hints for the release of other models or they cut efforts in late stage testing of the models to hit these earlier release dates. There’s always some flexibility. And there’s certainly the incentive to cannibalize the news cycles for competitor models.

I could imagine pulling out all the stops to get a release over the finish line a week early if you're worried about being surpassed by another release

Re: Muse Glimmer: 30B-parameter model optimized for always-on local agent workflows

#134

Post by skohan »

cmiles8 wrote: post #97

With the business model for API based LLMs looking iffy at best it seems like we’re heading back to the “server under your desk” era of IT again.

I've been coding using the LLM server in my living room for the past few weeks, and I haven't had this much fun with tech for ages

Re: Muse Glimmer: 30B-parameter model optimized for always-on local agent workflows

#135

Post by monster_truck »

Grombobulous wrote: post #122
larodi wrote: post #109

Earlier quoted context omitted.

Meta and its products, as a whole, is a threat to your kids, your mental health, your community's health and the planet as a whole. It is just sad and very repulsive everyone fell so easily addicted to their social drug. Yes - it is a drug, and it is hard to get off from. Nothing redeems them at this point of time, they are doing exactly ZERO to redeem. Tossing open weight models (not opensource!!) is not a basis for…

I think it’s also worth pointing out that that there are numerous less evil options to choose from. Perhaps none of the AI companies are shining examples of high ethics, but basically all of them have ethical high ground over Meta. At least Anthropic isn’t sending private videos from pervert glasses to contract workers in Africa. It’s a low bar but it’s a bar nonetheless.

They're still using Elon's servers, though. Not like their models are any good anyways

Re: Muse Glimmer: 30B-parameter model optimized for always-on local agent workflows

#136

Post by skohan »

_ache_ wrote: post #47

It is interesting but it does look like a careful distillation of (Spark and) biggers open-weight models. The progress compared to Qwen3.6 27B is good, not that impressive, it's a 4 months old model. (kuto to them to compare to 27B dense and not 35B MoE, it's more fair to do so). It is very probable that Qwen3.8 27B will crush Glimmer-30B on most benchmarks.

Still great if they want to play in this space. Having competition for the 24-32GB VRAM target is only good for the end user.

Re: Muse Glimmer: 30B-parameter model optimized for always-on local agent workflows

#139

Post by hn_submit »

avaer wrote: post #101

I lament the comments saying this in any way redeems Meta (the company). The researchers releasing this stuff have almost nothing to do with Meta other than being bankrolled by the slaughterhouse. You aren't the customer, you are the pawn in big tech's game of thrones. Your good will is a commodity to be traded, almost literally. It will be used against you the moment it's convenient. This is open weights because Met…

I can't take any Big Tech company that still uses PHP seriously. Sorry.

Re: Muse Glimmer: 30B-parameter model optimized for always-on local agent workflows

#140

Post by simianwords »

skinfaxi wrote: post #120
avaer wrote: post #101

I lament the comments saying this in any way redeems Meta (the company). The researchers releasing this stuff have almost nothing to do with Meta other than being bankrolled by the slaughterhouse. You aren't the customer, you are the pawn in big tech's game of thrones. Your good will is a commodity to be traded, almost literally. It will be used against you the moment it's convenient. This is open weights because Met…

How is this non-sequitor the top comment?

[flagged]
Post reply on HN