Sharing new research, models, and datasets from Meta FAIR
1–10 of 68 posts
Re: Sharing new research, models, and datasets from Meta FAIR
#2There’s honestly so much interesting stuff here, esp. the llm-related things - large concept models (operating on and predicting concepts, not tokens), dynamic byte latent transformers (byte-level alternative to standard tokenization), sparse memory layers (successfully scaling key-value memory layers without an increase in computational requirements).
Here they are presented as separate things, each of which apparently improves quality / efficiency. I wonder what the quality / efficiency increase is of all those methods put together? Maybe that’s what Llama 4 will be?
This looks like a lot of innovation is happening at Meta in those areas, really cool!
Re: Sharing new research, models, and datasets from Meta FAIR
#3This is so cool! Playing around with the first demo is a lot of fun. First one to get the model to moonwalk wins. My best attempt was probably something like `(body_speed_forward 1.0) * (stay_still > 0.2) * (body_speed_vertical 0.9)`
https://i.imgur.com/O5hGMo5.gif
Then the "Meta Explore Theory of Mind" is even more interesting. There was a thread about a month ago in which some of us were discussing some of the concepts here like "beliefs" and updating a model of the world accordingly. https://news.ycombinator.com/item?id=42035985
Re: Sharing new research, models, and datasets from Meta FAIR
#4meta has certainly redeemed itself and helping AI become moat-free
Re: Sharing new research, models, and datasets from Meta FAIR
#5[flagged]
Re: Sharing new research, models, and datasets from Meta FAIR
#6[flagged]
Don’t you love the doublespeak of using “FAIR” as well!
Re: Sharing new research, models, and datasets from Meta FAIR
#7[flagged]
Meta is a very large organization, and I'm willing to believe that a good chunk of Meta FAIR (the lab releasing all of this stuff) truly do care about innovations for advancing AI safety and are doing great work along these lines. I'm not disagreeing with your point about the company being led by its financial incentives as a unit, but let's also allow ourselves permission to celebrate this work by this group of people.
Re: Sharing new research, models, and datasets from Meta FAIR
#8It's not a hype when it's delivers and I'm also not seeing a ceiling yet
Yet again interesting progress.
Also I like the idea of using the pose model to generate not a NPC but a avatar living in my phone or glas cube as a hologram. That would be quite scifi futuristic
Re: Sharing new research, models, and datasets from Meta FAIR
#9[flagged]
"Please don't post shallow dismissals, especially of other people's work. A good critical comment teaches us something."
Re: Sharing new research, models, and datasets from Meta FAIR
#10meta has certainly redeemed itself and helping AI become moat-free
They still ruin society with the Facebook, no matter how much good they do with LLM.