Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Everything we announced at our first LlamaCon

ai.meta.com

Post reply on HN
Print view View original

31–40 of 122 posts

Re: Everything we announced at our first LlamaCon

#31

Post by stcroixx »

mgdev wrote: post #21
OtherShrezzing wrote: post #11

Earlier quoted context omitted.

>There is a potential world where Meta [is]... literally building smart homes... while preserving privacy and building trust I'm earnestly not sure what Meta are less qualified for. Building physical homes or building privacy & trust.

Visit SE Asia sometime and you'll experience a very different sentiment. Hundreds of millions of people rely on Meta to provide valuable services every day, some of them borderline essential. This is undebatable. The outsized public hatred toward Meta is almost entirely driven by a bureaucratic, anti-technology Europe (that has finally realized that their overstepping is hurting their future) and a US political insti…

Dumb fucks is what the founder of the company has thought about it's users since day 1. They've been caught lying to cover up terrible things they've done so many times it's just assumed at this point. Anyone relying on their services is being taken advantage of first by Meta, and then by their own failed economy that won't provide an alternative. I've never once considered what Europe thinks.

Re: Everything we announced at our first LlamaCon

#32

Post by littlestymaar »

walterbell wrote: post #14
smcnally wrote: post #13

Earlier quoted context omitted.

Beyond solid benchmarks, Alibaba's power move was dropping a bunch of models available to use and run locally today. That's disruptive already and the slew of fine tunes to come will be good for all users and builders. https://huggingface.co/collections/Qwen/qwen3-67dd247413f0e2...

What's the minimum GPU/NPU hardware and memory to run Qwen3 locally?

There are models down to 0.6B and you can even run Qwen3 30B-A3B reasonably fast on CPU only.

Re: Everything we announced at our first LlamaCon

#34

Post by wewewedxfgdf »

Can someone explain to me please why Meta doesn't create subject specific versions of their LLMs such as one that knows only about computer programming, computers, hardware software.

I would have imagined such a thing would be smaller and thus run on smaller configurations.

But since I am only a layman maybe someone can tell me why this isn't the case?

Re: Everything we announced at our first LlamaCon

#35

Post by KTibow »

wewewedxfgdf wrote: post #34

Can someone explain to me please why Meta doesn't create subject specific versions of their LLMs such as one that knows only about computer programming, computers, hardware software. I would have imagined such a thing would be smaller and thus run on smaller configurations. But since I am only a layman maybe someone can tell me why this isn't the case?

Other companies have done this (see Qwen Coder). It doesn't scale past a few disciplines like math and code though, and using mixtures of experts give you most of the same benefits.

Re: Everything we announced at our first LlamaCon

#37

Post by laweijfmvo »

walterbell wrote: post #14
smcnally wrote: post #13

Earlier quoted context omitted.

Beyond solid benchmarks, Alibaba's power move was dropping a bunch of models available to use and run locally today. That's disruptive already and the slew of fine tunes to come will be good for all users and builders. https://huggingface.co/collections/Qwen/qwen3-67dd247413f0e2...

What's the minimum GPU/NPU hardware and memory to run Qwen3 locally?

I'm running 4B on my 8GB AMD 7600 via ollama

Re: Everything we announced at our first LlamaCon

#39

Post by cube2222 »

wewewedxfgdf wrote: post #34

Can someone explain to me please why Meta doesn't create subject specific versions of their LLMs such as one that knows only about computer programming, computers, hardware software. I would have imagined such a thing would be smaller and thus run on smaller configurations. But since I am only a layman maybe someone can tell me why this isn't the case?

Generally, all that non-tech content still helps the model “to learn”.

Also, the software you’re working on will generally in some way have a real-world domain - without knowing it the AI all likely be a less effective assistant. Design conversations with it would likely be pretty non-fun, too.

Finally, the “bitter lesson” article[0] from a couple years ago is I think somewhat applicable too.

[0]: http://www.incompleteideas.net/IncIdeas/BitterLesson.html

Re: Everything we announced at our first LlamaCon

#40

Post by bbatha »

wewewedxfgdf wrote: post #34

Can someone explain to me please why Meta doesn't create subject specific versions of their LLMs such as one that knows only about computer programming, computers, hardware software. I would have imagined such a thing would be smaller and thus run on smaller configurations. But since I am only a layman maybe someone can tell me why this isn't the case?

To add on to the sibling. Specialized models, including fine tuned ones, continually have their lunch eaten by general models within 3-6 months. This time round is mixture of experts that’ll do it, next year it’ll be something else. Tuned models are expensive to produce and are benchmark kings but less do less well in the real world qualitative experience. The juice just ain’t worth the squeeze most of the time.

Meta does have some specialized models though, llamaguard was released for llama 2 and 3.

Post reply on HN