Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Meta Llama 3

llama.meta.com

Post reply on HN
Print view View original

581–590 of 965 posts

Re: Meta Llama 3

#581

Post by aussieguy1234 »

brcmthrowaway wrote: post #571
aussieguy1234 wrote: post #554

"You’ll also soon be able to test multimodal Meta AI on our Ray-Ban Meta smart glasses." Now this is interesting. I've been thinking for some time now that traditional computer/smartphone interfaces are on the way out for all but a few niche applications. Instead, everyone will have their own AI assistant, which you'll interact with naturally the same way as you interact with other people. Need something visual? Just…

Didn't Humane try this?

there are probably early, rough around the edges versions of this already that aren't good enough to go mainstream.

A few things might need to happen before that, like shinking the resolution of Quest 3 down into form factor like regular glasses, so you could wear them in public without looking weird.

It'll be a bit like Smartphones. The first "handheld computers"/smartphones were not that great, then along came the iPhone.

I'm looking forward to seeing people "ghost type" on the train while typing out their messages to their assistant.

Re: Meta Llama 3

#582

Post by nathanh4903 »

I tried generating a Chinese rap song, and it did generate a pretty good rap. However, upon completion, it deleted the response, and showed > I don’t understand Chinese yet, but I’m working on it. I will send you a message when we can talk in Chinese.

I tried some other languages and the same. It will generate non-English language, but once its done, the response is deleted and replaced with the message

Re: Meta Llama 3

#583

Post by kristianp »

Slightly off-topic, but I'd like to see a model that can fit nicely on a consumer 24GB GPU, such as a 20B model (8bit quantized, but some spare space to allow for context), or perhaps 40B so that a 4-bit quant could fit into 20GB VRAM. It's disappointing to me that Meta stopped releasing the 30B after llama 1. (I know codellama exists, but that's been finetuned to one use case).

Re: Meta Llama 3

#584

Post by natrys »

thelittleone wrote: post #558
natrys wrote: post #552

Earlier quoted context omitted.

I find it somewhat interesting that there is a common perception about GPT-4 at release being actually smart, but that it got gradually nerfed for speed with turbo, which is better tuned but doesn't exhibit intelligence like the original. There were times when I felt that too, but nowadays I predominantly use turbo. It's probably because turbo is faster and cheaper, but in lmsys turbo has 100 elo higher than original…

Have you tried Claude 3 Opus? I've been using that predominantly since release and find it's "smarts" as or better than my experience with GPT-4 (pre turbo).

I did. It definitely exudes more all around personality. Unfortunately in my private test suite (mostly about coding), it did somewhat worse than turbo or phind 70b.

Since price influences my calculus, I can't say this for sure, but it seems being slightly smarter is not much of an edge, because it's still dumb by human standards. For most non-coding use the smart doesn't make much difference (like summarisation), I find that cheaper options like mistral-large do just as good as Opus.

In the last month I have used Command R+ more and more. Finally had some excuse to write some function calling stuff. I have also been highly impressed by Gemini Pro 1.5 finding technical answers from a dense 650 page pdf manual. I have enjoyed chatting with the WizardLM2 fine-tune for the past few days.

Somehow I haven't quite found a consistent use case for Opus.

Re: Meta Llama 3

#585

Post by elzbardico »

aussieguy1234 wrote: post #554

"You’ll also soon be able to test multimodal Meta AI on our Ray-Ban Meta smart glasses." Now this is interesting. I've been thinking for some time now that traditional computer/smartphone interfaces are on the way out for all but a few niche applications. Instead, everyone will have their own AI assistant, which you'll interact with naturally the same way as you interact with other people. Need something visual? Just…

GUIs have an inherent advantage here: discoverability. If you think about it, conversational UIs, even turbo-charged by AI, are not that different from Command Line Interfaces. You need to have an idea that you want something. You lose the serendipity inherent to visual interfaces. We should never underestimate the power of the human visual cortex.

Re: Meta Llama 3

#586

Post by HarHarVeryFunny »

modeless wrote: post #314
pellucide wrote: post #288

From the article >We made several new observations on scaling behavior during the development of Llama 3. For example, while the Chinchilla-optimal amount of training compute for an 8B parameter model corresponds to ~200B tokens, we found that model performance continues to improve even after the model is trained on two orders of magnitude more data. Both our 8B and 70B parameter models continued to improve log-linea…

Yes. Llama 3 8B outperforms Llama 2 70B (in the instruct-tuned variants). "Chinchilla-optimal" is about choosing model size and/or dataset size to maximize the accuracy of your model under a fixed training budget (fixed number of floating point operations). For a given dataset size it will tell you the model size to use, and vice versa, again under the assumption of a fixed training budget. However, what people have…

What's interesting about the minimization of combined training + (model lifetime) inference cost is that that is going to look different for different companies, depending on what their inference volume is...

Meta have a massive user base, and if they are using these models to run their own business, then that implies massive inference volume, and that it might make economic sense for them to put more money into training (to make smaller/cheaper models more powerful) than for other companies with lower inference volume.

To put it another way, it'd not be surprising - if their internal use of these models is very high - to see Meta continuing to release models that size for size beat the competition since they were incentivized to pump more tokens through them during training.

Re: Meta Llama 3

#587

Post by swatcoder »

ponector wrote: post #566
swatcoder wrote: post #472

Earlier quoted context omitted.

Few viable technology businesses and non-technology busiesses with internal software departments were prepared to see their software engineers suddenly suddenly expect doctor or lawyer pay and can't effectively accomodate the change. They were largely left to rely on loyalty and other kinds of fragile non-monetary factors to preserve their existing talent and institutuonal knowledge and otherwise scavenge for scraps…

That business can search and find talents globally for fraction of SV salary. If FAANG company can hire an engineer overseas for 60k$ annually why other cannot?

Because maintaining the organizational infrastructure to coordinate remote teams dispersed to time zones all over the world and with different communication styles, cultural assumptions, and legal requirements is a whole matter of its own?

Companies that can do that are at an advantage over those who can't right now, but pulling that off is neither trivial nor immediate nor free.

Re: Meta Llama 3

#588

Post by mensetmanusman »

jph00 wrote: post #160
observationist wrote: post #67

https://github.com/meta-llama/llama3/blob/main/LICENSE Llama is not open source. It's corporate freeware with some generous allowances. Open source licenses are a well defined thing. Meta marketing saying otherwise doesn't mean they get to usurp the meaning of a well understood and commonly used understanding of the term "open source." https://opensource.org/license Nothing about Meta's license is open source. It's a…

> " Nothing about Meta's license is open source. It's a carefully constructed legal agreement intended to prevent any meaningful encroachment by anyone, ever, into any potential Meta profit, and to disavow liability to prevent reputational harm in the case of someone using their freeware for something embarrassing. " You seem to be making claims that have little connection to the actual license. The license states yo…

That's convenient because I only have 699,999,999 customers.

Re: Meta Llama 3

#589

Post by mensetmanusman »

littlestymaar wrote: post #486
jiggawatts wrote: post #475

Earlier quoted context omitted.

Is “reproducibility” actually the right term here? It’s a bit like arguing that Linux is not open source because you don’t have every email Linus and the maintainers ever received. Or that you don’t know what lectures Linus attended or what books he’s read. The weights “are the thing” in the same sense that the “code is the thing”. You can modify open code and recompile it. You can similarly modify weights with fine…

> It’s a bit like arguing that Linux is not open source because you don’t have every email Linus and the maintainers ever received. Or that you don’t know what lectures Linus attended or what books he’s read. Linux is open source, because you can actually compile it yourself! You don't need Linus's email for that (and if you needed some secret cryptographic key on Linus' laptop to decrypt and compile the kernel, then…

It's a blob that costs over $10,000,000 in electricity costs to compile. Even if they released everything only the rich could push go.

Re: Meta Llama 3

#590

Post by dazuaz »

bbig wrote: post #4

They've got a console for it as well, https://www.meta.ai/ And announcing a lot of integration across the Meta product suite, https://about.fb.com/news/2024/04/meta-ai-assistant-built-wi... Neglected to include comparisons against GPT-4-Turbo or Claude Opus, so I guess it's far from being a frontier model. We'll see how it fares in the LLM Arena.

I'm based on LLaMA 2, which is a type of transformer language model developed by Meta AI. LLaMA 2 is a more advanced version of the original LLaMA model, with improved performance and capabilities. I'm a specific instance of LLaMA 2, trained on a massive dataset of text from the internet, books, and other sources, and fine-tuned for conversational AI applications. My knowledge cutoff is December 2022, and I'm constantly learning and improving with new updates and fine-tuning.
Post reply on HN