Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Meta Llama 3

llama.meta.com

Post reply on HN
Print view View original

761–770 of 965 posts

Re: Meta Llama 3

#761

Post by sen »

segmondy wrote: post #646
nathanh4903 wrote: post #582

I tried generating a Chinese rap song, and it did generate a pretty good rap. However, upon completion, it deleted the response, and showed > I don’t understand Chinese yet, but I’m working on it. I will send you a message when we can talk in Chinese. I tried some other languages and the same. It will generate non-English language, but once its done, the response is deleted and replaced with the message

so run it locally, local version is not guarded

My locally-hosted llama3 actually craps itself if I ask it to answer in other languages. It's pretty hilarious. Has been working flawlessly (and impressively fast) for everything in English, then does hilarious glitches in other languages.

Eg right now to show it here, I say "Write me a poem about a digital pirate in Danish":

Digitalen Pirat

På nettet sejler han, En digital pirat, fri og farlig. Han har øjnene på de kodeagtige Og hans hjerne er fuld af ideer.

Hans skib er en virtuel børs, Hvor dataenes vætætø Tø Tø Tø Hø T Ø T Ø T Ø T Ø T Ø T 0 Ø T 0 Ø T 0

Edit: Formatting is lost here, but all those "T" and "Ø" etc are each on their own line, so it's a vomit of vertical characters that scrolls down my screen.

Re: Meta Llama 3

#762

Post by jokethrowaway »

viraptor wrote: post #579
hanspeter wrote: post #458

Earlier quoted context omitted.

It's because of regulations! The same reason that Threads was launched with a delay in EU. It simply takes a lot of work to comply with EU regulations, and by no surprise will we see these launches happen outside of EU first.

It's trivial to comply with EU privacy regulation if you're not depending on selling customer data. But if you say "It's because of regulations!" I hope you have a source to back that up.

It is because of regulations. Nothing is trivial and anything has a cost. Not only it impacts existing businesses, it also make it harder for a struggling new business to compete with the current leaders.

Regulations in the name of the users are actually just made to solidify the top lobbyists in their positions.

The reasons I hate regulations is not because billionaires have to spend an extra week on some employee's salary, but because it makes it impossible for me tiny business to enter a new business due to the sheer complexity of it (or force me to pay more for someone else to handle it, think Paddle vs Stripe thanks to EU VATMOSS)

I'm completely fine with giving away some usage data to get a free product, it's not like everyone is against it.

I'd also prefer to be tracked without having to close 800 pop-ups a day.

Draconian regulations like the EU ones destroy entire markets and force us to a single business model where we all need to pay with hard cash.

Re: Meta Llama 3

#763

Post by RamblingCTO »

tmalsburg2 wrote: post #324
noiseinvacuum wrote: post #254

Earlier quoted context omitted.

Good thing that he's only 39 years old and seems more energetic than ever to run his company. Having a passionate founder is, imo, a big advantage for Meta compared to other big tech companies.

Love how everyone is romanticizing his engineering mindset. But have we already forgotten that he was even more passionate about the metaverse which, as far as I can tell, was a 50B failure?

I swear, this feels like people get paid to write positive stuff about him? Have you forgotten his shitty leadership and practices around data and lock-ins?

Re: Meta Llama 3

#765

Post by yuppiepuppie »

akashkahlon wrote: post #764

At this time it does not seem to be GPT4 comparable in terms of quality, but tight integration with whatsapp would be real GPT chat killer

When I had my US phone registered on WhatsApp a few months ago, there was a MetaAI interface to interact with. Now that I have a European number, it no longer appears :(

Re: Meta Llama 3

#766

Post by 2dvisio »

nathanh4903 wrote: post #582

I tried generating a Chinese rap song, and it did generate a pretty good rap. However, upon completion, it deleted the response, and showed > I don’t understand Chinese yet, but I’m working on it. I will send you a message when we can talk in Chinese. I tried some other languages and the same. It will generate non-English language, but once its done, the response is deleted and replaced with the message

Tried with Italian and it seems to work but always appends the following disclaimer:

«I am still improving my command of non-English languages, and I may make errors while attempting them. I will be most useful to you if I can assist you in English.»

Re: Meta Llama 3

#767

Post by latexr »

mrtranscendence wrote: post #194
sa-code wrote: post #122

Earlier quoted context omitted.

EU actually has the opposite of draconian privacy laws. It's more that meta doesn't have a business model if they don't intrude on your privacy

Well, exactly, and that's why IMO they'll end up pulling out the EU. There's barely any money in non-targeted ads.

> IMO they'll end up pulling out the EU.

If only we’d be so lucky. I don’t thing they will, but fingers crossed.

Re: Meta Llama 3

#768

Post by visarga »

kristianp wrote: post #583

Slightly off-topic, but I'd like to see a model that can fit nicely on a consumer 24GB GPU, such as a 20B model (8bit quantized, but some spare space to allow for context), or perhaps 40B so that a 4-bit quant could fit into 20GB VRAM. It's disappointing to me that Meta stopped releasing the 30B after llama 1. (I know codellama exists, but that's been finetuned to one use case).

It's still possible to transform the 8B model into a MOE with N x 8B with a few tricks.

Re: Meta Llama 3

#769

Post by viraptor »

jokethrowaway wrote: post #762
viraptor wrote: post #579

Earlier quoted context omitted.

It's trivial to comply with EU privacy regulation if you're not depending on selling customer data. But if you say "It's because of regulations!" I hope you have a source to back that up.

It is because of regulations. Nothing is trivial and anything has a cost. Not only it impacts existing businesses, it also make it harder for a struggling new business to compete with the current leaders. Regulations in the name of the users are actually just made to solidify the top lobbyists in their positions. The reasons I hate regulations is not because billionaires have to spend an extra week on some employee's…

You didn't provide the source for the claim though. You're saying you think they made that choice because of regulations and what your issues are. That could well be true, but we really don't know. Maybe there's a more interesting reason. I'm just saying you're really sure for a person who wasn't involved in this.

Re: Meta Llama 3

#770

Post by altilunium »

mywacaday wrote: post #397
eigenvalue wrote: post #231

I just want to express how grateful I am that Zuck and Yann and the rest of the Meta team have adopted an open approach and are sharing the model weights, the tokenizer, information about the training data, etc. They, more than anyone else, are responsible for the explosion of open research and improvement that has happened with things like llama.cpp that now allow you to run quite decent models locally on consumer h…

Looks like it can't be accessed outside the states? I get a "Meta AI isn't available yet in your country"

Llama3 is available on Poe.
Post reply on HN