Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Llama 3.2: Revolutionizing edge AI and vision with open, customizable models

ai.meta.com

Post reply on HN
Print view View original

221–230 of 343 posts

Re: Llama 3.2: Revolutionizing edge AI and vision with open, customizable models

#221

Post by chriskanan »

The assessments of visual capability really need to be more robust. They are still using datasets like VQAv2, which while providing some insight, have many issues. There are many newer datasets that serve as much more robust tests and that are less prone to being affected by linguistic bias.

I'd like to see more head-to-head comparisons with community created multi-modal LLMs as done in these papers:

https://arxiv.org/abs/2408.05334

https://arxiv.org/abs/2408.03326

I look forward to reading the technical report, once its available. I couldn't find a link to one, yet.

Re: Llama 3.2: Revolutionizing edge AI and vision with open, customizable models

#222

Post by monkfish328 »

opdahl wrote: post #6

I'm blown away with just how open the Llama team at Meta is. It is nice to see that they are not only giving access to the models, but they at the same time are open about how they built them. I don't know how the future is going to go in the terms of models, but I sure am grateful that Meta has taken this position, and are pushing more openness.

Zuckerberg has never liked having Android/iOs as gatekeepers i.e. "platforms" for his apps.

He's hoping to control AI as the next platform through which users interact with apps. Free AI is then fine if the surplus value created by not having a gatekeeper to his apps exceeds the cost of the free AI.

That's the strategy. No values here - just strategy folks.

Re: Llama 3.2: Revolutionizing edge AI and vision with open, customizable models

#223

Post by monkfish328 »

Zuckerberg has never liked having Android/iOs as gatekeepers i.e. "platforms" for his apps.

He's hoping to control AI as the next platform through which users interact with apps. Free AI is then fine if the surplus value created by not having a gatekeeper to his apps exceeds the cost of the free AI.

That's the strategy. No values here - just strategy folks.

Re: Llama 3.2: Revolutionizing edge AI and vision with open, customizable models

#224

Post by theaniketmaurya »

lowyek wrote: post #134
simonw wrote: post #55

I'm absolutely amazed at how capable the new 1B model is, considering it's just a 1.3GB download (for the Ollama GGUF version). I tried running a full codebase through it (since it can handle 128,000 tokens) and asking it to summarize the code - it did a surprisingly decent job, incomplete but still unbelievable for a model that tiny: https://gist.github.com/simonw/64c5f5b111fe473999144932bef42... More of my notes he…

Hi simon, is there a way to run the vision model easily on my mac locally?

You can run it with LitServe (MPS GPU), here is the code - https://lightning.ai/lightning-ai/studios/deploy-llama-3-2-v...

Re: Llama 3.2: Revolutionizing edge AI and vision with open, customizable models

#226

Post by Dzidas »

create-username wrote: post #79
dhbradshaw wrote: post #19

Tried out 3B on ollama, asking questions in optics, bio, and rust. It's super fast with a lot of knowledge, a large context and great understanding. Really impressive model.

Can it speak foreign languages like German, Spanish, Ancient Greek?

Not one of these, but I tried on a small, Lithuanian, language. The catch is what the language has complicated grammar, but not as bad as Finnish, Estonian and Hungarian. I asked to summarise some text and it does the job, but the grammar is not perfect and in some cases, at a foreigner level. Plus, it invented some words with no meaning. E.g. `„Sveika gyvensena“ turi būti *atnemitinamas* viso kurso *vykišioje*.`

Re: Llama 3.2: Revolutionizing edge AI and vision with open, customizable models

#227

Post by stefs »

kristopolous wrote: post #187
nextworddev wrote: post #142

Earlier quoted context omitted.

They are literally training on all the free personal data you provided, so they owe you this much

Given what I see in Facebook comments I'm surprised the AI doesn't just respond with "Amen. Happy Birthday" to every query. They're clearly majorly scrubbing things somehow

given what i see in facebook posts much of their content is already AI generated and thus would poison their training data well.

Re: Llama 3.2: Revolutionizing edge AI and vision with open, customizable models

#228

Post by isoprophlex »

seydor wrote: post #199
isoprophlex wrote: post #194

Earlier quoted context omitted.

They're out to fuck over the competition by killing their moat. Classic commoditize your complement.

I believe the most important contribution is to show that super-funded companies don't really have a special moat: Llama is transformers, they just have the money to scale it. Many entities around the world can replicate this and it seems Meta is doing it before they do.

Crocodiles, swimming in a moat filled with money, haha

Re: Llama 3.2: Revolutionizing edge AI and vision with open, customizable models

#229

Post by 1986 »

mike_hearn wrote: post #195
nickpsecurity wrote: post #122

Earlier quoted context omitted.

Google’s and OpenAI often answered far-left, Progressive, and atheist. Google’s was censoring white people at one point. Facebook seems to espouse similar values. They’ve funded work to increase those values. Many mention topics relevant to these things in their papers in the bias or alignment sections. These political systems don’t represent the majority of the world. They might not even represent half the U.S.. Peo…

You're objectively correct but judging from your downvotes there seems to be some denial here about that! The atheism alone means it's different from a big chunk of the world's population, possibly the majority. Supposedly around 80% of the world's population identify with a religion though I guess you can debate how many people are truly devout. The good news is that the big AI labs seem to be slowly getting a grip…

You want the computer to believe in God?

Re: Llama 3.2: Revolutionizing edge AI and vision with open, customizable models

#230

Post by fennecfoxy »

opdahl wrote: post #6

I'm blown away with just how open the Llama team at Meta is. It is nice to see that they are not only giving access to the models, but they at the same time are open about how they built them. I don't know how the future is going to go in the terms of models, but I sure am grateful that Meta has taken this position, and are pushing more openness.

As the Google memo (https://www.semianalysis.com/p/google-we-have-no-moat-and-ne...) pointed out, a lot of OSS stuff/improvements are being built on top of Meta's work which somewhat benefits them as well.

But still, Kudos to Zuck/Meta for doing it anyway.

Post reply on HN