Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Llama 3.2: Revolutionizing edge AI and vision with open, customizable models

ai.meta.com

Post reply on HN
Print view View original

291–300 of 343 posts

Re: Llama 3.2: Revolutionizing edge AI and vision with open, customizable models

#291

Post by edc117 »

grahamj wrote: post #279
svieira wrote: post #266

Earlier quoted context omitted.

If God was real, wouldn't you? If God is real and you're wrong about that (or if you don't yet know the real God) would you want the computer to agree with your misconception or would you want it to know the truth? Cut out "computer" here - would you want any person to hold a falsehood as the truth?

God isn’t real and I don’t want any person - or computer - to believe otherwise.

If you don't have any proof of that, you're no different than those that believe he exists. (Respectfully) Agnosticism really is the only correct scientific approach.

Re: Llama 3.2: Revolutionizing edge AI and vision with open, customizable models

#292

Post by mike_hearn »

nickpsecurity wrote: post #252
mike_hearn wrote: post #195

Earlier quoted context omitted.

You're objectively correct but judging from your downvotes there seems to be some denial here about that! The atheism alone means it's different from a big chunk of the world's population, possibly the majority. Supposedly around 80% of the world's population identify with a religion though I guess you can debate how many people are truly devout. The good news is that the big AI labs seem to be slowly getting a grip…

“ You're objectively correct but judging from your downvotes there seems to be some denial here about that!” I learned upon following Christ and being less liberal that it’s a technique Progressives use. One or more of them ask if there’s any data for the other side. If it doesn’t appear, they’ll say it doesn’t exist. If it does, they try to suppress it with downvotes or deletion. If they succeed, they’ll argue the s…

I think some of it is the training material. People with strong ideologies tend to write more.

Re: Llama 3.2: Revolutionizing edge AI and vision with open, customizable models

#293

Post by snek_case »

rcpt wrote: post #270
a2128 wrote: post #234

Earlier quoted context omitted.

Is this sustainable though, or are they just trying really hard to attract users? If I build all of my tooling on it, will they start charging me thousands of dollars next year once the subsidies dry up? With a local model running with open source software, at least I can know that as long as my computer can still compute, the model will still run just as well and just as fast as it did on day 1, and cost the same am…

Aren't API calls essentially swappable now between vendors now? If you wanted to switch from Gemini to Chatgpt you could copy/paste your code into Chatgpt and ask it to switch to their API. Disclaimer I work at Google but not on Gemini

Different APIs and models are going to come with different capabilities and restrictions.

Re: Llama 3.2: Revolutionizing edge AI and vision with open, customizable models

#294

Post by QuinnyPig »

a2128 wrote: post #234
faangguyindia wrote: post #203

Earlier quoted context omitted.

If you are in US, you get 1 billion tokens a DAY with Gemini (Google) completely free of cost. Gemini Flash is fast with upto 4 million token context. Gemini Flash 002 improved in math and logical abilities surpassing Claude and Gpt 4o You can simply use Gemini Flash for Code Completion, git review tool and many more.

Is this sustainable though, or are they just trying really hard to attract users? If I build all of my tooling on it, will they start charging me thousands of dollars next year once the subsidies dry up? With a local model running with open source software, at least I can know that as long as my computer can still compute, the model will still run just as well and just as fast as it did on day 1, and cost the same am…

Facts. Google did the same thing you describe with Maps a few years ago.

Re: Llama 3.2: Revolutionizing edge AI and vision with open, customizable models

#295

Post by Carrok »

TZubiri wrote: post #257
simonw wrote: post #55

I'm absolutely amazed at how capable the new 1B model is, considering it's just a 1.3GB download (for the Ollama GGUF version). I tried running a full codebase through it (since it can handle 128,000 tokens) and asking it to summarize the code - it did a surprisingly decent job, incomplete but still unbelievable for a model that tiny: https://gist.github.com/simonw/64c5f5b111fe473999144932bef42... More of my notes he…

This obsession with using AI to help with programming is short sighted. We discover gold and you think of gold pickaxes.

If we make this an analogy to video games, gold pickaxes can usually mine more gold much faster.

What could be short sighted about using tools to improve your daily work?

Re: Llama 3.2: Revolutionizing edge AI and vision with open, customizable models

#296

Post by airspresso »

faangguyindia wrote: post #203
simonw wrote: post #55

I'm absolutely amazed at how capable the new 1B model is, considering it's just a 1.3GB download (for the Ollama GGUF version). I tried running a full codebase through it (since it can handle 128,000 tokens) and asking it to summarize the code - it did a surprisingly decent job, incomplete but still unbelievable for a model that tiny: https://gist.github.com/simonw/64c5f5b111fe473999144932bef42... More of my notes he…

If you are in US, you get 1 billion tokens a DAY with Gemini (Google) completely free of cost. Gemini Flash is fast with upto 4 million token context. Gemini Flash 002 improved in math and logical abilities surpassing Claude and Gpt 4o You can simply use Gemini Flash for Code Completion, git review tool and many more.

Free of cost != free open model. Free of cost means all your requests are logged for Google to use as training data and whatnot.

Llama3.2 on the other hand runs locally, no data is ever sent to a 3rd party, so I can freely use it to summarize all my notes regardless of one of them being from my most recent therapy session and another being my thoughts on how to solve a delicate problem involving politics at work. I don't need to pre-classify all the input to make sure it's safe to share. Same with images, I can use Llama3.2 11B locally to interpret any photo I've taken without having to worry about getting consent from the people in the photo to share it with a 3rd party, or whether the photo is of my passport for some application I had to file or a receipt of something I bought that I don't want Google to train their next vision model OCR on.

TL;DR - Google free of cost models are irrelevant when talking about local models.

Re: Llama 3.2: Revolutionizing edge AI and vision with open, customizable models

#297

Post by croes »

a_wild_dandan wrote: post #48

"The Llama jumped over the ______!" (Fence? River? Wall? Synagogue?) With 1-hot encoding, the answer is "wall", with 100% probability. Oh, you gave plausibility to "fence" too? WRONG! ENJOY MORE PENALTY, SCRUB! I believe this unforgiving dynamic is why model distillation works well. The original teacher model had to learn via the "hot or cold" game on text answers. But when the child instead imitates the teacher's pr…

Isn't jumping over a fence more likely than jumping over a wall?

Re: Llama 3.2: Revolutionizing edge AI and vision with open, customizable models

#299

Post by moffkalast »

QuinnyPig wrote: post #294
a2128 wrote: post #234

Earlier quoted context omitted.

Is this sustainable though, or are they just trying really hard to attract users? If I build all of my tooling on it, will they start charging me thousands of dollars next year once the subsidies dry up? With a local model running with open source software, at least I can know that as long as my computer can still compute, the model will still run just as well and just as fast as it did on day 1, and cost the same am…

Facts. Google did the same thing you describe with Maps a few years ago.

It's not just Google, literally every new service always does this. Prices will always go up once the have enough customers and bean counters start pointing at spreadsheets. Ergo, local is the only option if you don't want to be held for ransom afterwards. As goes for web servers, scraper bots, and whatever, so goes for llms.

Re: Llama 3.2: Revolutionizing edge AI and vision with open, customizable models

#300

Post by altruios »

grahamj wrote: post #279
svieira wrote: post #266

Earlier quoted context omitted.

If God was real, wouldn't you? If God is real and you're wrong about that (or if you don't yet know the real God) would you want the computer to agree with your misconception or would you want it to know the truth? Cut out "computer" here - would you want any person to hold a falsehood as the truth?

God isn’t real and I don’t want any person - or computer - to believe otherwise.

God is not physically real. Neither are numbers. Both come from thinking minds.

God is an egregore. It may be useful to model the various religions as singular entities under this lens, not true in the strictest sense, but useful none the less.

God, Santa, and (our {human} version of) Math: all exist in 'mental space', they are models of the world (one is a significantly more accurate model, obviously).

Atheist here: God didn't create humans, humans created an egregorical construction we call God, and we should kill the egregores we have let loose into the minds of humans.

Post reply on HN