Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

1-Bit Bonsai Image 4B Image Generation for Local Devices

prismml.com

Post reply on HN
Print view View original

171–180 of 214 posts

Re: 1-Bit Bonsai Image 4B Image Generation for Local Devices

#171

Post by pjc50 »

plomme wrote: post #162
pjc50 wrote: post #156

Earlier quoted context omitted.

The death of consensus reality is also the death of democratic politics. Too many people regard that as a positive.

Sure, but LLMS and image generators are not the death of "consensus reality". Healthy democracies will still have investigative journalism, public debate, trustworthy institutions, etc.

> will still have investigative journalism, public debate, trustworthy institutions, etc.

All of which are under serious threat from social media, buyouts by billionaires, and simple smear campaigns. Not dependent on AI, but effects which will be magnified by AI.

Re: 1-Bit Bonsai Image 4B Image Generation for Local Devices

#172

Post by pjc50 »

onion2k wrote: post #123
flashman wrote: post #97

Twenty years ago, I don't think any of us were excited about a future internet where we couldn't trust whether what we were seeing or reading was genuine. I hope one day we'll be able to look back on this era as an aberration, like that scene in Mad Men where the Drapers fling their picnic rubbish onto the grass and drive away.

You don't remember the discussion around Narrative Science ( https://en.wikipedia.org/wiki/Narrative_Science ) then. They were a university spin-out that could write plausible-sounding baseball news articles (and later finance) from the stats. Their software enabled local news websites to publish articles about every game, which was seen as a boon to sports fans and a key driver for web traffic. There was a lot of cr…

> could write plausible-sounding baseball news articles (and later finance) from the stats

Back in the day, baseball commentators sometimes did this for live games they couldn't see based on very limited information they were being passed. One such commentator was .. Ronald Reagan.

Re: 1-Bit Bonsai Image 4B Image Generation for Local Devices

#173

Post by mft_ »

fulafel wrote: post #155
mft_ wrote: post #145

Earlier quoted context omitted.

Probably the bottom end an individual would want to consider using due to slow generation time . Sure, you could theoretically take a model compressed in this manner and deploy it on an old netbook and run the calculations on the CPU, but each image would probably take an hour…

I was thinking more about the 0-3 year old midrange x86 laptops and phones, they have unified memory GPUs that are easily worth using (vs CPU), support narrow FP datatypes but don't have a ton of memory bandwidth.

Fair enough :)

Re: 1-Bit Bonsai Image 4B Image Generation for Local Devices

#174

Post by itake »

ekianjo wrote: post #161
itake wrote: post #160

Earlier quoted context omitted.

you're also missing all of the positive healthcare outcomes the internet grants due to better access to information. If the internet saves 1,000 lives per day, and hurts 1, then the roi is there.

> positive healthcare outcomes Its seems to be hidden from view. Global health is getting worse, not better

Can you cite a source?

Covid pushed back the longevity gains, but there hasn't be a decline or flatten since the internet grew in popularity (2000 - 2019).

https://www.who.int/data/gho/data/themes/mortality-and-globa...

Re: 1-Bit Bonsai Image 4B Image Generation for Local Devices

#175

Post by OvidNaso »

davkan wrote: post #130
nostrebored wrote: post #114

Earlier quoted context omitted.

I am pretty excited. The factuality of important events has been distorted for most of history. Moving to a low information trust society is something that I think will be positive.

I don’t see it leading anywhere but a flat earth. When no one can be trusted whoever can tell you want to hear will be who people listen to and snake oil salesmen will reign supreme. Even if he was CIA, Cronkite’s world was closer to the truth than Alex Jones’.

Gr 3d 7

Re: 1-Bit Bonsai Image 4B Image Generation for Local Devices

#176

Post by general_reveal »

lumost wrote: post #10

I actually can’t wait for the future where I upgrade hardware in order to upgrade my ai as an alternative to an expensive subscription. There are many problems I want to work on which require billions of tokens. These are completely inaccessible without corporate project sponsorship at the moment. An asic generation machine which can pump out a few 10s of thousands of tokens per second at opus4.6 quality is more than…

Round Robin the free tier APIs, should be effectively free. Just say say “sike” if discussing sensitive issues so the LLM never flags you.

Re: 1-Bit Bonsai Image 4B Image Generation for Local Devices

#177

Post by latexr »

nl wrote: post #166
flashman wrote: post #97

Twenty years ago, I don't think any of us were excited about a future internet where we couldn't trust whether what we were seeing or reading was genuine. I hope one day we'll be able to look back on this era as an aberration, like that scene in Mad Men where the Drapers fling their picnic rubbish onto the grass and drive away.

I LOVE being able to create images of things I could previously only imagine. I think the inability to see the freedom AI gives people is one of the saddest things I've seen. I remember when the internet was young people would complain about how it was becoming read-only. Now we have a tool to let people express themselves and people complain the fact there are fake pics on AirBNB means the collapse of society. Pleas…

> I think the inability to see the freedom AI gives people is one of the saddest things I've seen.

No one’s failing to see the good things, hypothetical or not. Most of us are aware just fine, we just don’t all agree that the negative trade-offs are worth it.

Re: 1-Bit Bonsai Image 4B Image Generation for Local Devices

#178

Post by selcuka »

tomaytotomato wrote: post #153
barnas2 wrote: post #34

Earlier quoted context omitted.

A company called Taalas is working on something like that. Not Opus4.6 quality, but I'm sure they're targeting larger models. Currently they're using a LLama 8B model. It runs at ~17k tokens per second, and you can test it at https://chatjimmy.ai/ .

That's cool, I just tested it out and it is fast but unfortunately its accuracy is not great.

It's an 8B model. Consider it a proof-of-concept.

Re: 1-Bit Bonsai Image 4B Image Generation for Local Devices

#179

Post by sunaookami »

flashman wrote: post #97

Twenty years ago, I don't think any of us were excited about a future internet where we couldn't trust whether what we were seeing or reading was genuine. I hope one day we'll be able to look back on this era as an aberration, like that scene in Mad Men where the Drapers fling their picnic rubbish onto the grass and drive away.

>we couldn't trust whether what we were seeing or reading was genuine

You could never trust ANYTHING you read or see on the internet, this isn't new. There are thousands of old hoaxes that many people still believe.

Post reply on HN