Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

1-Bit Bonsai Image 4B Image Generation for Local Devices

prismml.com

Post reply on HN
Print view View original

151–160 of 214 posts

Re: 1-Bit Bonsai Image 4B Image Generation for Local Devices

#151

Post by bonzini »

orleyhuxwell wrote: post #143
paulluuk wrote: post #135

Earlier quoted context omitted.

Twenty years ago my teachers were telling me not to use Wikipedia because you can't trust anything on the internet. You should never date someone you met through an app or website because they are 100% murderers. "The internet is for porn". Things have a way of improving over time, and people always overestimate societal risks of new tech in the beginning.

Young girls suicides, Brexit&Trump (post-truth politics, general democratic decline), demographic catastrophe, obesity crisis are often partially attributed to social media. Not saying that tech is inherently evil, these could have been prevented, but to me it seems we have underestimated the social risks and failed to regulate accordingly.

Demographic decay was already going on in the 90s in some countries (Italy, South Korea, Japan), and the obesity crisis in the US too. For Brexit & Trump it could have been a contributing factor, but Italy had Berlusconi in the 90s just with TV and France almost elected Le Pen (father).

That said, while I am generally skeptical of these effects, fake news are a real problem that social media has exacerbated.

Re: 1-Bit Bonsai Image 4B Image Generation for Local Devices

#152

Post by plomme »

hidroto wrote: post #150
plomme wrote: post #147

Earlier quoted context omitted.

I think it may turn out postive; That the less we are able to take images and video at face value the better. Motivated actors have been able to doctor, fake, or spin media content since time immemorial. But peoples default mode was to trust what they saw. Now that fake imagery is ubiquitous, maybe we'll all get a bit more skeptical.

being skeptical and determining the truth takes a lot of work. I fear that we may just refuse to wade through all the lies and just accept a enforced willful ignorance.

You're right. But I'd rather be uninformed than misinformed.

Re: 1-Bit Bonsai Image 4B Image Generation for Local Devices

#153

Post by tomaytotomato »

barnas2 wrote: post #34
lumost wrote: post #10

I actually can’t wait for the future where I upgrade hardware in order to upgrade my ai as an alternative to an expensive subscription. There are many problems I want to work on which require billions of tokens. These are completely inaccessible without corporate project sponsorship at the moment. An asic generation machine which can pump out a few 10s of thousands of tokens per second at opus4.6 quality is more than…

A company called Taalas is working on something like that. Not Opus4.6 quality, but I'm sure they're targeting larger models. Currently they're using a LLama 8B model. It runs at ~17k tokens per second, and you can test it at https://chatjimmy.ai/ .

That's cool, I just tested it out and it is fast but unfortunately its accuracy is not great.

Re: 1-Bit Bonsai Image 4B Image Generation for Local Devices

#155

Post by fulafel »

mft_ wrote: post #145
fulafel wrote: post #120

Earlier quoted context omitted.

> Lots of models will run on 8-12 GB 1080-generation GPUs onwards, or on Macs with similar memory, which are probably the bottom end from a GPU power perspective anyway. Not the bottom end - most people are on laptops or mobile devices that are much lower GPU power than this.

Probably the bottom end an individual would want to consider using due to slow generation time . Sure, you could theoretically take a model compressed in this manner and deploy it on an old netbook and run the calculations on the CPU, but each image would probably take an hour…

I was thinking more about the 0-3 year old midrange x86 laptops and phones, they have unified memory GPUs that are easily worth using (vs CPU), support narrow FP datatypes but don't have a ton of memory bandwidth.

Re: 1-Bit Bonsai Image 4B Image Generation for Local Devices

#156

Post by pjc50 »

plomme wrote: post #147
flashman wrote: post #97

Twenty years ago, I don't think any of us were excited about a future internet where we couldn't trust whether what we were seeing or reading was genuine. I hope one day we'll be able to look back on this era as an aberration, like that scene in Mad Men where the Drapers fling their picnic rubbish onto the grass and drive away.

I think it may turn out postive; That the less we are able to take images and video at face value the better. Motivated actors have been able to doctor, fake, or spin media content since time immemorial. But peoples default mode was to trust what they saw. Now that fake imagery is ubiquitous, maybe we'll all get a bit more skeptical.

The death of consensus reality is also the death of democratic politics. Too many people regard that as a positive.

Re: 1-Bit Bonsai Image 4B Image Generation for Local Devices

#157

Post by moebrowne »

nickvec wrote: post #16
MitPitt wrote: post #3

Lately I've noticed posts with barely 10 points getting to HN frontpage. Was it always like this?

If you are looking to see the "true" HN frontpage (i.e. most upvoted posts), I'd recommend using https://hckrnews.com

If you want a list of posts simply ordered by upvotes: https://news.ycombinator.com/best

Re: 1-Bit Bonsai Image 4B Image Generation for Local Devices

#158

Post by pjc50 »

nostrebored wrote: post #114
flashman wrote: post #97

Twenty years ago, I don't think any of us were excited about a future internet where we couldn't trust whether what we were seeing or reading was genuine. I hope one day we'll be able to look back on this era as an aberration, like that scene in Mad Men where the Drapers fling their picnic rubbish onto the grass and drive away.

I am pretty excited. The factuality of important events has been distorted for most of history. Moving to a low information trust society is something that I think will be positive.

Low trust societies are poorer because everyone has to spend much more effort on verifying everything. People give up business opportunities because they can't trust their partners. It becomes more nepotistic because people trust family over strangers.

Low information trust societies get destroyed by pandemics of both physical viruses (due to anti-vax and medical distrust; we can see this happening again with Ebola) and destructive memetic lies (see 20th century fascism).

Re: 1-Bit Bonsai Image 4B Image Generation for Local Devices

#159

Post by pjc50 »

lumost wrote: post #57
bigmadshoe wrote: post #17

Earlier quoted context omitted.

Can you give an example of such a problem?

"Design me a 3d printable rocket engine for a hobby rocket project. Verify it's design in a full simulation. Iterate until it works reliably in simulation based on a verified printable design on a consumer laser sintering device (or substitute contract manufacture for under 1000 dollars)." This is a hobby version of a project, but you can imagine commercial versions of the same prompt for new databases, genomics stud…

Verifying how the model works against the real world is the difficult, dangerous bit.

There might be some interesting side effects from making simulation software, which is currently either an expensive niche or quirky university project (SPICE always has that feel).

Re: 1-Bit Bonsai Image 4B Image Generation for Local Devices

#160

Post by itake »

orleyhuxwell wrote: post #143
paulluuk wrote: post #135

Earlier quoted context omitted.

Twenty years ago my teachers were telling me not to use Wikipedia because you can't trust anything on the internet. You should never date someone you met through an app or website because they are 100% murderers. "The internet is for porn". Things have a way of improving over time, and people always overestimate societal risks of new tech in the beginning.

Young girls suicides, Brexit&Trump (post-truth politics, general democratic decline), demographic catastrophe, obesity crisis are often partially attributed to social media. Not saying that tech is inherently evil, these could have been prevented, but to me it seems we have underestimated the social risks and failed to regulate accordingly.

you're also missing all of the positive healthcare outcomes the internet grants due to better access to information.

If the internet saves 1,000 lives per day, and hurts 1, then the roi is there.

Post reply on HN