Within a day, someone will have trained a LoRA for this 1-bit model that enables hentai content generation on your Apple Watch.
Great.
1-Bit Bonsai Image 4B Image Generation for Local Devices
91–100 of 214 posts
Re: 1-Bit Bonsai Image 4B Image Generation for Local Devices
#92Stuff like this is great - more promises of things that can run on phones please!
Sadly right now the expensive developer subscription means the few folks willing to hold a forever subscription make something that barely works then move on… or make something with so many ads it is an app. For example Google’s “Model Garden” app has no ads but still has major UX issues and isn’t suitable for daily use, even though the models are amazing.
Raising awareness of how capable today’s phone hardware is will make normal people demand to run what they choose on their phones. It’d be a much stronger way back to general purpose computing than via all legislation that has been tried so far..
Re: 1-Bit Bonsai Image 4B Image Generation for Local Devices
#93Is there a benchmark of local image generation models? Local = can run on a 16 GB MacBook or 8 GB+ NVIDIA card.
I run a moderately popular image comparison benchmark site called GenAI Image Showdown [1]. You can click “View All Models” and filter the list down to just locally runnable options (Flux, Qwen, Hunyuan, etc.).
Re: 1-Bit Bonsai Image 4B Image Generation for Local Devices
#94[dead]
Re: 1-Bit Bonsai Image 4B Image Generation for Local Devices
#95Earlier quoted context omitted.
Genuine question: doesn't it blow your mind that there exists a 1 Gigabyte file/program that can generate any image you can think of just from a rough description of it?
Where are you getting the 1 Gigabyte number from? Their 1-bit quantized Diffusion Transformer is just under 1 GB. You also need the text-encoder (4-bit quantized) and VAE (unquantized) for inference and their combined weight is ~3.42 GB. TBF, even at that size it's no less mind blowing.
Same order of magnitude.
Re: 1-Bit Bonsai Image 4B Image Generation for Local Devices
#96I actually can’t wait for the future where I upgrade hardware in order to upgrade my ai as an alternative to an expensive subscription. There are many problems I want to work on which require billions of tokens. These are completely inaccessible without corporate project sponsorship at the moment. An asic generation machine which can pump out a few 10s of thousands of tokens per second at opus4.6 quality is more than…
Can you give an example of such a problem?
Not OP but if I had a couple RTX 6000 I'd throw them at decompiling bloodborne to play on PC without emulation.
Re: 1-Bit Bonsai Image 4B Image Generation for Local Devices
#97Twenty years ago, I don't think any of us were excited about a future internet where we couldn't trust whether what we were seeing or reading was genuine. I hope one day we'll be able to look back on this era as an aberration, like that scene in Mad Men where the Drapers fling their picnic rubbish onto the grass and drive away.
Re: 1-Bit Bonsai Image 4B Image Generation for Local Devices
#98Earlier quoted context omitted.
Can you give an example of such a problem?
"Design me a 3d printable rocket engine for a hobby rocket project. Verify it's design in a full simulation. Iterate until it works reliably in simulation based on a verified printable design on a consumer laser sintering device (or substitute contract manufacture for under 1000 dollars)." This is a hobby version of a project, but you can imagine commercial versions of the same prompt for new databases, genomics stud…
You almost certainly do not want an LLM to do that. Leap71 actually has computational models generating functional rocket engines that way. You could absolutely wrap a tool like that in a shell and handle control with an LLM and not need anywhere near the tokens.
Thats the thing - these models see and predict tokens. For any real engineering you get more bang for your buck using math.
Re: 1-Bit Bonsai Image 4B Image Generation for Local Devices
#99I extracted the code from the web demo to add to make a web image generation node to my in browser ai workflow tool, and it’s pretty sweet. Waiting for xenova to add to transformersjs 4.3 and I’ll release as well. Couldn’t wait though to test.
Re: 1-Bit Bonsai Image 4B Image Generation for Local Devices
#100Can anyone think of any negative externalities of making generative photorealistic images illegal?
I can think of a lot of positives. The negatives amount to a convoluted argument about the limits of free speech.