Live data from Hacker News

Bunny AI

bunny.net

11–20 of 156 posts

Re: Bunny AI

#12
post #8

Looks like it is generating on-the-fly. No? Second request for each generation (unique number) takes no time. for a in `seq 1000 2000`; do wget "https://bunnynet-avatars.b-cdn.net/.ai/img/dalle-256/avatar/email-${a}/rabbit.jpg?width=128&hiEbunny=is_this_secure_though" ; done

[deleted]

Re: Bunny AI

#13
Thinking the next logical step - chatgpt at edge - could be even more useful.

Though I guess that still has the underlying limitation of compute shortage so could take a while

Re: Bunny AI

#15
I can't understand the need for this kind of thing as there are so many options for using Stable Diffusion for very cheap (or free) and of course Dall E has its own UI. What's the point of using a service like this (besides getting free compute while they are launching)? Do we really need another service aggregator?

Re: Bunny AI

#16
post #13

Thinking the next logical step - chatgpt at edge - could be even more useful. Though I guess that still has the underlying limitation of compute shortage so could take a while

OpenAI has very similar models available in their API.

Re: Bunny AI

#18

The commoditization of image generation has been shockingly fast. Now our CDN provider provides low-cost generation.

Kind of. They all run Stable Diffusion because they released fully open source.

There’s still competitive advantage to owning, training, and gatekeeping access to models. MidJourney and DallE are both superior to Stable Diffusion along many axes.

Monetizing models is tricky because it’s so cheap to run locally but so expensive in the cloud. Except if you release your model such that it can run locally all advantage is lost.

I wonder if there is a way to split compute such that only the last 10% runs in the cloud?

Re: Bunny AI

#19

The commoditization of image generation has been shockingly fast. Now our CDN provider provides low-cost generation.

Kind of. They all run Stable Diffusion because they released fully open source. There’s still competitive advantage to owning, training, and gatekeeping access to models. MidJourney and DallE are both superior to Stable Diffusion along many axes. Monetizing models is tricky because it’s so cheap to run locally but so expensive in the cloud. Except if you release your model such that it can run locally all advantage i…

Why is it expensive to run in the cloud and cheap to run on a device?

1. Commodity hardware can do the inference on a single instance (must be true if a user device can do it).

2. It’s apparently possible to run a video game streaming service for $10/month/user.

3. So users should be able to generate unlimited images (one at a time) for $10/month?

Maybe the answer is the DallE/Midjourney models running in the cloud are super inefficient and Stable Diffusion is better. So the services will need to care about optimizing to get that kind of performance. But it’s not inherently expensive because they run it on the cloud.

Re: Bunny AI

#20
post #13

Thinking the next logical step - chatgpt at edge - could be even more useful. Though I guess that still has the underlying limitation of compute shortage so could take a while

There's a huge difference between diffusion models that were built to be run on commodity hardware and the huge autoregressive models like GPT. You can't even run GPT3 on the cloud without some specialized interconnect.
Post reply on HN