Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Bunny AI

bunny.net

Post reply on HN
Print view View original

31–40 of 156 posts

Re: Bunny AI

#31

Post by slig »

TuringNYC wrote: post #26
forrestthewoods wrote: post #18

Earlier quoted context omitted.

Kind of. They all run Stable Diffusion because they released fully open source. There’s still competitive advantage to owning, training, and gatekeeping access to models. MidJourney and DallE are both superior to Stable Diffusion along many axes. Monetizing models is tricky because it’s so cheap to run locally but so expensive in the cloud. Except if you release your model such that it can run locally all advantage i…

>> Monetizing models is tricky because it’s so cheap to run locally but so expensive in the cloud. Can you expand on this a bit? The way i'm thinking, that is only the case if you need low-latency. And in that case, it seems you just need to charge to cover compute. We're running Stable Diffusion on an eks cluster and it evens out the load across calls and prevents over-resourcing. If latency isnt an issue, it can be…

>On that note, I havent checked whether there are lambda/fargate style options which provide GPU power, to achieve consumption based pricing tied to usage, but that might be a route. Can anyone speak to this?

https://lambdalabs.com/service/gpu-cloud

Re: Bunny AI

#32

Post by causality0 »

kache_ wrote: post #24
zzzeek wrote: post #22

Saw a great toot yesterday. Startups and media business are looking to make a windfall on AI generated art, music, code, writing, and other services. The payment models will be subscriptions, pay per use, and other models that make more money the more content is produced. But there's still no AI (with associated mechanics) that can fold laundry. (I think the latter would be really useful.)

>There's still no AI that can fold laundry We're actually really close to general robot agents that operate in your home. Check out googleAI's saycan & RT-1 systems https://ai.googleblog.com/2022/12/rt-1-robotics-transformer-... .

That's gonna be great until someone hacks it and has it stab me to death in my sleep.

Re: Bunny AI

#33

Post by fshbbdssbbgdd »

rileyphone wrote: post #23
fshbbdssbbgdd wrote: post #19

Earlier quoted context omitted.

Why is it expensive to run in the cloud and cheap to run on a device? 1. Commodity hardware can do the inference on a single instance (must be true if a user device can do it). 2. It’s apparently possible to run a video game streaming service for $10/month/user. 3. So users should be able to generate unlimited images (one at a time) for $10/month? Maybe the answer is the DallE/Midjourney models running in the cloud a…

Nvidia’s business model makes it inherently more expensive to run on the cloud.

Ah, do you have to contract when you buy the cheap GPUs that you might use then for game streaming but you won’t do AI inference?

Makes me wonder if you could first-sale-doctrine your way out of that problem by buying the GPUs on eBay and not making any agreement with Nvidia.

Re: Bunny AI

#34

Post by [deleted] »

zzzeek wrote: post #22

Saw a great toot yesterday. Startups and media business are looking to make a windfall on AI generated art, music, code, writing, and other services. The payment models will be subscriptions, pay per use, and other models that make more money the more content is produced. But there's still no AI (with associated mechanics) that can fold laundry. (I think the latter would be really useful.)

[deleted]

Re: Bunny AI

#35

Post by TuringNYC »

slig wrote: post #31
TuringNYC wrote: post #26

Earlier quoted context omitted.

>> Monetizing models is tricky because it’s so cheap to run locally but so expensive in the cloud. Can you expand on this a bit? The way i'm thinking, that is only the case if you need low-latency. And in that case, it seems you just need to charge to cover compute. We're running Stable Diffusion on an eks cluster and it evens out the load across calls and prevents over-resourcing. If latency isnt an issue, it can be…

>On that note, I havent checked whether there are lambda/fargate style options which provide GPU power, to achieve consumption based pricing tied to usage, but that might be a route. Can anyone speak to this? https://lambdalabs.com/service/gpu-cloud

Thanks for this. This is nice and the prices are great...but I was specifically curious about something where consumption can be tied to cost (e.g. lambda/fargate style where you pay by the call)

Re: Bunny AI

#36

Post by forrestthewoods »

fshbbdssbbgdd wrote: post #19
forrestthewoods wrote: post #18

Earlier quoted context omitted.

Kind of. They all run Stable Diffusion because they released fully open source. There’s still competitive advantage to owning, training, and gatekeeping access to models. MidJourney and DallE are both superior to Stable Diffusion along many axes. Monetizing models is tricky because it’s so cheap to run locally but so expensive in the cloud. Except if you release your model such that it can run locally all advantage i…

Why is it expensive to run in the cloud and cheap to run on a device? 1. Commodity hardware can do the inference on a single instance (must be true if a user device can do it). 2. It’s apparently possible to run a video game streaming service for $10/month/user. 3. So users should be able to generate unlimited images (one at a time) for $10/month? Maybe the answer is the DallE/Midjourney models running in the cloud a…

I wouldn’t assume those $10/mo gaming services are profitable.

It’s not that running in the cloud is more expensive. It’s that people already have a $2000 laptop or maybe even $1600 RTX 4090. If I’ve got that I don’t want to pay $20/month to 6 different AI services.

Sam Altman said ChatGPT costs like 2 cents per message. I’m sure they can get that way down. Their bills are astronomical. But the data they’re collecting is more valuable than the money they’re spending.

Stable Diffusion isn’t super fast. It takes 30 to 60 GPU seconds. There’s minimal consumer advantage to running in the cloud. Id run them all locally if I could.

Re: Bunny AI

#37

Post by seanw444 »

causality0 wrote: post #32
kache_ wrote: post #24

Earlier quoted context omitted.

>There's still no AI that can fold laundry We're actually really close to general robot agents that operate in your home. Check out googleAI's saycan & RT-1 systems https://ai.googleblog.com/2022/12/rt-1-robotics-transformer-... .

That's gonna be great until someone hacks it and has it stab me to death in my sleep.

More worried about government backdoors.

Re: Bunny AI

#38

Post by danielheath »

causality0 wrote: post #32
kache_ wrote: post #24

Earlier quoted context omitted.

>There's still no AI that can fold laundry We're actually really close to general robot agents that operate in your home. Check out googleAI's saycan & RT-1 systems https://ai.googleblog.com/2022/12/rt-1-robotics-transformer-... .

That's gonna be great until someone hacks it and has it stab me to death in my sleep.

Much like my fears about bluetooth connected cars being hacked to crash on the highway, it turns out that - by and large - nobody wants to kill me (or at least, not badly enough to do anything about it).

Re: Bunny AI

#39

Post by sneak »

fshbbdssbbgdd wrote: post #33
rileyphone wrote: post #23

Earlier quoted context omitted.

Nvidia’s business model makes it inherently more expensive to run on the cloud.

Ah, do you have to contract when you buy the cheap GPUs that you might use then for game streaming but you won’t do AI inference? Makes me wonder if you could first-sale-doctrine your way out of that problem by buying the GPUs on eBay and not making any agreement with Nvidia.

The software is proprietary and is governed by the license. It's not the hardware.
Post reply on HN