91–100 of 156 posts
Earlier quoted context omitted.
Do you have a GPU? Run it locally, it's really easy.
Oh I didn't know I could do that, thanks. Yes I have a GPU. I'm on the M1 Macbook Pro.
I think it probably needs updating now, but it should give you something to start with.
Earlier quoted context omitted.
I wouldn’t assume those $10/mo gaming services are profitable. It’s not that running in the cloud is more expensive. It’s that people already have a $2000 laptop or maybe even $1600 RTX 4090. If I’ve got that I don’t want to pay $20/month to 6 different AI services. Sam Altman said ChatGPT costs like 2 cents per message. I’m sure they can get that way down. Their bills are astronomical. But the data they’re collectin…
If I try to pencil it out, $10/mo seems maybe doable at 10% utilization and downright lucrative at 1%.
This kills your margin.
Earlier quoted context omitted.
Yeah lots of services are lucrative when people buy it but hardly use it!
Some random stats for successful web services (unit is average minutes of use per day per user): YouTube - 19 minutes Spotify - 140 minutes TikTok - 95 minutes Netflix - 71 minutes So we’re looking at roughly a 1% - 10% utilization range, depending on where your game streaming or AI inference app falls. You need to factor that in when figuring out the pricing, your competition certainly will.
GPU utilization is less scalable. No GPU cloud service is particularly popular. I don’t think any of them are profitable. Having 1:1 GPUs to users use tough.
Gaming is especially difficult because it’s super latency sensitive. Which means you need racks or expensive GPUs sitting in hundreds of edge nodes. I’m super bearish on cloud gaming still.
ML tools aren’t that sensitive. They’ll exist and they’ll be profitable. But I think the economics are tough. And as a consumer I’d still greatly prefer to run locally. Which means there’s a tension between “good for the customer” and “good for the business”.
Saw a great toot yesterday. Startups and media business are looking to make a windfall on AI generated art, music, code, writing, and other services. The payment models will be subscriptions, pay per use, and other models that make more money the more content is produced. But there's still no AI (with associated mechanics) that can fold laundry. (I think the latter would be really useful.)
Saw a great toot yesterday. Startups and media business are looking to make a windfall on AI generated art, music, code, writing, and other services. The payment models will be subscriptions, pay per use, and other models that make more money the more content is produced. But there's still no AI (with associated mechanics) that can fold laundry. (I think the latter would be really useful.)
Please, lets not waste electricity & emit more CO2 for the sake of unnecessary eye-candy..
Saw a great toot yesterday. Startups and media business are looking to make a windfall on AI generated art, music, code, writing, and other services. The payment models will be subscriptions, pay per use, and other models that make more money the more content is produced. But there's still no AI (with associated mechanics) that can fold laundry. (I think the latter would be really useful.)
I just want some AI that can cut my hair, exactly the way I want it.
Earlier quoted context omitted.
Kind of. They all run Stable Diffusion because they released fully open source. There’s still competitive advantage to owning, training, and gatekeeping access to models. MidJourney and DallE are both superior to Stable Diffusion along many axes. Monetizing models is tricky because it’s so cheap to run locally but so expensive in the cloud. Except if you release your model such that it can run locally all advantage i…
>> Monetizing models is tricky because it’s so cheap to run locally but so expensive in the cloud. Can you expand on this a bit? The way i'm thinking, that is only the case if you need low-latency. And in that case, it seems you just need to charge to cover compute. We're running Stable Diffusion on an eks cluster and it evens out the load across calls and prevents over-resourcing. If latency isnt an issue, it can be…