41–50 of 156 posts
Thinking the next logical step - chatgpt at edge - could be even more useful. Though I guess that still has the underlying limitation of compute shortage so could take a while
There's a huge difference between diffusion models that were built to be run on commodity hardware and the huge autoregressive models like GPT. You can't even run GPT3 on the cloud without some specialized interconnect.
Saw a great toot yesterday. Startups and media business are looking to make a windfall on AI generated art, music, code, writing, and other services. The payment models will be subscriptions, pay per use, and other models that make more money the more content is produced. But there's still no AI (with associated mechanics) that can fold laundry. (I think the latter would be really useful.)
Earlier quoted context omitted.
Kind of. They all run Stable Diffusion because they released fully open source. There’s still competitive advantage to owning, training, and gatekeeping access to models. MidJourney and DallE are both superior to Stable Diffusion along many axes. Monetizing models is tricky because it’s so cheap to run locally but so expensive in the cloud. Except if you release your model such that it can run locally all advantage i…
>> Monetizing models is tricky because it’s so cheap to run locally but so expensive in the cloud. Can you expand on this a bit? The way i'm thinking, that is only the case if you need low-latency. And in that case, it seems you just need to charge to cover compute. We're running Stable Diffusion on an eks cluster and it evens out the load across calls and prevents over-resourcing. If latency isnt an issue, it can be…
Yeah. These models don’t need special resources to run. As a consumer I would prefer to buy a 4090 and then run everything locally. I don’t want to pay $10 or $20 monthly subs to a half dozen different AI services. All professional software turning into subscription services sucks.
Midjourney charges $30/mo for unlimited “relax” time and 15 hours of fast GPU time. That’s not too bad. But multiply that by 6 services and a 4090 pays for itself in a few months.
Feels a bit gimmicky to me, but maybe I’m missing some need in the market. I wonder about auto-generated captchas perhaps? or are these going to be easy to reverse? On a side note: I’d love to switch from Cloudflare to bunny, but it’s missing a WAF. We were promised it from bunny for a long while, but didn’t see it yet. Personally I would imagine it being a more core feature for a CDN than AI bunnies on the edge, but…
Earlier quoted context omitted.
That's gonna be great until someone hacks it and has it stab me to death in my sleep.
Much like my fears about bluetooth connected cars being hacked to crash on the highway, it turns out that - by and large - nobody wants to kill me (or at least, not badly enough to do anything about it).
Earlier quoted context omitted.
That's gonna be great until someone hacks it and has it stab me to death in my sleep.
Much like my fears about bluetooth connected cars being hacked to crash on the highway, it turns out that - by and large - nobody wants to kill me (or at least, not badly enough to do anything about it).
In a more Orwellian world. It can be used to assassinate dissidents or individuals who speak out against authoritarian regimes. It's just a tool in a box, but it's one that's simple, easy to use, and leaves no evidence.
Earlier quoted context omitted.
That's gonna be great until someone hacks it and has it stab me to death in my sleep.
Much like my fears about bluetooth connected cars being hacked to crash on the highway, it turns out that - by and large - nobody wants to kill me (or at least, not badly enough to do anything about it).
Earlier quoted context omitted.
That's gonna be great until someone hacks it and has it stab me to death in my sleep.
Much like my fears about bluetooth connected cars being hacked to crash on the highway, it turns out that - by and large - nobody wants to kill me (or at least, not badly enough to do anything about it).
Saw a great toot yesterday. Startups and media business are looking to make a windfall on AI generated art, music, code, writing, and other services. The payment models will be subscriptions, pay per use, and other models that make more money the more content is produced. But there's still no AI (with associated mechanics) that can fold laundry. (I think the latter would be really useful.)
I just want some AI that can cut my hair, exactly the way I want it.
Much more useful than driving a car, because in a car you're mostly idling anyway so you might as well drive.
Earlier quoted context omitted.
Why is it expensive to run in the cloud and cheap to run on a device? 1. Commodity hardware can do the inference on a single instance (must be true if a user device can do it). 2. It’s apparently possible to run a video game streaming service for $10/month/user. 3. So users should be able to generate unlimited images (one at a time) for $10/month? Maybe the answer is the DallE/Midjourney models running in the cloud a…
I wouldn’t assume those $10/mo gaming services are profitable. It’s not that running in the cloud is more expensive. It’s that people already have a $2000 laptop or maybe even $1600 RTX 4090. If I’ve got that I don’t want to pay $20/month to 6 different AI services. Sam Altman said ChatGPT costs like 2 cents per message. I’m sure they can get that way down. Their bills are astronomical. But the data they’re collectin…