Earlier quoted context omitted.
It seems like as hardware gets cheaper, software gets more bloated to compensate. Or maybe it’s vice versa. I wonder if there’s a computer science law about this. This could be my chance!
Is your name Wirth?
Hold on to Your Hardware
291–300 of 559 posts
Re: Hold on to Your Hardware
#292Earlier quoted context omitted.
We won't be in a supply crunch forever. We'll have a demand crunch. The demand of powerful consumer hardware will shrink so much that producing them will lose the economics of scale. It 've always been bound to happen, just delayed by the trend of pursuing realistic graphics for games. People who are willing to drop $20k on a computer might not be affected much tho.
My bet is that phone hardware will be used more and more in mini PCs and laptops keeping the cost down and volume up. We see it with Apple and many Chinese mini PC makers I looked at.
Re: Hold on to Your Hardware
#293Earlier quoted context omitted.
I rarely doge a chance to shit on Microslop and its horrible products, but you don't use a browser? In fact, running all that junk in a single chromium instance is quite a memory saver compared to individual electron applications.
fun fact, you can kill all firefox background processes and basically hand-crash every tab and just reload the page in the morning. I do this every evening before bed. `pkill -f contentproc` and my cpu goes from wheezing to idle, as well as releasing ~8gb of memory on busy days. ("Why don't you just close firefox?" No thanks, I've lost tab state too many times on restart to ever trust its sessionstore. In-memory is m…
You have to close Firefox every now and then for updates though. The issue you describe seems better dealt with on filesystem level with a CoW filesystem such as ZFS. That way, versioning and snapshots are a breeze, and your whole homedir could benefit.
Re: Hold on to Your Hardware
#294Okay but what about the icon and tab name changing and the pop-up about disabling javascript?!
The favicon changes every time you switch away to something different with various tab names (ranging from porn, to right-wing news, to 4chan and I'm sure more).
All this author has convinced me to do is block their website.
I also don't agree at all with the premise of the article so I don't imagine I'm going to be missing much by not seeing this site again.
Re: Hold on to Your Hardware
#295Earlier quoted context omitted.
We won't be in a supply crunch forever. We'll have a demand crunch. The demand of powerful consumer hardware will shrink so much that producing them will lose the economics of scale. It 've always been bound to happen, just delayed by the trend of pursuing realistic graphics for games. People who are willing to drop $20k on a computer might not be affected much tho.
My bet is that phone hardware will be used more and more in mini PCs and laptops keeping the cost down and volume up. We see it with Apple and many Chinese mini PC makers I looked at.
Re: Hold on to Your Hardware
#296Earlier quoted context omitted.
But commodity hardware that's right-sized for your own private needs is many orders of magnitude cheaper than datacenter hardware that's intended to serve millions of users simultaneously while consuming gigawatts in power. You're mostly paying for that hardware when you buy LLM tokens, not just for power efficiency. And your own hardware stays available for non-AI related needs, while paying for these tokens would r…
I doubt it because you aren't going to get the utilisation that a commercial setup would. No point wasting tons of money on hardware that is sat idle most of the time.
Re: Hold on to Your Hardware
#297Earlier quoted context omitted.
We are on borrowed time, most of the world is running on oil and this resource is not unlimited at all. A lot of countries have gone past their production peak, meaning it's only downhill from here. Everything is gonna be more costly, more expensive, our lavish "democracies" lifestyles are only possible because we have (had) this amazing freely available resource, but without it it's gonna change. Even at a geopoliti…
Doubt it. Renewables are expanding much faster than oil output is decreasing. Wind and solar will enable energy to remain cheap everywhere that builds it.
Also C: nations that are both A and B, needlessly causing oil volatility with unplanned military dickheadedness.
Re: Hold on to Your Hardware
#298Earlier quoted context omitted.
I rarely doge a chance to shit on Microslop and its horrible products, but you don't use a browser? In fact, running all that junk in a single chromium instance is quite a memory saver compared to individual electron applications.
I use a browser at home, but I don't use the heaviest web sites. There are several options for my hourly weather update, some are worse than others (sadly I haven't found any that are light weight - I just need to know if it would be a thunderstorm when I ride my bike home from work thus meaning I shouldn't ride in now)
Re: Hold on to Your Hardware
#299Earlier quoted context omitted.
It seems like as hardware gets cheaper, software gets more bloated to compensate. Or maybe it’s vice versa. I wonder if there’s a computer science law about this. This could be my chance!
Sorry to burst your bubble: https://en.wikipedia.org/wiki/Wirth%27s_law Not exactly the same (it's about power rather than price). But close enough that when you said it, I thought, "oh! there is something like that." There's also more fundamental economics laws at play for supply and demand of a resource / efficiencies at scale / etc. Given our ever increasing demand of compute compared increasing supply (cheaper mo…
I guess this might be happening with LLMs already
Re: Hold on to Your Hardware
#300Earlier quoted context omitted.
Local is a dead end. Open source efforts need to give up on local AI and embrace cloud compute. We need to stop building toy models to run on RTX and instead try to compete with the hyperscalers. We need open weights models that are big and run on H200s. Those are the class of models that will be able to compete. When the hyperscalers reach take off, we're done for. If we can stay within ~6months, we might be able to…
> Open source efforts need to give up on local AI and embrace cloud compute. Oh god no, please not more slop, you're already consuming over 1 percent of human energy output, could you, like, chill a bit?
- Our career is reaching the end of the line
- 99.9999% of users will be using the cloud
- if we don't have strong open source models, we're going to be locked into hyperscaler APIs for life
- piddly little home GPUs don't do squat against this
Why are you building for hobby uses?
Build for freedom of the ability to make and scale businesses. To remain competitive. To have options in the future independent of hyperscalers.
We're going to be locked out of the game soon.
Everyone should be panicking about losing the ability to participate.
Play with your RTXes all you like. They might as well be raspberry pis. They're toys.
Our future depends on our ability to run and access large scale, competitive, open weights. Not stuff you run with LM Studio or ComfyUI as a hobby.