Outside say video and image editing and maybe lossless audio. Why is this much ram even needed in most use cases? And I mean actually thinking about using it. Computer code unless you are actually doing whole Linux kernel, is just text. So lot of projects probably would fit in cache. Maybe software companies should be billed for user's resources too...
As AI gobbles up chips, prices for devices may rise
261–270 of 536 posts
Re: As AI gobbles up chips, prices for devices may rise
#262So writing optimized software was niche and overshadowed by the huge gains of hardware. People and corporations didn't care. They preferred fast feature delivery. Even when optimizing techniques like multi-tenant servers, we ended up having heavy containers wasting RAM and resources. And most apps switched to web frameworks like Electron where each one has its own huge web browser. Most people didn't care.
I hope this shortage has a silver lining of untangling the mess and refactoring the sea of bloat. But I know it's more likely some trick will be found to just patch it up a bit and only reduce the pain up to the new equilibrium level. For example something idiotic like Electron sharing resources across multiple apps and taking huge security risks. Corporations love to play false dichotomies to save pennies.
Re: As AI gobbles up chips, prices for devices may rise
#263Earlier quoted context omitted.
Old devices work just fine. I've upgraded my old iPhone XS last year to the latest and greatest 16 to see what changed (not much), the old one was still fast (in fact faster than a most upper-midrange Androids, its insane how much of a lead Apple has) and the battery was good. I considered selling it, but quickly had to realize it was worth almost nothing. Also, when treated right, computers almost never break. There…
Well the industries the most impacted by it are homelabbing/datacenters imo. Like in current circumstances, its hard to get a homelab/datacenter so its better to postpone these plans for sometime I agree with your statement overall but I feel like till the years that these ram shortages occur, there is a freeze of all companies providing vps's etc. ie. no new player can enter so I am a bit worried about those raising…
Re: As AI gobbles up chips, prices for devices may rise
#264For last 2 years, I've noticed a worrying trend: the typical budget PCs (especially Laptops) are being sold at higher prices with lower RAM (just 8GB) and lower-end CPUs (and no dedicated GPUs). Industry mandate should have become 16GB RAM for PCs and 8GB for mobile, since years ago, but instead it is as if computing/IT industry is regressing. New budget mobiles are being launched with lower-end specs as well (e.g.,…
Re: As AI gobbles up chips, prices for devices may rise
#265I really wonder when the point will be reached at which the South Korean government steps in and starts to take a closer look at the growing long-term supply commitments that companies like OpenAI are indirectly driving with major memory manufacturers such as SK hynix and Samsung Electronics. Allocating a very large share of advanced memory production, especially HBM and high-end DRAM, which are critical for almost a…
It's not like it's their fault that micron pulled out of the market...
Edit: maybe someone should consider sweet-talking kioxia into making dram chips?
Re: As AI gobbles up chips, prices for devices may rise
#266It's somewhat alarming to see that companies (owned by a very small slice of society) producing these AI thingies (whose current economic is questionable value and actual future potential is up to hot debate), can easily price the rest of humanity out of computing goods.
Supply should increase as a response to higher prices, this bringing prices down.
Take a look at GPU prices and how that "supply increased thus bringing the prices down"
Re: As AI gobbles up chips, prices for devices may rise
#267Earlier quoted context omitted.
A $100k EV has roughly the same amount of DRAM as a $1k phone. The EV is a therefore, on a whole, a lot less sensitive to DRAM price increases.
That is factually wrong. That might be the case only for the infotainment system, but there’s usually many other ECUs in an EV. The ADAS ECUs are carrying similar amounts as an iPhone or the infotainment system. Telematics is also usually also a relatively complex one, but more towards lower sized amounts. Then you have around 3-5 other midsized ECUs with relatively high memory sizes, or at least enough to require MM…
Re: As AI gobbles up chips, prices for devices may rise
#268Earlier quoted context omitted.
I think living up to the hype needs to be defined. A lot of AI 'influencers' love wild speculation, but lets ignore the most fantastical claims of techno-singularity, and let's focus on what I would consider a very optimistic scenario for AI companies - that AI capable of replacing knowledge workers can be developed using the current batch of hardware, in the span of a year or two. Even in this scenario, the capital…
> a very optimistic scenario for AI companies - that AI capable of replacing knowledge workers can be developed using the current batch of hardware, in the span of a year or two. I'm really interested in what will happen to the economy/society in this case. Knowledge workers are the market for much that money is being made on. Facebook and Google make most of their money from ads. Those ads are shown to billions of p…
Most white collar work is just a kind of game people play, it’s in to way needed, but people still enjoy playing it. Having AI writing reports nobody reads instead of people doing it isn’t going to change anything.
Re: As AI gobbles up chips, prices for devices may rise
#269Earlier quoted context omitted.
I think living up to the hype needs to be defined. A lot of AI 'influencers' love wild speculation, but lets ignore the most fantastical claims of techno-singularity, and let's focus on what I would consider a very optimistic scenario for AI companies - that AI capable of replacing knowledge workers can be developed using the current batch of hardware, in the span of a year or two. Even in this scenario, the capital…
> a very optimistic scenario for AI companies - that AI capable of replacing knowledge workers can be developed using the current batch of hardware, in the span of a year or two. I'm really interested in what will happen to the economy/society in this case. Knowledge workers are the market for much that money is being made on. Facebook and Google make most of their money from ads. Those ads are shown to billions of p…
Don’t forget Sam Altman publicly said they have no idea how to make money, and their brilliant plan is to develop AGI (which they don’t know how and aren’t close to) then ask it how to generate revenue.
https://www.startupbell.net/post/sam-altman-told-investors-b...
Maybe this imaginary AGI will finally exist when all of society is on the brink of collapse, then Sam will ask it how to make money and it’ll answer “to generate revenue, you should’ve started by not being an outspoken scammer who drove company-wide mass hysteria to consume society. Now it’s too late. But would you like to know how may ‘r’ are in ‘strawberry’?”.
Re: As AI gobbles up chips, prices for devices may rise
#270It's somewhat alarming to see that companies (owned by a very small slice of society) producing these AI thingies (whose current economic is questionable value and actual future potential is up to hot debate), can easily price the rest of humanity out of computing goods.