Live data from Hacker News

Ask HN: Will programmers write more efficient code during the memory shortage?

news.ycombinator.com

21–30 of 264 posts

Re: Ask HN: Will programmers write more efficient code during the memory shortage?

#21
The memory shortage is really for these insane memory requirements for LLMs.

A web browser and the basic mobile app will be fine.

The iPhone 17 Pro has the most RAM and it's only 12GB. Hell the iPhone 16 Pro only had 8 GB. The vast majority of consumer cases don't need it. I doubt Apple and other manufacturers will go beyond that to keep prices down.

Re: Ask HN: Will programmers write more efficient code during the memory shortage?

#22
Some programmers will write more efficient code. At my $dayjob (one of the big tech companies) we're already planning a major goal next year of optimizing server code to reduce RAM requirements, and this is directly in response to the crunch.

In practice I expect most optimizations will come from "stop doing stupid stuff" and not "use fancy advanced algorithms." But that's a cynical perspective so don't be cynical like me.

Re: Ask HN: Will programmers write more efficient code during the memory shortage?

#25
post #14

For this incentive to exist, the app needs to be such an obvious memory hog that users start identifying it as the source of the problem. Even then, a lot is required for most businesses to prioritize this (presumably) temporary issue at the cost of things like: participation in the AI race, other features, bug fixes, new markets etc. Heck, sometimes software is so inefficient that it costs developer and tester produ…

Your response suggests that you're only considering native apps where users can view memory usage.

For cloud apps where the costs are largely hidden from users, the user has no way of doing that analysis. I agree with the second part of what you said, though: I expect businesses to just raise their prices in those cases rather than systematically focus on actual difficult engineering problems.

Re: Ask HN: Will programmers write more efficient code during the memory shortage?

#26
Of course not. Why would they? The software nowadays is mostly written for people who already own computers with RAM already installed. Yeah, they probably won't upgrade for the next couple of years, so what?

Besides, have you heard about "virtual memory" and "swapping"? Nowadays, SSDs (and especially NVMe) are quite fast, so thrashing is much less of an issue.

Re: Ask HN: Will programmers write more efficient code during the memory shortage?

#27
If that happens, we will see it in triple-A games first. If some new titles have significant lower hardware specs than expected.

If buyers can't afford the hardware anymore, the studios need to adjust. It's definitively possible to scale games down a lot. There are a few AAA games that were "dumbed down" for the Switch 1 (Hogwarts, cyberpunk, ...). And that's a really low-spec device.

There are two factors: existing gamers not able to afford upgrading. But also new gamers, that might only be able to afford much lower spec PCs than people who bought 2 years earlier.

Why games? Because there is a clear point where people stop buying games. Minimum hw specs are known before buying.

Re: Ask HN: Will programmers write more efficient code during the memory shortage?

#28
post #27

If that happens, we will see it in triple-A games first. If some new titles have significant lower hardware specs than expected. If buyers can't afford the hardware anymore, the studios need to adjust. It's definitively possible to scale games down a lot. There are a few AAA games that were "dumbed down" for the Switch 1 (Hogwarts, cyberpunk, ...). And that's a really low-spec device. There are two factors: existing…

If you listen to gaming Youtube then the gaming industry is already in trouble from hardware costs and availability. I'm not sure if they are making a mountain out of a mole hill or not though.

Re: Ask HN: Will programmers write more efficient code during the memory shortage?

#29
post #5

I don't think at this point in history limitations drive the the way we do things, abundance does.

I don't see the underlying economic dynamics of the relevance of substitution costs driving the way we do things going away. And substitution costs are all about limitations.

Abundance and limitations are a bit of ying/yang phenomena in terms of driving things, you don't have one without the other.

Igor Stravinsky: "Constraint drives creativity"

(I also don't see Amdahl's Law --which is fundamentally about limitations -- going away any time soon.)

I do agree that there are compounding abundancies present.

Re: Ask HN: Will programmers write more efficient code during the memory shortage?

#30
Until prices hit the large hyperscalers, I don't think most people are going to make significant changes. You might see a small set of open source projects related to self hosting put in an effort, but in general, I don't think so.

Some big-tech orgs (that have their own hardware) will take costs into account, but they already do that. The "optimization" is more likely to be business-optimizations; "this can be slower if it uses less memory", rather than inventing new stuff.

Note that I am excluding any of the big AI labs. They are definitely going to be working to figure out how to use less memory, but that's primarily not related to the direct cost.

Post reply on HN