Ok so Samsung, SK Hynix and Micron do not have the capacity to meet demand. Also, what little capacity they do have they are allocating to HBM over DRAM. Based on my limited knowledge HBM can not be easily repurposed for consumer electronics. Translation: main street is cooked for the next 3-4 years. It doesn't stop there though. OpenAI is currently mired in a capital crunch. Their last round just about sucked all th…
What kind of consumer electronics can you build with HBM? That's the startup you should be founding...
They can just switch back to normal DRAM if HBM demand drops, you ain't getting it cheap just coz AI flops
And HTML/CSS/JS are far more powerful for designing than any of SwiftUI/IB on Apple, Jetpack/XML on Android, or WPF/WinUI on Windows, leaving aside that this is what designers, design platforms and AI models already work best with. Even if all the major OSes converged on one solution, it still wouldn't compete on ergonomics or declarative power for designing.
Lol SwiftUI/Jetpack/WPF aren’t design tools, they’re for writing native UI code. They’re simply not the right tool for building mockups. I don’t see how design workflows matter in the conversation about cross-platform vs native and RAM efficiency since designers can always write their mockups in HTML/CSS/JS in isolation whenever they like and with any tool of their choice. You could even use purely GUI-based approach…
Who said anything about mockups? Design goes all the way from concept to real-world. If a designer can specify declaratively how that will look, feel, and animate, that's far better than a developer taking a mockup and trying their hardest to approximate some storyboards. Even as a developer working against mockups, I can move much faster with HTML/CSS than I can with native, and I'm well experienced at both (yes, that includes every tech I mentioned). With native, I either have to compromise on the vision, or I have to spend a long time fighting the system to make it happen (...and even then)
Last year, China's coal use decreased, while China installed 300x more renewables than nuclear. Coal and nuclear aren't cost competitive with renewables, either in a free market or a technocratic top-down economy. Coal and gas still maintain a valid niche of firming intermittency. But that niche is temporary and shrinking.
> either in a free market o Then why all the anti-coal mining diktats coming down from Brussels?
The free market installs a tiny amount of coal, and a lot of renewable energy. Whether you believe this means "coal is/isn't cost competitive with renewables in a free market" is a debate about word definitions that I'm not terribly interested in.
China, like Brussels, is trying to reduce coal for similar reasons. They don't like the air pollution health hazard (fully believable), and they say they don't like global warming (somewhat believable).
I'm a bit surprised the article makes no mention of Google's TurboQuant[0] introduced 26 days prior. Given that TurboQuant results in a 6x reduction in memory usage for KV caches and up to 8x boost in speed, this optimization is already showing up in llama.cpp, enabling significantly bigger contexts without having to run a smaller model to fit it all in memory. Some people thought it might significantly improve the R…
Your skepticism is well placed. Every time a new quantization or compression technique drops, the immediate response is to just scale up context length or run a bigger model to fill whatever headroom was freed up. It's Jevons paradox applied to VRAM - efficiency gains get eaten by increased usage almost immediately.
To add a more local hurdle as well, the Dutch power grid is at capacity and its managing company is now telling companies that planned to build a datacenter that they can't be connected to the grid until 2030, even though said companies already paid for and got guarantees about that connection. That is, memory capacity is reserved for datacenters yet to be built, but this will do weird things if said datacenter const…
This just highlights what an utter failure and self-inflicted wound the green policies of Euro countries have been. Europe has already lost the AI race to the U.S. and China.
There appears to be zero advantage to having the datacenter actually in your country apart from minor local property tax, in exchange for which it will put up the electricity bills of every single citizen, who already hate how much they're paying.
love that theres virtually infinite capital there. meanwhile in the rest of the world there is virtually no food.
The "no food in other countries" is because of failed/corrupt governments, not because people use AI to generate cat pictures in the West. The economy is not a "fixed pie" that needs to be allocated among people of the world. Just look at Cuba, which could be a very rich country and one of the prime tourist destinations of the world.
Both of those problems exist largely or primarily due to the US, destabilizing countries with bombs and coups, and the cuban blockade.
Im thankfull for buying 16gb of RAM, but what is gonna happen in 5 years when users PCs start to fail?
There is enough older hardware floating around to last us for decades. You don't need a gaming rig to do 99% of your computing (excluding gaming obviously). Also computers don't really just break. It's mostly the disks that wear out and PSUs that age.
This could be great. There's a future where RAM makers tool up for this massively increased demand, then the AI companies go broke as the bubble bursts, so RAM is cheap as. So laptop manufacturers get on that and start making laptops with 1TB+ memory so we can run decent LLMs on the local machine. Everyone happy :)
RAM makers are not increasing their capacity. If AI bubble bursts we might see a momentary drop in RAM prices but it won't be dramatic. Return to "normal" is the best scenario I can imagine but my gut tells me we're probably never going back to early 2025 memory prices.
Ok so Samsung, SK Hynix and Micron do not have the capacity to meet demand. Also, what little capacity they do have they are allocating to HBM over DRAM. Based on my limited knowledge HBM can not be easily repurposed for consumer electronics. Translation: main street is cooked for the next 3-4 years. It doesn't stop there though. OpenAI is currently mired in a capital crunch. Their last round just about sucked all th…
To add a more local hurdle as well, the Dutch power grid is at capacity and its managing company is now telling companies that planned to build a datacenter that they can't be connected to the grid until 2030, even though said companies already paid for and got guarantees about that connection. That is, memory capacity is reserved for datacenters yet to be built, but this will do weird things if said datacenter const…
It says that in 2025, Netherlands was a net exporter of electricity (~14,000 GWh). My guess: Where they want to build data centers, the grid cannot handle it, but the overall system has more than enough power to build data centers. Do you think that sounds like a resonable guess?