101–110 of 327 posts
Earlier quoted context omitted.
What makes you think the supply crunch is short-term?
If the increased demand is not short term, production capacity will eventually increase. In the meantime, the logistics disruptions and industrial material shortages and energy inflation will disappear as soon as the wars disrupting them stop, which should bring prices down.
what if demand keeps rising faster than production capacity is deployed?
If I had the capital I’d make an household inference appliance. No peripherals except Ethernet, integrated compute (cpu+gpu+mem) and secondary storage (+mobo, psu). No accoutrements, just the minimum amount of hardware to run a model as a utility. Even the appliance faceplate would be a display showing stats like an old HiFi stereo. Edit: something like a series of modules consisting of a RISC-V CPU + Vortex GPGPU +…
95% of the price is going to be in GPU+CPU+RAM
I don’t understand why they are not reintroducing the Apple Xserve?
Because they killed the market, no one would now buy a macOS server, when Linux distributions, and to a lesser extent FreeBSD, own the server room. They would even sell less than Windows Server licenses. By the way, they are down the same path with the workstation market, now that they only top level answer is the Mac Studio. Workstation market wants flexible towers that they can customise to their own liking and spe…
but Apple needs to change the licensing model, currently you are allowed to run only 2 macOS VMs for every physical one you buy
Earlier quoted context omitted.
Apples on stage use cases for their hardware and software makes me wonder if they actually use computers over there, or what a "job" at apple entails. I am unsure that apple themselves understand why their hardware (top end & bottom end) has been so successful, without this understanding leaning into these use cases isn't really going to be possible.
> I am unsure that apple themselves understand why their hardware ... has been so successful [like I do] You have a bold career as a technical journalist ahead of you!
With their apple finger right there on the pulse, they are going hard on the VR/AR glasses (following the lead of the visionary CEO of facebook), cars and folding phones. By the end of the year (tm) we 100% will have all the features that were showcased and demonstrated 2 releases ago.
Earlier quoted context omitted.
What makes you think the supply crunch is short-term?
If the increased demand is not short term, production capacity will eventually increase. In the meantime, the logistics disruptions and industrial material shortages and energy inflation will disappear as soon as the wars disrupting them stop, which should bring prices down.
We are in a bubble which will be burst the moment the world starts retaliating against the US' 20+ year history of supporting genocide and committing war crimes unabated.
Buy the AI toys while you still can.
I don’t understand why they are not reintroducing the Apple Xserve?
whos going to buy one? You cant trust them not to kill it within a few years and cease all software updates AND make it impossible to install a different OS to keep it going. Until they stop being dicks about what you can do with the hardware you own it's a non starter.
Earlier quoted context omitted.
Fairly sure most iGPUs these days are zero-copy and can dynamically allocate memory so what does "unified memory" mean to you exactly? A wider bus would be nice but it's not exactly a groundbreaking new invention.
I was actually pretty far off: > Unified memory in Linux creates a single address space accessible to both the CPU and GPU, eliminating the need to manually copy data between system RAM and video memory. It is enabled via NVIDIA's CUDA, AMD's ROCm/HIP, or generic kernel-level Heterogeneous Memory Management (HMM). So it does exist and is available for platforms that matter.
Intel and AMD had been doing this for years already, and had linux support for it from day 1.
Apple could probably sell a machine starting at $10,000 if they architected it as the sole place one’s Private Cloud Compute [1] ran. It would need a path to a $2,500 machine, I think. But this is a niche I don’t think another consumer-facing brand could do like Apple. [1] https://security.apple.com/blog/private-cloud-compute/
If I had the capital I’d make an household inference appliance. No peripherals except Ethernet, integrated compute (cpu+gpu+mem) and secondary storage (+mobo, psu). No accoutrements, just the minimum amount of hardware to run a model as a utility. Even the appliance faceplate would be a display showing stats like an old HiFi stereo. Edit: something like a series of modules consisting of a RISC-V CPU + Vortex GPGPU +…
Unfortunately their chatbot, while amazingly fast, doesn't know anything about the company running it.
Anyway I wouldn't mind an ASIC running a diffusion language model locally. Even if eventually it would become dated. Beats outsourcing all that to a company that's running on VC money which in the future might either perish or worse - dominate the market and charge whatever they wish.
Earlier quoted context omitted.
Yeah but like running linux hopefully
so you have invent unified memory for linux first because that’s the limitation today
All have unified memory. Linux runs just fine on all of those.