701–710 of 1001 posts
Earlier quoted context omitted.
Thunderbolt 5 can do bi-directional 80 Gbps....and Mac Studio Ultra has 6 ports...
That's still not even competitive with 100G Ethernet on a per-port basis. An overall bandwidth of 480 Gbps pales in comparison with, for example, the 3200 Gbps you get with a P5 instance on EC2.
Earlier quoted context omitted.
At my last N jobs, companies built high end server farms and carefully specced all the hardware. Then they looked at SSD specs and said “these are all fine”. Fast forward 2 years: The $50-$250K machines have a 100% drive failure rate, and some poor bastard has to fly from data center to data center to swap the $60 drive for a $120 one, then re-rack and re-image each machine. Anyway, soldering a decent SSD to the moth…
What does soldering it to the board have to do with reliability? If they were soldered onto those systems you talk about, all those would have had to be replaced instead of just having the drive swapped out and re-imaged.
$14K with 512gb memory and 16 Tb storage
I cannot believe I’m saying that, but: for apple that’s rather cheap. Threadripper boxes with that amount of memory do not come a lot cheaper. Considering what apples pricing when it comes to memory in other devices, 4K for the 96GB to 512GB upgrade is a bargain.
If you configure a Threadripper workstation at Puget Systems, memory price seems to be ~$6/GB. Except if you use 128 GB modules, which are almost $10/GB. You can get 768 GB for a Threadripper Pro cheaper than 512 GB for a Threadripper, but the base cost of a Pro system is much higher.
Earlier quoted context omitted.
> Transformers are typically memory-bandwidth bound during decoding. Not in case of language models, which are typically bound by memory size rather than bandwidth.
nope
Earlier quoted context omitted.
I don't need 512GB of RAM but the moment I do I'm certain I'll have bigger things to worry about than a $10K price tag.
This is Pascal's wager written in terms of ... RAM. The original didn't make sense and neither does this iteration.
Earlier quoted context omitted.
These have been possible in much smaller smartphone chips for years.
Possible != energy efficient, which is important for mobile devices.
Earlier quoted context omitted.
In 1998-1999 I had a DEC Alpha on my desktop that was really impressive, it was a 64-bit machine a few years before you could get a 64-bit Athlon.
The Alpha architecture was 64-bit from the very beginning (though the amount of addressable virtual memory and physical memory depends on the processor implementation). I think it goes something like: - 2106x/EV4: 34-bit physical, 43-bit virtual - 21164/EV5: 40-bit physical, 43-bit virtual - 21264/EV6: 44-bit physical, 48-bit virtual The EV6 is a bit quirky as it is 43-bit by default, but can use 48-bits when I_CTL o…
Digital struggled with the microprocessor transition because they didn't want to kill their cash cow minicomputers with microcomputer-based replacements. They went with the 64-bit Alpha because they wanted to rule the high end in the CMOS age. And they did, for a little while. But the mass market caught up.
When would Apple silicons made natively support for OSes such as Linux? Apple seemlingly reluctant to release detailed technical reference manual for M-series SoCs, which makes running Linux natively on Apple silicon challenging.
Is it not an option to run Darwin? What would Linux offer that that would not?
Earlier quoted context omitted.
Uh.... I must be missing something here, because you're hyping up Apple's NPU only to show it getting absolutely obliterated by the equally old 3090? Your 10900K having 64gb of RAM is also irrelevant here...
You're missing the the bigger picture by getting bogged down in technical details. To an end user, the difference between thirty seconds and ninety seconds is often irrelevant for things like AI, where they expect a delay while it "thinks". When taken in that context, you're now comparing a 14" laptop running off its battery, to a desktop rig gulping down ~500W according to my UPS, for a mere 66% reduction in runtime…
Also Apple isn't unique in having an NPU in a laptop. Fucking everyone does at this point.