Earlier quoted context omitted.
q4 or q5 quantization. Edit: Actually you'd want q3 to fit a 200B model into 128GB of RAM. e.g. this one is about 140GB https://huggingface.co/lmstudio-community/DeepSeek-V2.5-GGUF...
Wouldn't it be incredibly misleading to say you can interact with an LLM, when they really mean that you can lossy-compress it to like 25% size where it becomes way less useful and then interact with that? (Isn't that kind of like saying you can do real-time 4k encoding when you actually mean it can do real-time 720p encoding and then interpolate the missing pixels?)
M4 MacBook Pro
961–970 of 1001 posts
Re: M4 MacBook Pro
#962> "up to 1.8x faster when compared to the 16-inch MacBook Pro with M1 Pro" I insist my 2020 Macbook M1 was the best purchase I ever made
Re: M4 MacBook Pro
#963Earlier quoted context omitted.
So you're saying Apple added something to the design to make it do things faster...which is literally the definition of improvement. When a company adds a supercharger to a car does it not count as faster? When I add more solar panels to my roof does it not count as more power? Surely doing this kind of thing is exactly what we want companies to be doing to make their products faster/better.
It will be faster only for code that uses/is optimized for that specific extension. And the examples you give are not really correct. If you add a supercharger you will get more power, but if the car's transmission is not upgraded, you might just get some broken gears and shafts. If you add more solar panels to your roof, you might exceed the inverter power, and the panels will not bring benefits. It's true that you…
Re: M4 MacBook Pro
#964It's hard to imagine ay reason why I would not want to keep upgrading to a new MPB every few years -- my M3 MBP is by far the best laptop I've owned thanks to the incredible battery life. Of course I'm rooting for competition, but Apple seems to be establishing a bigger and bigger lead with each iteration.
I don’t see the yearly releases as saying you have to upgrade. Rather, having a consistent cadence makes it easier for the supply chain, and the short iteration time means there’s less pressure to rush something in half-baked or delay a release.
Re: M4 MacBook Pro
#965It's hard to imagine ay reason why I would not want to keep upgrading to a new MPB every few years -- my M3 MBP is by far the best laptop I've owned thanks to the incredible battery life. Of course I'm rooting for competition, but Apple seems to be establishing a bigger and bigger lead with each iteration.
My M1 laptop from early 2022 is too good for me to care about upgrading right now, I loaded it up with 64GB ram and it's still blazing. What benefit would I really notice? My heavy apps loading a couple of seconds faster?
Re: M4 MacBook Pro
#966> "up to 1.8x faster when compared to the 16-inch MacBook Pro with M1 Pro" I insist my 2020 Macbook M1 was the best purchase I ever made
I switched from a 2014 MacBook pro to a 2020 M1 MacBook Air, yeah the CPU is much faster, but the build quality and software is a huge step backwards. The trackpad is feels fake, not nearly as responsive, keyboard also feel not as solid. But now I'm already used to it.
I don't understand how people are enamored with those things, sure it's better in some way than what it was before but it's also very compromised for the price.
Re: M4 MacBook Pro
#967Four generations into the new platform and there is no answer from anyone else in the industry. Incredible.
I switched my work M1 Max with an AMD Ryzen 9 7940HS Framework 16 running Linux and am happier since. I guess it depends on the person which computer is better for them.
Re: M4 MacBook Pro
#968Four generations into the new platform and there is no answer from anyone else in the industry. Incredible.
I switched my work M1 Max with an AMD Ryzen 9 7940HS Framework 16 running Linux and am happier since. I guess it depends on the person which computer is better for them.
Re: M4 MacBook Pro
#969Earlier quoted context omitted.
The Mac mini video from yesterday has employees: https://www.apple.com/105/media/us/mac-mini/2024/58e5921e-f4...
That by itself raises an interesting editorial question. Apple (like most big companies) doesn't do things randomly re: high impact public communications like this. I'm curious what made the Mac mini a product that merited showing people doing things, with a computer that is tied to one location, vs. a Macbook Pro's comparative emptiness, for a computer that can go anywhere and be with anyone. It could be as simple a…
Re: M4 MacBook Pro
#970Earlier quoted context omitted.
These numbers are misleading (as in not apples to apples comparison). M4 has a matrix multiply hardware extension which can accelerate code written (or compiled) specifically for this extension. Also: https://news.ycombinator.com/item?id=40339248
So you're saying Apple added something to the design to make it do things faster...which is literally the definition of improvement. When a company adds a supercharger to a car does it not count as faster? When I add more solar panels to my roof does it not count as more power? Surely doing this kind of thing is exactly what we want companies to be doing to make their products faster/better.
I think the whole point is that microbenchmarks provide no data in overall performance. They just test very specific and by no means common use case.