See: "3D TVs are driving the biggest change in TVs in decades"
This article is just saying more laptops will have power efficient GPUs in it. A bit better than 3D TVs. They might not use Apple silicon often. Other options are encouraging.
[deleted]
Local AI is driving the biggest change in laptops in decades
71–80 of 273 posts
Re: Local AI is driving the biggest change in laptops in decades
#72Earlier quoted context omitted.
Even collecting and sending all that data to the cloud is going to drain battery life. I'd really rather my devices only do what I ask them to than have AI running the background all the time trying to be helpful or just silently collecting data.
>> I'd really rather my devices only do what I ask them to Linux hears your cry. You have a choice. Make it.
Part of me is starting to think Valve is going to be the best thing to happen to Linux (in this regard) since Ubuntu.
Re: Local AI is driving the biggest change in laptops in decades
#73The problem with this is that NPU have terrible, terrible support in the various software ecosystems because they are unique to their particular soc or whatever. No consistency even within particular companies.
Re: Local AI is driving the biggest change in laptops in decades
#74Earlier quoted context omitted.
Laptop manufacturers are too desperate to cash on the AI craze. There's nothing special about an 'AI PC'. It's just a regular PC with Windows Copilot... which is a standard Windows feature anyway. >I don't want this garbage on my laptop, especially when its running of its battery! The one bit of good news is it's not going to impact your battery life because it doesn't do any on-device processing. It's just calling a…
Doesn't this lead to a lot of tension between the hardware makers and Microsoft? MS wants everyone to run Copilot on their shiny new data centre, so they can collect the data on the way. Laptop manufacturers are making laptops that can run an LLM locally, but there's no point in that unless there's a local LLM to run (and Windows won't have that because Copilot). Are they going to be pre-installing Llama on new lapto…
Copilot is a local LLM (well SLM). https://learn.microsoft.com/en-us/windows/ai/apis/phi-silica
Re: Local AI is driving the biggest change in laptops in decades
#75This mostly just shows you how far behind the M1 (which came out 5 years ago) all the non Apple laptops are.
Re: Local AI is driving the biggest change in laptops in decades
#76"How many TOPS do you need to run state-of-the-art models with hundreds of millions of parameters? No one knows exactly." What's he talking about? It's trivial to calculate that.
It's also been done before...[0]
[0]: https://www.edge-ai-vision.com/2024/05/2024-edge-ai-and-visi...
Re: Local AI is driving the biggest change in laptops in decades
#77Earlier quoted context omitted.
Laptop manufacturers are too desperate to cash on the AI craze. There's nothing special about an 'AI PC'. It's just a regular PC with Windows Copilot... which is a standard Windows feature anyway. >I don't want this garbage on my laptop, especially when its running of its battery! The one bit of good news is it's not going to impact your battery life because it doesn't do any on-device processing. It's just calling a…
> It's just a regular PC with Windows Copilot... which is a standard Windows feature anyway. "AI PC" branded devices get "Copilot+" and additional crap that comes with that due to the NPU. Despite desktops having GPUs with up to 50x more TOPs than the requirement, they don't get all that for some reason https://www.thurrott.com/mobile/copilot-pc/323616/microsoft-...
Is Microsoft trying to help NPU chip makers?
When is Wintel going to finally happen?
Microsoft has roughly $102 billion in cash (+ short-term investments). Intel’s market value is approximately $176 billion.
I've never really understood why Microsoft helped Intel's bottom line over decades.
With Azure, Microsoft has even more reason to buy Intel.
Re: Local AI is driving the biggest change in laptops in decades
#78See: "3D TVs are driving the biggest change in TVs in decades"
A lazy easy cheap shot. But do you deny these aspects from the article are not coming? Or won't be still here in 5 years? - Addition of more—and faster—memory. - Consolidation of memory. - Combination of chips on the same silicon. All of these are also happening for non AI reasons. The move to SoC that really started with the M1 wasn't because of AI, but unified memory being the default is something we will see in 5…
In order:
- People wanting more memory is not a novel feature. I am excited to find out how many people immediately want to disable the AI nonsense to free up memory for things they actually want to do.
- Same answer.
- I think the drive towards SOCs has been happening already. Apple's M-series utterly demolishes every PC chip apart from the absolute bleeding-edge available, includes dedicated memory and processors for ML tasks, and it's mature technology. Been there for years. To the extent PC makers are chasing this, I would say it's far more in response to that than anything to do with AI.
Re: Local AI is driving the biggest change in laptops in decades
#79I was in the market for a laptop this month. Many new laptops now advertise AI features like this "HP OmniBook 5 Next Gen AI PC" which advertises: "SNAPDRAGON X PLUS PROCESSOR - Achieve more everyday with responsive performance for seamless multitasking with AI tools that enhance productivity and connectivity while providing long battery life" I don't want this garbage on my laptop, especially when its running of its…
Laptop manufacturers are too desperate to cash on the AI craze. There's nothing special about an 'AI PC'. It's just a regular PC with Windows Copilot... which is a standard Windows feature anyway. >I don't want this garbage on my laptop, especially when its running of its battery! The one bit of good news is it's not going to impact your battery life because it doesn't do any on-device processing. It's just calling a…
That's not quite correct. Snapdragon chips that are advertised as being good for "AI" also come with the Hexagon DSP, which is now used for (or targeted at) AI applications. It's essentially a separate vector processor with large vector sizes.
Re: Local AI is driving the biggest change in laptops in decades
#80See: "3D TVs are driving the biggest change in TVs in decades"
A lazy easy cheap shot. But do you deny these aspects from the article are not coming? Or won't be still here in 5 years? - Addition of more—and faster—memory. - Consolidation of memory. - Combination of chips on the same silicon. All of these are also happening for non AI reasons. The move to SoC that really started with the M1 wasn't because of AI, but unified memory being the default is something we will see in 5…
> Addition of more—and faster—memory.
probably not after scam altman bought up half the world's supply for his shit company