Windows AI Studio is in real a Linux AI Studio as it needs WSL to run. Little funny
But can you get this to run in Linux? From the article I can see it's a VSCode extension or something like that but the name kind of implies it's Windows only.
Windows AI Studio Preview
21–30 of 69 posts
Re: Windows AI Studio Preview
#22> will run only on NVIDIA GPUs for the preview
I wonder why Microsoft helps nVidia, instead of using their own technology?
Here’s an example: https://github.com/Const-me/Cgml
Re: Windows AI Studio Preview
#23Windows AI Studio is in real a Linux AI Studio as it needs WSL to run. Little funny
But can you get this to run in Linux? From the article I can see it's a VSCode extension or something like that but the name kind of implies it's Windows only.
> https://github.com/microsoft/windows-ai-studio/blob/main/QA....
For now, but seems to be planned in the future.
Re: Windows AI Studio Preview
#24Apple has good uniform hardware to enable this, but they are a product company and an “AI studio” would not fit their usual definition of a product. I do hope they are considering going in that direction though.
That's the weird thing. They seem to have the best hardware for the price, for individuals to develop and use local LLMs, but so far they have been pretty quiet on all this.
Highly depends on the price. Currently 1600€ gets you a laptop with 8gb shared memory, which surely is a nice device for other use cases but for developing local LLMs that seems awfully limiting.
With upgraded ram (for just 230€ for each 8GB) and storage (just over 1000€ for 2tb; a samsung 990 pro is like 170€) that might be another story, but "check your specs before downloading this app" seems very un-appley. Also, no cuda support etc. Maybe if they make it exclusive to the mac studio?
Re: Windows AI Studio Preview
#25Earlier quoted context omitted.
But can you get this to run in Linux? From the article I can see it's a VSCode extension or something like that but the name kind of implies it's Windows only.
> https://github.com/microsoft/windows-ai-studio/blob/main/QA.... For now, but seems to be planned in the future.
Yep, didn't read that. In the meantime, kudos to Canonical (and other parties) who helped Microsoft with WSL. Now they can also use Linux to produce Windows-only software! :D
Re: Windows AI Studio Preview
#26Why is this on GitHub?
Re: Windows AI Studio Preview
#27Apple has good uniform hardware to enable this, but they are a product company and an “AI studio” would not fit their usual definition of a product. I do hope they are considering going in that direction though.
Apple has it: https://github.com/ml-explore/mlx
Two tangential thoughts about this.
1. Why would they miss the opportunity to go all in and make use of the Neural engines for this? Or do they already, and I just don’t know how to interpret it?
2. At what point is Apple going to think - hmm, we have a kick ass processor on our hands. What if we run our server fleet - the ones that serve iCloud, Apple Store, all Apple services, databases etc on M* processors? It sure would help even better the economies of scale for Apple to go to TSMC and say - here is our new CPU design for servers, iPhone, iPad, watch and whatever VR thing. Why no love for the server side that must be orders of magnitude power hungrier today?
Re: Windows AI Studio Preview
#28Earlier quoted context omitted.
That's the weird thing. They seem to have the best hardware for the price, for individuals to develop and use local LLMs, but so far they have been pretty quiet on all this.
Highly depends on the price. Currently 1600€ gets you a laptop with 8gb shared memory, which surely is a nice device for other use cases but for developing local LLMs that seems awfully limiting. With upgraded ram (for just 230€ for each 8GB) and storage (just over 1000€ for 2tb; a samsung 990 pro is like 170€) that might be another story, but "check your specs before downloading this app" seems very un-appley. Also,…
Cuda would be pointless for Apple, because cuda is for Nvidia only,
no?
As for the price - when you get to 32/64/96GB levels of RAM it’s the cheapest setup on the market that can get you this much VRAM. At least that’s what it was half a year ago when I checked the last time
Re: Windows AI Studio Preview
#29Microsoft also has a nice AI/ML framework called ML.NET.
Re: Windows AI Studio Preview
#30Earlier quoted context omitted.
Highly depends on the price. Currently 1600€ gets you a laptop with 8gb shared memory, which surely is a nice device for other use cases but for developing local LLMs that seems awfully limiting. With upgraded ram (for just 230€ for each 8GB) and storage (just over 1000€ for 2tb; a samsung 990 pro is like 170€) that might be another story, but "check your specs before downloading this app" seems very un-appley. Also,…
Cuda would be pointless for Apple, because cuda is for Nvidia only, no? As for the price - when you get to 32/64/96GB levels of RAM it’s the cheapest setup on the market that can get you this much VRAM. At least that’s what it was half a year ago when I checked the last time
> Cuda would be pointless for Apple, because cuda is for Nvidia only, no?
That is the point. Cuda is widely used in particular for training as opposed to tuning and is just flat out not available. So you buy your nice $6000 machine and it just does not work for its intended purpose.
> it’s the cheapest setup on the market that can get you this much VRAM.
shared VRAM is not everything.