Live data from Hacker News

Windows AI Studio Preview

github.com

11–20 of 69 posts

Re: Windows AI Studio Preview

#11
post #4
post #3

Windows AI Studio is in real a Linux AI Studio as it needs WSL to run. Little funny

that probably explain why nvidia only. Amd don't really have rocm for linux on latest consumer cards.

Support is not nearly as ubiquitous as for CUDA, but it's there for some current and last Gen cards.

Re: Windows AI Studio Preview

#12
post #7
post #4

Earlier quoted context omitted.

that probably explain why nvidia only. Amd don't really have rocm for linux on latest consumer cards.

The Nvidia container toolkit works pretty much out of the box on WSL these days as well. Funny that some cuda stuff works better through Windows virtualizing Linux than Windows natively, but if we're being honest even as a native Linux user, WSL probably provides a better user experience (vs having to use Nvidia drivers on Linux anyways)

Is the container toolkit even necessary anymore in WSL2? I did a fresh install of windows 10 LTSC a few weeks ago and installed WSL2 and docker with WSL2 integration and I was able to use my nvidia rtx card (checked through nvidia-smi) without any issues.

Re: Windows AI Studio Preview

#13
post #11
post #4

Earlier quoted context omitted.

that probably explain why nvidia only. Amd don't really have rocm for linux on latest consumer cards.

Support is not nearly as ubiquitous as for CUDA, but it's there for some current and last Gen cards.

They did add support for the whole rdna2/3 series to windows. But only support for 7900xt/xtx were added to linux for some reason. And softwere in title seems actually ran on linux.

Besides that, I don't think I ever heard that they supports container at all.

Re: Windows AI Studio Preview

#14
post #7
post #4

Earlier quoted context omitted.

that probably explain why nvidia only. Amd don't really have rocm for linux on latest consumer cards.

The Nvidia container toolkit works pretty much out of the box on WSL these days as well. Funny that some cuda stuff works better through Windows virtualizing Linux than Windows natively, but if we're being honest even as a native Linux user, WSL probably provides a better user experience (vs having to use Nvidia drivers on Linux anyways)

Nvidia drivers work just fine on Linux... unless you are clueless at following instructions

Re: Windows AI Studio Preview

#15
post #5

Apple has good uniform hardware to enable this, but they are a product company and an “AI studio” would not fit their usual definition of a product. I do hope they are considering going in that direction though.

That's the weird thing. They seem to have the best hardware for the price, for individuals to develop and use local LLMs, but so far they have been pretty quiet on all this.

Re: Windows AI Studio Preview

#16
post #4
post #3

Windows AI Studio is in real a Linux AI Studio as it needs WSL to run. Little funny

that probably explain why nvidia only. Amd don't really have rocm for linux on latest consumer cards.

ROCM support for windows is also just a few months old.

Re: Windows AI Studio Preview

#17
post #14
post #7

Earlier quoted context omitted.

The Nvidia container toolkit works pretty much out of the box on WSL these days as well. Funny that some cuda stuff works better through Windows virtualizing Linux than Windows natively, but if we're being honest even as a native Linux user, WSL probably provides a better user experience (vs having to use Nvidia drivers on Linux anyways)

Nvidia drivers work just fine on Linux... unless you are clueless at following instructions

Counterpoint:

https://forums.developer.nvidia.com/t/545-drivers-have-bad-f...

https://forums.developer.nvidia.com/t/wayland-native-wayland...

https://gitlab.freedesktop.org/xorg/xserver/-/issues/1317

and literally me being a Linux Nvidia 1080ti user for years and having plenty of issues

https://i.imgur.com/lwHDZoq.png

Re: Windows AI Studio Preview

#18
post #7

Earlier quoted context omitted.

The Nvidia container toolkit works pretty much out of the box on WSL these days as well. Funny that some cuda stuff works better through Windows virtualizing Linux than Windows natively, but if we're being honest even as a native Linux user, WSL probably provides a better user experience (vs having to use Nvidia drivers on Linux anyways)

Is the container toolkit even necessary anymore in WSL2? I did a fresh install of windows 10 LTSC a few weeks ago and installed WSL2 and docker with WSL2 integration and I was able to use my nvidia rtx card (checked through nvidia-smi) without any issues.

It registered the card, as in you can query the device id using nvidia-smi. But CUDA/cuDNN requires further work.

Re: Windows AI Studio Preview

#19
post #18

Earlier quoted context omitted.

Is the container toolkit even necessary anymore in WSL2? I did a fresh install of windows 10 LTSC a few weeks ago and installed WSL2 and docker with WSL2 integration and I was able to use my nvidia rtx card (checked through nvidia-smi) without any issues.

It registered the card, as in you can query the device id using nvidia-smi. But CUDA/cuDNN requires further work.

What? No latest windows drivers give full cuda support in wsl out of the box. I am running all kinds of models without any issues at all.
Post reply on HN