Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Windows AI Studio Preview

github.com

Post reply on HN
Print view View original

31–40 of 69 posts

Re: Windows AI Studio Preview

#32

Post by jeroenhd »

diffeomorphism wrote: post #30
kolinko wrote: post #28

Earlier quoted context omitted.

Cuda would be pointless for Apple, because cuda is for Nvidia only, no? As for the price - when you get to 32/64/96GB levels of RAM it’s the cheapest setup on the market that can get you this much VRAM. At least that’s what it was half a year ago when I checked the last time

> Cuda would be pointless for Apple, because cuda is for Nvidia only, no? That is the point. Cuda is widely used in particular for training as opposed to tuning and is just flat out not available. So you buy your nice $6000 machine and it just does not work for its intended purpose. > it’s the cheapest setup on the market that can get you this much VRAM. shared VRAM is not everything.

I think it's clear that GPU manufacturers are scamming their customers more than Apple does with their ridiculous prices. There's an 80GB GPU out there that costs about six times as much as an equivalent Mac with 96 GB of shared RAM.

Nvidia intentionally nerfs the amount of VRAM in their consumer cards so you need to buy their ridiculously overpriced enterprise cards. I think it's fair to say Apple's lineup is the cheapest way to get >64GB of VRAM-ish memory and that's definitely not because Apple prices their products so fairly.

Re: Windows AI Studio Preview

#33

Post by nightski »

theturtle32 wrote: post #9
iotku wrote: post #7

Earlier quoted context omitted.

The Nvidia container toolkit works pretty much out of the box on WSL these days as well. Funny that some cuda stuff works better through Windows virtualizing Linux than Windows natively, but if we're being honest even as a native Linux user, WSL probably provides a better user experience (vs having to use Nvidia drivers on Linux anyways)

Having had the displeasure of trying to get CUDA running under WSL2, I can tell you it is most definitely not a better user experience :-P

Weird it was pretty much turn key here. Maybe that was the early days when it was in beta?

Re: Windows AI Studio Preview

#34

Post by mngdtt »

Installed this, and it didn't let me do anything. Despite the fact the readme says stuff runs locally, first it asked me to link to my github account, and then all models required me to ask someone (I think meta?) for permission on github or use a huggingface token or whatever.

So I uninstalled it and now my wsl prompt starts with (base) and I don't know how to disable it and all my python scripts are broken because they can't find all the libraries I've installed from pip throughout the years.

0/10 would not recommend.

Re: Windows AI Studio Preview

#36

Post by baz00 »

severino wrote: post #25
diffeomorphism wrote: post #23

Earlier quoted context omitted.

> https://github.com/microsoft/windows-ai-studio/blob/main/QA.... For now, but seems to be planned in the future.

Yep, didn't read that. In the meantime, kudos to Canonical (and other parties) who helped Microsoft with WSL. Now they can also use Linux to produce Windows-only software! :D

The effort always stops when the commercial goal is achieved.

Re: Windows AI Studio Preview

#39

Post by ekianjo »

iotku wrote: post #17
ekianjo wrote: post #14

Earlier quoted context omitted.

Nvidia drivers work just fine on Linux... unless you are clueless at following instructions

Counterpoint: https://forums.developer.nvidia.com/t/545-drivers-have-bad-f... https://forums.developer.nvidia.com/t/wayland-native-wayland... https://gitlab.freedesktop.org/xorg/xserver/-/issues/1317 and literally me being a Linux Nvidia 1080ti user for years and having plenty of issues https://i.imgur.com/lwHDZoq.png

I thought we were talking about CUDA here?
Post reply on HN