Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Windows AI Studio Preview

github.com

Post reply on HN
Print view View original

41–50 of 69 posts

Re: Windows AI Studio Preview

#41

Post by capableweb »

severino wrote: post #21
blackoil wrote: post #3

Windows AI Studio is in real a Linux AI Studio as it needs WSL to run. Little funny

But can you get this to run in Linux? From the article I can see it's a VSCode extension or something like that but the name kind of implies it's Windows only.

The link takes me to marketplace.visualstudio.com which makes it seem like a Visual Studio extension, not a VSCode extension? Not sure, it's as confusing as the live/hotmail/outlook/authentication parts of Microsoft tends to be.

Besides, it says the following:

> Windows AI Studio will run only on NVIDIA GPUs for the preview, so please make sure to check your device spec. WSL Ubuntu distro 18.4 or greater should be installed and is set to default prior to using Windows AI Studio.

So seems it'll only run in Linux, as it's a requirement to have Ubuntu WSL running beforehand.

Re: Windows AI Studio Preview

#42

Post by capableweb »

Mashimo wrote: post #40
SSLy wrote: post #37

Earlier quoted context omitted.

Because there's no real source included therein.

True. But it's easy to publish something on github, and you get an bug tracker. So .. I guess they do it because it's easy to do so?

When even Microsoft uses their own platform in a non-intended way, you know it's an official Microsoft project.

Re: Windows AI Studio Preview

#43

Post by ZunarJ5 »

mngdtt wrote: post #34

Installed this, and it didn't let me do anything. Despite the fact the readme says stuff runs locally, first it asked me to link to my github account, and then all models required me to ask someone (I think meta?) for permission on github or use a huggingface token or whatever. So I uninstalled it and now my wsl prompt starts with (base) and I don't know how to disable it and all my python scripts are broken because…

You need to turn off the default conda environment.

Try: conda config --set auto_activate_base false

Re: Windows AI Studio Preview

#44

Post by mngdtt »

ZunarJ5 wrote: post #43
mngdtt wrote: post #34

Installed this, and it didn't let me do anything. Despite the fact the readme says stuff runs locally, first it asked me to link to my github account, and then all models required me to ask someone (I think meta?) for permission on github or use a huggingface token or whatever. So I uninstalled it and now my wsl prompt starts with (base) and I don't know how to disable it and all my python scripts are broken because…

You need to turn off the default conda environment. Try: conda config --set auto_activate_base false

Thanks !!!

Re: Windows AI Studio Preview

#45

Post by dazzlefruit »

mngdtt wrote: post #34

Installed this, and it didn't let me do anything. Despite the fact the readme says stuff runs locally, first it asked me to link to my github account, and then all models required me to ask someone (I think meta?) for permission on github or use a huggingface token or whatever. So I uninstalled it and now my wsl prompt starts with (base) and I don't know how to disable it and all my python scripts are broken because…

(base) sounds like Anaconda. Try typing conda deactivate?

Re: Windows AI Studio Preview

#46

Post by davikr »

Anyone knows when Microsoft will release a local OCR model officially? I haven't seen anyone talking about this, but the one they're shipping with Snipping Tool (OneOcr) is top-tier and beats everything out there like Tesseract, easyOCR etc.

The model is technically in everyone's Windows installs, but we don't have the C++ projected WinRT headers to use the Microsoft.Windows.Vision library.

Re: Windows AI Studio Preview

#47

Post by capableweb »

Const-me wrote: post #22

> will run only on NVIDIA GPUs for the preview I wonder why Microsoft helps nVidia, instead of using their own technology? Here’s an example: https://github.com/Const-me/Cgml

Companies of the size of Microsoft usually function more like a country with various companies within, rather than one company with a unified view and unified goals.

So probably, the group wasn't even aware of that technology because it's far away by either professional connection, or by personal/relationship connections, or they knew about it but had another goal than "maximize use of own stuff" and made the call that the tradeoffs wasn't worth it.

Re: Windows AI Studio Preview

#48

Post by capableweb »

TheRoque wrote: post #15
andruby wrote: post #5

Apple has good uniform hardware to enable this, but they are a product company and an “AI studio” would not fit their usual definition of a product. I do hope they are considering going in that direction though.

That's the weird thing. They seem to have the best hardware for the price, for individuals to develop and use local LLMs, but so far they have been pretty quiet on all this.

It's not weird, is typical Apple playbook.

Year 0 of cool thing - Nothing and silence

Year 1-3 of cool thing - Maybe, if you're lucky, a mention on some hardware thing related to it

Year 3-5 of cool thing - Hardware or software launches that uses thing, no mentions of this besides the earlier one if any.

Year 5-6 of cool thing - Next part of hardware or software launches that uses previous launch, no mentions of this besides the earlier one if any.

Obviously, the time-frames differ, but that's generally how they do things.

Re: Windows AI Studio Preview

#49

Post by capableweb »

davikr wrote: post #46

Anyone knows when Microsoft will release a local OCR model officially? I haven't seen anyone talking about this, but the one they're shipping with Snipping Tool (OneOcr) is top-tier and beats everything out there like Tesseract, easyOCR etc. The model is technically in everyone's Windows installs, but we don't have the C++ projected WinRT headers to use the Microsoft.Windows.Vision library.

Seems they've released a bunch already?

Image-to-text models, filtered by "Microsoft": https://huggingface.co/models?pipeline_tag=image-to-text&sor...

Re: Windows AI Studio Preview

#50

Post by hu3 »

jeroenhd wrote: post #32
diffeomorphism wrote: post #30

Earlier quoted context omitted.

> Cuda would be pointless for Apple, because cuda is for Nvidia only, no? That is the point. Cuda is widely used in particular for training as opposed to tuning and is just flat out not available. So you buy your nice $6000 machine and it just does not work for its intended purpose. > it’s the cheapest setup on the market that can get you this much VRAM. shared VRAM is not everything.

I think it's clear that GPU manufacturers are scamming their customers more than Apple does with their ridiculous prices. There's an 80GB GPU out there that costs about six times as much as an equivalent Mac with 96 GB of shared RAM. Nvidia intentionally nerfs the amount of VRAM in their consumer cards so you need to buy their ridiculously overpriced enterprise cards. I think it's fair to say Apple's lineup is the ch…

> There's an 80GB GPU out there that costs about six times as much as an equivalent Mac with 96 GB of shared RAM.

Those are not equivalent in speed. macs RAM are much slower than these GPUs.

Post reply on HN