Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

UFO: A UI-Focused AI Agent for Windows OS Interaction

github.com

Post reply on HN
Print view View original

61–66 of 66 posts

Re: UFO: A UI-Focused AI Agent for Windows OS Interaction

#61

Post by batch12 »

MaxikCZ wrote: post #57
batch12 wrote: post #53

Earlier quoted context omitted.

How is not moving the control panel important context or related to this product? I'm not seeing it.

Context lies in how this corporation approaches bars it set itself, and UX the end user have to deal with resulting from it. When a game studio releases new game, looking at previous games they released is a solid indicator of what quality we can expect. Same goes for software companies making new piece of software. Combined with how LLMs seem super useful until I want them to do something original, I would be very s…

Sorry, but I still think you're reaching. You're entitled to your opinion though so I'll leave it at that. Have a great weekend.

Re: UFO: A UI-Focused AI Agent for Windows OS Interaction

#62

Post by klabb3 »

dartos wrote: post #38
klabb3 wrote: post #34

Earlier quoted context omitted.

Rules for thee not for me. Scraping for instance is bad only when other people do it. Technically speaking though, user facing websites are built with quite weak UI accessibility in mind. Partly to prevent others bots from using it. I worry less about the LLM/AI particularities, and more about adding yet another comprehensive layer to the stack. It’d not exactly be standing on solid foundation. During the 2010s Web 2…

I’ve worked on many sites over the past 10 years. Never once was the conscious decision made to not be accessible to prevent bots from scraping.

Me neither but I’ve also scraped sites and seen this is very commonplace. Especially the last couple of years it’s been ramped up. Twitter and Reddit locking down api access. You know that gchat and facebook chat were both open back in the day? Today you’re lucky if you can use a niche web browser to access a large web site. So I don’t mean accessibility necessarily in terms of human accessibility, but in a broader sense. Some of the anti-bot measures are creating problems for humans as well.

Re: UFO: A UI-Focused AI Agent for Windows OS Interaction

#63

Post by anonzzzies »

_sword wrote: post #40

Like a Windows-focused copy of the the Self Operating Computer Framework. There's clearly something here with this approach if it's popping up in multiple open source frameworks

But they don’t work at all. They will get better but they all are pretty much unworkable for the moment.

Re: UFO: A UI-Focused AI Agent for Windows OS Interaction

#66

Post by dbish »

ukuina wrote: post #52
dbish wrote: post #13

Earlier quoted context omitted.

Hard to "beat" someone when you have a very close partnership and you're using their model (GPT-4V), likely this is developed quickly with input from OpenAI. I don't think it's right to think of the two as competing at this point.

If I understand correctly, there is zero overlap between Microsoft AI Research efforts that use GPT4(V) and OpenAI's development. OpenAI gave Microsoft the model weights, and Microsoft hosts it on Azure for MS Research. None of the Azure usage analytics goes back to OpenAI except via bug reports and publications.

They are pretty closely tied, and are directly building atop GPT4V for this, I would not bet that they are this decoupled.
Post reply on HN