Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

UFO: A UI-Focused AI Agent for Windows OS Interaction

github.com

Post reply on HN
Print view View original

11–20 of 66 posts

Re: UFO: A UI-Focused AI Agent for Windows OS Interaction

#11

Post by ukFxqnLa2sBSBf6 »

tflol wrote: post #10

have they fixed teams yet? that app that like the entire united states uses for pc work every day? i still cant copy paste a code block, or copy paste literally anything. i think microsoft should use AI to learn how to code code blocks in chat or they should ask chatgpt how to use the clipboard of their own OS

[flagged]

Re: UFO: A UI-Focused AI Agent for Windows OS Interaction

#12

Post by anonzzzies »

This is from MS , so it works better than other attempts for other OSs? I tried a few Mac, browser and linux attempts and they were unusable; clicking in the wrong place, having no clue what to do etc…. And can this handle a browser or is that off limits (considering how many projects tried that and failed)?

Re: UFO: A UI-Focused AI Agent for Windows OS Interaction

#13

Post by dbish »

ukuina wrote: post #5

Note this is from Microsoft! They are on a roll lately, and seem to have beaten OpenAI to GPT-Agents with this release.

Hard to "beat" someone when you have a very close partnership and you're using their model (GPT-4V), likely this is developed quickly with input from OpenAI. I don't think it's right to think of the two as competing at this point.

Re: UFO: A UI-Focused AI Agent for Windows OS Interaction

#14

Post by capybara_2020 »

ukuina wrote: post #5

Note this is from Microsoft! They are on a roll lately, and seem to have beaten OpenAI to GPT-Agents with this release.

Just my experience. Tried Copilot(the one for Office) but was left disappointed.

It said it could not do say add an image to a ppt/create one. When it clearly could. Chat was was overly simplified and fixed the wrong problem. Randomly changed say Excel sheet with no clear undo after multiple steps Plus how it works is hidden, so not sure if they are using 3.5, 4 or something else. So no idea if that is causing the problem.

MS is putting out a lot of things quickly. But the quality is just not there in my experience. They are doing way too many things too fast to make any one thing good.

Re: UFO: A UI-Focused AI Agent for Windows OS Interaction

#16

Post by userbinator »

tflol wrote: post #10

have they fixed teams yet? that app that like the entire united states uses for pc work every day? i still cant copy paste a code block, or copy paste literally anything. i think microsoft should use AI to learn how to code code blocks in chat or they should ask chatgpt how to use the clipboard of their own OS

MS Teams is exactly what I'd expect from an AI-generated app --- barely working, lots of little bugs and general oddness, and overall a mediocre experience.

Re: UFO: A UI-Focused AI Agent for Windows OS Interaction

#18

Post by one_buggy_boi »

ukuina wrote: post #7
userbinator wrote: post #6

Earlier quoted context omitted.

That sounds like "don't use this" to everyone I know; or is this meant to be a disclaimer and at the same time normalise the lack of privacy?

Doesn't Azure OpenAI support resolve the privacy concerns?

Azure OpenAI still flags prompts that trigger their censorship rules for human review. The only way around that is to request a waiver which is generally reserved for regulated industries. That may have changed (hope so!) but at the time I know it was a non-starter for some privacy-minded clients.

Re: UFO: A UI-Focused AI Agent for Windows OS Interaction

#20

Post by TeMPOraL »

tflol wrote: post #10

have they fixed teams yet? that app that like the entire united states uses for pc work every day? i still cant copy paste a code block, or copy paste literally anything. i think microsoft should use AI to learn how to code code blocks in chat or they should ask chatgpt how to use the clipboard of their own OS

Yes of course. It works perfectly for what it was meant to be: good enough so people won't switch away from MS ecosystem to have a group chat. Nothing more.

Teams is actively developed along the lines that deliver greatest value to Microsoft at the expense of their customers (a business model increasingly popular these days):

1) implementing corporate-nerfed versions of vanity features introduced by competitors in group chat space (Slack, Discord);

2) broader integration with everything else in Microsoft's corporate ecosystem.

You can be excused for thinking Teams is just a crappy chat-based interface to SharePoint, because this is what it effectively is (Don't have SharePoint? Sucks to be you.).

Copy-paste? What are you? A corporate smartass? There's no budget left for smart-ass features - it's all in lock-in features, where the RoI is much greater.

Post reply on HN