Live data from Hacker News

ChatGPT agent: bridging research and action

openai.com

131–140 of 508 posts

Re: ChatGPT agent: bridging research and action

#132
post #30

The "spreadsheet" example video is kind of funny: guy talks about how it normally takes him 4 to 8 hours to put together complicated, data-heavy reports. Now he fires off an agent request, goes to walk his dog, and comes back to a downloadable spreadsheet of dense data, which he pulls up and says "I think it got 98% of the information correct... I just needed to copy / paste a few things. If it can do 90 - 95% of the…

I think this is my favorite part of the LLM hype train: the butterfly effect of dependence on an undependable stochastic system propagates errors up the chain until the whole system is worthless. "I think it got 98% of the information correct..." how do you know how much is correct without doing the whole thing properly yourself? The two options are: - Do the whole thing yourself to validate - Skim 40% of it, 'seems…

> Meanwhile an agent that you accept to get only 98% of things right is meeting expectations.

Well yeah, because the agent is so much cheaper and faster than a human that you can eat the cost of the mistakes and everything that comes with them and still come out way ahead. No, of course that doesn't work in aircraft manufacturing or medicine or coding or many other scenarios that get tossed around on HN, but it does work in a lot of others.

Re: ChatGPT agent: bridging research and action

#134
post #70

I've been using OpenAI operator for some time - but more and more websites are blocking it, such as LinkedIn and Amazon. That's two key use-cases gone (applying to jobs and online shopping). Operator is pretty low-key, but once Agent starts getting popular, more sites will block it. They'll need to allow a proxy configuration or something like that.

In typical SV style, this is just to throw it out there and let second order effects build up. At some point I expect OpenAI to simply form a partnership with LinkedIn and Amazon.

In fact, I suspect LinkedIn might even create a new tier that you'd have to use if you want to use LinkedIn via OpenAI.

Re: ChatGPT agent: bridging research and action

#135

Earlier quoted context omitted.

Maybe this is the "bitter lesson of agentic decisions": hard things in your life are hard because they involve deeply personal values and complex interpersonal dynamics, not because they are difficult in an operational sense. Calling a restaurant to make a reservation is trivial. Deciding what restaurant to take your wife to for your wedding anniversary is the hard part (Does ChatGPT know that your first date was at…

Well, people do have personal assistants and concierges, so it can be done? but I think they need a lot of time and personal attention from you to get that useful right. they need to remember everything you've mentioned offhand or take little corrections consistently. It seems to me like you have to reset the context window on LLMs way more often than would be practical for that

I think it's doable with the current context window we have, the issue is the LLM needs to listen passively to a lot of things in our lives, and we have to trust the providers with such an insane amount of data.

I think Google will excel at this because their ad targeting does this already, they just need to adapt to an llm can use that data as well.

Re: ChatGPT agent: bridging research and action

#136
post #70

I've been using OpenAI operator for some time - but more and more websites are blocking it, such as LinkedIn and Amazon. That's two key use-cases gone (applying to jobs and online shopping). Operator is pretty low-key, but once Agent starts getting popular, more sites will block it. They'll need to allow a proxy configuration or something like that.

Automating applying to jobs makes sense to me, but what sorts of things were you hoping to use Operator on Amazon for?

Re: ChatGPT agent: bridging research and action

#137

I'm not so optimistic as someone that works on agents for businesses and creating tools for it. The leap from low 90s to 99% is classic last mile problem for LLM agents. The more generic and spread an agent is (can-do-it-all) the more likely it will fail and disappoint. Can't help but feel many are optimizing happy paths in their demos and hiding the true reality. Doesn't mean there isn't a place for agents but rathe…

[deleted]

Re: ChatGPT agent: bridging research and action

#138

One the one hand this is super cool and maybe very beneficial, something I definitely want to try out. On the other, LLMs always make mistakes, and when it's this deeply integrated into other system I wonder how severe these mistakes will be, since they are bound to happen.

This. Recently I uploaded screenshot of movie show timing at a specific theatre and asked ChatGPT to find the optimal time for me to watch the movie based on my schedule. It did confidently find the perfect time and even accounted for the factors such as movies in theatre start 20 mins late due to trailers and ads being shown before movie starts. The only problem: it grabbed the times from the screenshot totally inco…

This... what?

Re: ChatGPT agent: bridging research and action

#139
post #70

I've been using OpenAI operator for some time - but more and more websites are blocking it, such as LinkedIn and Amazon. That's two key use-cases gone (applying to jobs and online shopping). Operator is pretty low-key, but once Agent starts getting popular, more sites will block it. They'll need to allow a proxy configuration or something like that.

Agents respecting robots.txt is clearly going to end soon. Users will be installing browser extensions or full browsers that run the actions on their local computer with the user's own cookie jar, IP address, etc.

Re: ChatGPT agent: bridging research and action

#140
post #118

Earlier quoted context omitted.

How do they block it?

Certainly there's a fixed IP range or browser agent that OpenAI uses

I could imagine something happening on the client end which is indistinguishable from the client just buying it.

Also the AI not being able to tell customers about your wares could end up being like not having your business listed on Google.

Google doesn't pay you for indexing your website either.

Post reply on HN