Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI Agents API

developers.openai.com

Post reply on HN
Print view View original

191–200 of 202 posts

Re: OpenAI Agents API

#191

Post by cududa »

Kind of shocked nobody is calling out at the flag at the bottom of the announcement saying that it's not eligible for Zero Data Retention and it's currently pretty nebulous what the "Don't train on my conversations" toggle means, as the TOS classifies "conversations" as "user visible input and outputs" - says nothing about thinking, etc.

I suspect anything you make in these, the thinking traces or "safety evaluations" of the content allows whatever you build to become RL or eventual pre-training data.

Re: OpenAI Agents API

#192

Post by sillysaurusx »

cududa wrote: post #191

Kind of shocked nobody is calling out at the flag at the bottom of the announcement saying that it's not eligible for Zero Data Retention and it's currently pretty nebulous what the "Don't train on my conversations" toggle means, as the TOS classifies "conversations" as "user visible input and outputs" - says nothing about thinking, etc. I suspect anything you make in these, the thinking traces or "safety evaluations…

This is probably a silly question, but is the internal monologue useful training data? It's where the work is done, but without the input or output, it seems hard to get any useful context.

In other words, what would the data be used to train for? It has to improve some kind of objective function. But it's a little hard to see what the objective function would be if it's just raw inner monologue.

Re: OpenAI Agents API

#193

Post by Draiken »

sillysaurusx wrote: post #192
cududa wrote: post #191

Kind of shocked nobody is calling out at the flag at the bottom of the announcement saying that it's not eligible for Zero Data Retention and it's currently pretty nebulous what the "Don't train on my conversations" toggle means, as the TOS classifies "conversations" as "user visible input and outputs" - says nothing about thinking, etc. I suspect anything you make in these, the thinking traces or "safety evaluations…

This is probably a silly question, but is the internal monologue useful training data? It's where the work is done, but without the input or output, it seems hard to get any useful context. In other words, what would the data be used to train for? It has to improve some kind of objective function. But it's a little hard to see what the objective function would be if it's just raw inner monologue.

Isn't the internal monologue exactly what Anthropic is always trying to hide to avoid distillation?

If it was useless, they wouldn't bother.

It's probably not as useful as if you also have the prompts, but even assuming they really don't train on the prompts (which we can never verify), you can probably get to the prompts based on the monologue. Some agents essentially repeat the prompt in the monologue.

"The user asked me to build X using Y..."

Re: OpenAI Agents API

#195

Post by hunterbrooks »

zackify wrote: post #43
bluesnowmonkey wrote: post #40

I think we’re still figuring out the right abstraction for offering agents as a product. - LLMs are a great foundation but building your own harness is a huge undertaking, a deep rabbit hole. - There are harnesses available as open source libraries but that’s still coupled to an environment. Where does the state persist? Like maybe I’m a Cloudflare worker and don’t even have a file system. Agent as a service like thi…

I just have a slack bot running on a VM that sees a message and invokes pi. It would be trivial for every request to clone a full lxd container and have all the tools and repos required if I wanted to allow it to do even more. Not sure why anyone prefers to choose locked in options

How did you set all that up? We built a flow where you push a slack.yaml to github to arrange this

Re: OpenAI Agents API

#196

Post by hunterbrooks »

druskacik wrote: post #146

I actually have a good use case for this. For my project, I run a lot of Codex sessions in parallel (via Codex SDK[0]), because they are solving self-contained tasks (building crawlers for websites) and in theory I could scale it to hundreds or thousands of parallel sessions. But my VPS can handle maybe 10 parallel sessions max. Btw, the crawlers are for classical music websites, the project is https://classicalbot.c…

Hi, can we schedule a call? Our product supports exactly this use case: www.ellipsis.dev

Re: OpenAI Agents API

#197

Post by hunterbrooks »

zmmmmm wrote: post #128

This idea of remotely hosting the agent harness is honestly backwards to what I need. In so many cases, all the friction is about how to provision access to local data so the agent can work. So you started with the problem of how do I integrate an agent that is running locally with data that is hosted locally, and you have to deal with a bunch of security, data sensitivity and management issues around that. Now you m…

The self hosted workers solve this use case. The control plane sits in OAI's cloud, but the actual tool calls are executed in your worker fleet. The main problem with this approach is that tool arg's get sent over the wire, and those often contain code/data.

Re: OpenAI Agents API

#198

Post by hunterbrooks »

karakanb wrote: post #152

I launched Epho a few weeks ago as an API like this but for all harnesses: https://epho.io I built it primarily for ourselves: we are building an AI data engineer, and we need a way to run many of them in parallel securely. An API for this seemed like the most obvious path forward. It makes it trivial to bring agentic capabilities into any product surface without having to deal with sandboxes, reliability issues, com…

Awesome! I'm also working this, and looking for a cofounder. Feel free to shoot me an email

Re: OpenAI Agents API

#199

Post by hunterbrooks »

Linkd wrote: post #55
theahura wrote: post #22

Earlier quoted context omitted.

do you mean like a cloud agent provider? What we're working on at noriagentic.com may be relevant -- you can fire events from slack/web/cli to kick off an agent in a box and talk to it as if it was running local

Do you guys support projects that span multiple repositories? (and can create multiple PRs across them?)

We do! Happy to get you set up, "schedule a demo" button goes to me: www.ellipsis.dev

Re: OpenAI Agents API

#200

Post by hunterbrooks »

podviaznikov wrote: post #62

would love if it would be possible to allow suer and signing with the open ai account and use exiting subscription. anyone knows how to do that and implement agent api with user actual account?

You can do that on ellipsis.dev. Shoot me an email if you need help getting set up (email in bio)
Post reply on HN