Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

AI teaches itself to use an API

twitter.com

Post reply on HN
Print view View original

131–140 of 162 posts

Re: AI teaches itself to use an API

#131

Post by DrewADesign »

raldi wrote: post #115
DrewADesign wrote: post #98

Earlier quoted context omitted.

What you call understanding is assumption. There were retail jobs back then too and a hell of a lot of people worked in those factories. Being able to raise a family in a nice house that you own, drive new cars, send your kids to college without scrimping and retire in your early 60s with a pension is a pretty compelling reason to endure difficult work environments. Meanwhile, in some states, 3% of full-time non-elde…

The data doesn't seem to support what you're saying, e.g., even ignoring the other three and just looking at service-industry jobs, their growth alone made up for the drop in manufacturing jobs many times over: https://i0.wp.com/www.brookings.edu/wp-content/uploads/2022/... Also, the definition of a "nice house" in 1950 or 1975 is very, very different from today. In the 70's, a nice house often had one story and a si…

The US population is well over 100 million larger than in the 70s. You can't just erase changes in individual communities by looking only at national statistics. Our national economy profited just fine. Even within those national numbers, jobs that have seen significant growth line food service jobs are worse in measurable ways. The wages are significantly lower, they're less likely to provide basic benefits like health insurance, let alone paid vacation and retirement. One again, my initial assertion is that a whole lot of people don't just figure it out when part of a broad population deemed unnecessary, and the rust belt is obvious evidence of that.

Re: AI teaches itself to use an API

#132

Post by avg_dev »

One thing I don’t see people discussing here is that API calls often have consequences. Like, if you make a call in your trial-and-error process that inserts a row in some database, and that’s about it, it’s not a really big deal.

But I’m thinking of:

1. How badly secured many real-world APIs are and how many API keys are out there to be scraped

2. Some APIs offer truly destructive or otherwise irreversible actions.

Suppose for one second there was a poorly secured API to control medication dosages. Or to deliver a lethal injection to a death row prison inmate. Or to detonate a building scheduled for demolition. Or, …

Re: AI teaches itself to use an API

#133

Post by tobr »

WXLCKNO wrote: post #111
paxys wrote: post #36

So the AI can learn to use APIs that follow perfect RESTful semantics, are fully documented and intuitively behave exactly like one would expect. Our jobs are safe.

Many humans can't do this.

Most humans can’t do it. Most humans aren’t expected to do it in their jobs, though.

Re: AI teaches itself to use an API

#134

Post by lenkite »

paxys wrote: post #36

So the AI can learn to use APIs that follow perfect RESTful semantics, are fully documented and intuitively behave exactly like one would expect. Our jobs are safe.

Not really - our jobs are going to get changed to "AI operators". Or more brutally: "AI assistants".

Re: AI teaches itself to use an API

#135

Post by [deleted] »

lenkite wrote: post #134
paxys wrote: post #36

So the AI can learn to use APIs that follow perfect RESTful semantics, are fully documented and intuitively behave exactly like one would expect. Our jobs are safe.

Not really - our jobs are going to get changed to "AI operators". Or more brutally: "AI assistants".

[deleted]

Re: AI teaches itself to use an API

#136

Post by mountainriver »

mistrial9 wrote: post #23
momothereal wrote: post #4

Earlier quoted context omitted.

ChatGPT can pretty easily generate documentation from code though :p

ChatGPT can pretty easily generate unreliable documentation from code .. FTFY

Lol yeah, maybe GPT4 and the likes will do this but chatGPT is still way to unreliable

Re: AI teaches itself to use an API

#137

Post by mountainriver »

mistrial9 wrote: post #19

in the Toolformer paper, it seems what they are doing is : * take a performant language model (copied from some other team e.g. GPT-J) * show the machinery that it can learn new tokens using one or more tools from a provided set of tools ... e.g. WikiSearch tool * demonstrate that the sequence of characters in the full API call content, has some effect.. e.g. no reply, useless content, or content that helps predict a…

Yeah there are some pieces missing with it, it’s till not really understanding mutations and state which would be needed, but it’s a huge step in the right direction

Re: AI teaches itself to use an API

#138

Post by lumost »

famouswaffles wrote: post #127
lumost wrote: post #84

I’m a skeptic. There is no evidence behind this tweet that the technique works. I may be mistaken, but I don’t see the authors as having a background in the field. Likewise they don’t describe the technique in any detail. Sounds like snake oil to me, or fake it until you make it.

GPT3 has demonstrably been able to run/execute execute and make API requests with python for quite some time now. You can test it too. See here https://twitter.com/sergeykarayev/status/1569377881440276481 https://twitter.com/sergeykarayev/status/1570868002954055682 None of this seems like it would be hard to implement. The memory would be the more out there thing but even that would be a matter of retrieval.

The proposed method would improve the model anytime the model didn’t know which api to use. This requires the model to not hallucinate knowledge and some form of incremental training.

Re: AI teaches itself to use an API

#139

Post by famouswaffles »

lumost wrote: post #138
famouswaffles wrote: post #127

Earlier quoted context omitted.

GPT3 has demonstrably been able to run/execute execute and make API requests with python for quite some time now. You can test it too. See here https://twitter.com/sergeykarayev/status/1569377881440276481 https://twitter.com/sergeykarayev/status/1570868002954055682 None of this seems like it would be hard to implement. The memory would be the more out there thing but even that would be a matter of retrieval.

The proposed method would improve the model anytime the model didn’t know which api to use. This requires the model to not hallucinate knowledge and some form of incremental training.

Not necessarily. Even in people, memory is (albeit very complex) retrieval. I mean, how many of your x years of memories are in the forefront on your mind at any given moment?

Not the creator so i won't make any definite statements on how it works on the memory side but if you embedded and stored the chain of thought "how to use x API" generations and then retrieved them anytime the model was going to use the same API, it would certainly simulate a memory of sorts without needing any incremental training.

Re: AI teaches itself to use an API

#140

Post by skor »

lenkite wrote: post #134
paxys wrote: post #36

So the AI can learn to use APIs that follow perfect RESTful semantics, are fully documented and intuitively behave exactly like one would expect. Our jobs are safe.

Not really - our jobs are going to get changed to "AI operators". Or more brutally: "AI assistants".

parent comment emphasizes on the fact that no matter how big the effort was, ultimately our tools will always be imperfect. Therefore we will always have something to do.
Post reply on HN