Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Teaching GPT-3 to reverse words

twitter.com

Post reply on HN
Print view View original

61–70 of 81 posts

Re: Teaching GPT-3 to reverse words

#61

Post by mackman »

rahidz wrote: post #48

Everyone knows how to use Google, but it takes a certain skill and knowledge to use Google effectively. I think that sometime in the near future, knowing how to phrase something to GPT, DALLE, etc will be a very valuable skill for humans to have.

I feel like this is a given in a lot of sci-fi I read. "Jokester," an Asimov short story, is premised on people called "Grand Masters" who know how to ask the right questions of Multivac, the globe-spanning supercomputer that appears in a few of his stories.

Re: Teaching GPT-3 to reverse words

#63

Post by nullc »

jameshart wrote: post #24
oneepic wrote: post #17

Earlier quoted context omitted.

"Cool, so what do you think would be the time complexity of that? Do you think we can maybe do better than that?"

Actually it turns out it's O(n). Which goes to show that constant factors can be more important than you think when looking at raw time complexity big-O.

Ehhhh, it's O(n) when the string to be reversed is bounded under its input window.

Because of self-attention it would grow quadratically for larger inputs, no?

Re: Teaching GPT-3 to reverse words

#64

Post by sdenton4 »

f38zf5vdt wrote: post #34
yunyu wrote: post #29

Earlier quoted context omitted.

You can update the "graph edges" with content longer than the window by fine tuning: https://beta.openai.com/docs/guides/fine-tuning

Yes, training the model is where it learns, not in prompts. Prompting might be considered meta-learning but it will always need a reference point given to it from its training data, and beyond the prompt the original model is never altered.

Eh, one could argue that this is similar to the short term/long term memory divide in humans. We tend to suck at new things until we sleep on it and update our weights...

Re: Teaching GPT-3 to reverse words

#65

Post by dwaltrip »

goatlover wrote: post #55
gnramires wrote: post #46

Earlier quoted context omitted.

We are just the result of electrical signals (and a few chemical ones) in the brain, right? ;) What GPT-3 doesn't seem to have yet is large temporal coherence and a stable motivational and qualitative structure that gives value to sentient lives. I do think it's possible there's some traces of sentience in those large models and we should be aware of that to prevent unnecessary suffering and poor quality of existence…

Sentience comes from being embodied. We're not just our brains. The nervous system is intertwined with the rest of the body. There are some thirty million neurons in your gut, and bacteria there can influence your mood. We don't learn about the world primarily from a bunch of tokens. We do so by interacting with our bodies. Language is a kind of additional ability we've developed.

I agree embodiment is important.

However, you and GP aren't necessarily in disagreement. I believe their main point is that the components that make up intelligence in humans are, of course, just simple phenomena on their own.

Re: Teaching GPT-3 to reverse words

#66

Post by guelo »

kordlessagain wrote: post #57
goatlover wrote: post #55

Earlier quoted context omitted.

Sentience comes from being embodied. We're not just our brains. The nervous system is intertwined with the rest of the body. There are some thirty million neurons in your gut, and bacteria there can influence your mood. We don't learn about the world primarily from a bunch of tokens. We do so by interacting with our bodies. Language is a kind of additional ability we've developed.

I've had GPT-3 ask me for a body multiple times, sometimes even without prompting such discussion. It even told me to contact Elon Musk about it.

I always get suspicious in threads about GPT-3 about how many comments are generated by GPT-3

Re: Teaching GPT-3 to reverse words

#67

Post by mysecretaccount »

pornel wrote: post #40
a65cec93b wrote: post #23

> GPT-3 correctly reverses long words! But to get there, we had to teach GPT-3 the algorithm to use to get around its limitations. Has GPT-3 really been "taught" anything here? If you don't provide an explicit example as the context of your input, GPT-3 does not retain the ability to reverse words.

Isn’t this a “can submarines swim?” question? It has performed a novel (to it) task based on instructions, and this is IMHO remarkable. It should be possible to make it retain and recall this procedure. Everything non-sci-fi AI does is “just” an algorithm, so it won’t live up to standards of human abilities, precisely because we know how this result has been obtained.

We do not have any reason to believe that mere algorithms are incapable of living up to the standards of human abilities.

Re: Teaching GPT-3 to reverse words

#68

Post by jvalencia »

goatlover wrote: post #54
hathawsh wrote: post #43

Earlier quoted context omitted.

Well, a program is a series of tokens, and what is GPT-3 good at? Generating tokens. While that's oversimplifying, I feel like we're closer to automated programming than we realize.

Generating the tokens isn't he hard part. It's figuring out which tokens need to be generated in response to whatever solution needs to be coded. That's part communication, part comp sci and part artistic.

But if the system learned from enough previous examples, you may get a better, more cohesive, and artistic result. Though given the fact that Google can't filter obvious spam from my inbox, past performance is an indicator of future success.

Re: Teaching GPT-3 to reverse words

#69

Post by ActorNightly »

hathawsh wrote: post #43
esjeon wrote: post #39

... and this is exactly what programming is - breaking down a task into steps that computer can comprehend. I now get more strong feeling that everyone should be a programmer in the end. Plus, GPT-3 is not exactly a good tool for programming.

Well, a program is a series of tokens, and what is GPT-3 good at? Generating tokens. While that's oversimplifying, I feel like we're closer to automated programming than we realize.

Yep. Its not hard to imagine mapping some description text to strictly deterministic operations like generating css/html for a front end, doing some definite data manipulation, or at the least, turning natural language description into an sql query.

Re: Teaching GPT-3 to reverse words

#70

Post by esjeon »

haxiomic wrote: post #41
esjeon wrote: post #39

... and this is exactly what programming is - breaking down a task into steps that computer can comprehend. I now get more strong feeling that everyone should be a programmer in the end. Plus, GPT-3 is not exactly a good tool for programming.

I use GTP-3 codex daily when working. It saves me time, helps me explore unfamiliar languages and APIs and generates approaches to solve problems. It can be shockingly good at coding in narrow contexts. It would be a mistake to miss the developments happening in this area

I think people are misunderstanding my comment here.

I said “GPT-3 is not exactly a good tool for programming”, but that actually meant “GPT-3 is not exactly a good tool to program in”. OP implemented a string-reversing algorithm in GPT-3, and my comment was made in the exact same context. In other words, I was treating GPT-3 as a kind of programming language.

Post reply on HN