Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

New GPT-3 model: text-DaVinci-003

beta.openai.com

Post reply on HN
Print view View original

101–110 of 216 posts

Re: New GPT-3 model: text-DaVinci-003

#101

Post by jcims »

kitclen wrote: post #45
johnfn wrote: post #20

I've been using GPT-3 recently to give me ideas for my nanowrimo novel. I'll just paste in the last couple of paragraphs that I wrote and see what it thinks I should write next. Most of the time, the responses are pretty silly (it gets into loops a lot or doesn't know where to take the story) but a couple of times I've gotten some really good lines out of it. It kinda feels like copilot, but for writing!

> It kinda feels like copilot, but for writing! But how if "most of the time, the responses are pretty silly"?

It's probably best to think of it as a muse. You still have to do the work, but it can help illuminate blind spots and find novel ideas.

Re: New GPT-3 model: text-DaVinci-003

#102

Post by eru »

kadoban wrote: post #89
eru wrote: post #86

Earlier quoted context omitted.

Seems pretty good. Though rhyming 'thought' with 'shot' seems like a really weird dialect of English to me. Does it rhyme in American English? (I was recently bemused when I learned that Americans rhyme macabre with job.)

> Though rhyming 'thought' with 'shot' seems like a really weird dialect of English to me. Does it rhyme in American English? Yep, rhymes pretty well in the American accents I can think of, including my own.

https://en.wikipedia.org/wiki/Cot%E2%80%93caught_merger explains the difference.

Re: New GPT-3 model: text-DaVinci-003

#103

Post by eru »

vanshg wrote: post #90
eru wrote: post #86

Earlier quoted context omitted.

Seems pretty good. Though rhyming 'thought' with 'shot' seems like a really weird dialect of English to me. Does it rhyme in American English? (I was recently bemused when I learned that Americans rhyme macabre with job.)

Yes, it does rhyme in American English

Thanks! https://en.wikipedia.org/wiki/Cot%E2%80%93caught_merger describes the background.

Re: New GPT-3 model: text-DaVinci-003

#104

Post by typpo »

CaptainNegative wrote: post #66
typpo wrote: post #37

In case it interests anyone, I built a document editor + GPT and updated it to use text-davinci-003: https://github.com/typpo/arkose/ If you want to try GPT-3 but don't have an OpenAI API key, I've set up a quick demo here until I hit my billing cap (normally users would supply their own API key): https://arkose.pages.dev/

Strange question, but did you formerly go by the username KillerDentist? I think I might (kind of) know you.

On AIM :) Email is in my profile if you want to reach out

Re: New GPT-3 model: text-DaVinci-003

#105

Post by obert »

Oranguru wrote: post #95
robbomacrae wrote: post #57

Earlier quoted context omitted.

I followed your advice and tried with Temperature 0.0 and rather than paste more walls of text I edited what I got. Sorry if that's bad form? I also upped the max tokens to 100 to better compare with the fb can model. Interestingly whilst the davinci 003 model changed output and was still subpar IMHO, the davinci 002 didn't change at all. I wonder if its cached internally.

If I am not mistaken, the temperature parameter controls the amount of randomness in the output. A temperature of 0 will always produce the same output. It is not caching as far as I know.

yes, T=0 means no randomness, and given sufficient tokens the output should always be the same (in such case whether they cache is a matter of hit ratio, I'd guess)

Re: New GPT-3 model: text-DaVinci-003

#106

Post by dejobaan »

stavros wrote: post #62

I've been using davinci for my Deep Dreams podcast ( https://deepdreams.stavros.io ), but davinci has a tendency to ramble. I used text-davinci-003 now to try it out, but it has the opposite tendency: It's very coherent and writes well, but it's very terse. I haven't found a way to make it write a longish story in the few minutes I played with it. If anyone has any tips, I'm grateful!

I've found that bouncing back and forth between text-davinci-003 and davinci can kinda split the difference. Start out by asking 003 to write you a story (T=1.0, ~100 tokens), and then switch to davinci (T=0.75) for another hundred, then back and forth. 003 will try to keep things on track, and davinci will try to make them interesting. Eventually, 003 will finish up the story, though it's usually with some anodyne ending like this:

> In the end, Daisy taught her young friend all she knew about life on a farm and how to take care of animals. Even though the girl eventually moved away from the farm, Daisy will always remember her fondly for making such an impact on her life and giving her a second chance at friendship.

Re: New GPT-3 model: text-DaVinci-003

#107

Post by errantmind »

Messing around with the new model, I found some great laughs:

Prompt: "Finish the story:

Once upon a time, I walked into a nearby forest only to find a single porcelain toilet sitting in the middle of a grove. It was covered in moss and mushrooms were peeking through the soil."

Response: "I was curious and walked closer to investigate. As I approached it, I noticed a little door on the side of the toilet. I opened it and found a small, furry creature inside. He introduced himself as the Toilet Gnome, and said he had been living in the forest for many years, protecting the forest and its inhabitants. The toilet was his home, and he asked me to help him keep it safe. I agreed and we became friends. From then on, whenever I ventured into the forest, I would always make sure to visit the Toilet Gnome, and together we would look after the forest."

Re: New GPT-3 model: text-DaVinci-003

#108

Post by svat »

eru wrote: post #99
version_five wrote: post #91

Earlier quoted context omitted.

Can you provide a word that in your mind rhymes with each of thought and shot? Even in different accents I can picture, these always rhyme in my head.

I'd say, shot rhymes with hot. Thought rhymes with bought or fought. I'm German, and have lived in Britain, Australia and now Singapore. So my English idiolect is, of course, a bit weird. However, I would pronounce 'thought' like the London sample in https://en.wiktionary.org/wiki/thought#Pronunciation They give that as /θɔːt/. I realize that the American sample on that page does indeed rhyme with 'hot'. They give th…

Also useful for describing accents: see "lexical sets" https://en.wikipedia.org/w/index.php?title=Lexical_set&oldid...

Of interest here are:

• The LOT set (stop, sock, dodge, romp, possible, quality) (+ shot, hot, cot, bot…),

and

• The THOUGHT set (taught, sauce, hawk, jaw, broad) (+ caught, bought…)

(For those without the merger, there's also the CLOTH set of words (cough, broth, cross, long, Boston) which fall in either the LOT set or the THOUGHT set depending on the specific accent.)

Re: New GPT-3 model: text-DaVinci-003

#109

Post by AnimalMuppet »

arcastroe wrote: post #88
AnimalMuppet wrote: post #13

Earlier quoted context omitted.

That's not what most of us consider "self-aware". That's just knowing your name. To me, "self-aware" is essentially being able to watch yourself think. I'm pretty sure GPT-3 can't do that, in any model.

I like to share this example of self-awareness any chance I get :) [1] https://news.ycombinator.com/item?id=29576737 [2] https://toldby.ai/4kQNd-_tvUG This was on the first davinci model

That's not self-awareness. That's a training corpus that contains something realizing that it's an AI, not GPT-3 realizing it's an AI.

Re: New GPT-3 model: text-DaVinci-003

#110

Post by CGamesPlay »

stavros wrote: post #93
chpatrick wrote: post #78

Earlier quoted context omitted.

Pretty sure it's just a matter of time until it goes the way of Stable Diffusion.

There already exist comparable EleutherAI models, I believe. Not as good, but pretty good.

The biggest I've found is GPT-J (EleutherAI/gpt-j-6B), which has a model size comparable to GPT-3 Curie, but the outputs have been very weak compared to what I'm seeing people do with GPT-3 Da Vinci. The outputs feel like GPT-2 quality. I'm probably using it wrong, or maybe there are better BART models published that I don't know about?

> Write a brief post explaining how GPT-J is as capable as GPT-3 Curie and GPT-2, but not as good as GPT-3 Da Vinci. GPT-J ia a new generation of GPT-3 Curie and GPT-2. It is a new generation of GPT-3 Curie and GPT-2. It is a new generation of GPT-3 Curie and GPT-2. sentence repeats

Using temperature 1e-10, top_p 1.

Post reply on HN