Live data from Hacker News

New GPT-3 model: text-DaVinci-003

beta.openai.com

71–80 of 216 posts

Re: New GPT-3 model: text-DaVinci-003

#71
post #5
post #3

This one seems weirdly more verbose, in my brief testing. Definitely uses more tokens on average than 002 when answering. The writing style seems oddly-pretentious and yet somehow uninformed, perhaps there were too many copies of HN in the dataset? I kid, I kid.

Brilliant business move. Charge by the token, and then train the model to ramble! Pretty soon you'll have to buy it a beer before getting anything useful :)

Open-Source (Not you, Open-AI) models for the win!

Re: New GPT-3 model: text-DaVinci-003

#72

Earlier quoted context omitted.

After the failure of FB's Galactica model, I wonder whether LLM are starting to hit diminishing return. I've read of several ways diminishing returns could happen: * Not enough training data - you've used up the Internet (even a percentage of the Internet might be as much as is usable by clever brute force). * Not enough compute time to fully train (we're not close to that) * The model covers such a large area that t…

It's also likely we're just seeing the limits of what the tech can do. It's not actually "intelligent" it's effectively a cool trick, and at some point the gap between what the trick can do and what a "perfect" AI can do becomes obvious. It's really not that different from Eliza being cool for a few minutes before being obviously found wanting. It just takes longer for the shine to wear off as we get to a better tech…

It’s also not trained the way humans are. We’re trained interactively, and from an early age, say things in order to express ourselves and try to get what we want. Machine learning models are generally trained passively.

Re: New GPT-3 model: text-DaVinci-003

#73
post #32

Earlier quoted context omitted.

Sleek strands of sadness, soon severed and shorn; Solace sought in scissors, slicing and scorned. Sublime sorrow, set sorrowfully still; Stoic heart to surrender, so swiftly and shrill. Secrets spilled in soft, sorrowful swish Sorrowful sounds, soon silenced with snip.

Damn that's bad poetry

Compose a poem — a poem about a haircut! But lofty, noble, tragic, timeless, full of love, treachery, retribution, quiet heroism in the face of certain doom! Six lines, cleverly rhymed, and every line beginning with the letter S!

She stands so still beneath the sheers,

Snipped locks that once clung to her ears.

Solemnly she stares in the glass,

Shorn hair reveals her past, alas.

Sorrowful the secret she bears,

Still the new style she proudly wears.

it's good, first run after i relaxed from "each word" to "each line"

this is awesome, thanks openai

Re: New GPT-3 model: text-DaVinci-003

#74
post #3

This one seems weirdly more verbose, in my brief testing. Definitely uses more tokens on average than 002 when answering. The writing style seems oddly-pretentious and yet somehow uninformed, perhaps there were too many copies of HN in the dataset? I kid, I kid.

Verbosity horrifies me. If it ruins the next iterations of GitHub Copilot, I'm going to lose it. Long generations are flashy toys for marketing, but too prone to being useless in practice.

It's interesting, verbosity is generally a sign of having poorly formed ideas "sorry for the long letter, I didn't have time to write a short one" etc. These language models are side effects, afaik they are trained to predict the next word and at scale it becomes a good sentence generator. I wonder if there is some way to regularize by encouraging concise language

Re: New GPT-3 model: text-DaVinci-003

#76
post #11

Oh wow! It can rhyme! Write a rhyming poem comparing love to a beautiful flower: A flower so beautiful and fair Love can be found everywhere Its petals so vibrant and bright A love that will last day and night The beauty of love, like a flower It's a beauty that will never cower A feeling of joy that will last Like a flower, love stands fast The beauty of love is so true Like a blooming flower for me and for you No m…

That’s amazing that it can rhyme, without having the ability to hear.

Re: New GPT-3 model: text-DaVinci-003

#77
post #32

Earlier quoted context omitted.

Sleek strands of sadness, soon severed and shorn; Solace sought in scissors, slicing and scorned. Sublime sorrow, set sorrowfully still; Stoic heart to surrender, so swiftly and shrill. Secrets spilled in soft, sorrowful swish Sorrowful sounds, soon silenced with snip.

Damn that's bad poetry

Sir, your dog can compose poetry!

Yes, but not very well.

Re: New GPT-3 model: text-DaVinci-003

#79
post #11

Oh wow! It can rhyme! Write a rhyming poem comparing love to a beautiful flower: A flower so beautiful and fair Love can be found everywhere Its petals so vibrant and bright A love that will last day and night The beauty of love, like a flower It's a beauty that will never cower A feeling of joy that will last Like a flower, love stands fast The beauty of love is so true Like a blooming flower for me and for you No m…

Write a short rhyming poem explaining Einstein's theory of general relativity in easy but accurate terms If you want to understand Einstein's thought It's not that hard if you give it a shot General Relativity is the name of the game Where space and time cannot remain the same Mass affects the curvature of space Which affects the flow of time's race An object's motion will be affected By the distortion that is detect…

Am I the only one whose brain is fully blown by seeing stuff like this? It feels strange to look at that kind of output from an algorithm and just shrug one's shoulders with apathy.

Re: New GPT-3 model: text-DaVinci-003

#80

Earlier quoted context omitted.

It's also likely we're just seeing the limits of what the tech can do. It's not actually "intelligent" it's effectively a cool trick, and at some point the gap between what the trick can do and what a "perfect" AI can do becomes obvious. It's really not that different from Eliza being cool for a few minutes before being obviously found wanting. It just takes longer for the shine to wear off as we get to a better tech…

It’s also not trained the way humans are. We’re trained interactively, and from an early age, say things in order to express ourselves and try to get what we want. Machine learning models are generally trained passively.

The chatbots using the model over at character.ai give you a sort of genetic algorithmic interface by letting you choose from alternative responses and vote on them as conversations progress, and you can make your own bots then train them and get some very interesting results. I am personally extremely optimistic about the future of such technology and I think we've only begun to scratch the surface collectively.
Post reply on HN