Earlier quoted context omitted.
You can still be anonymous with this. You just need to be pseudonymous.
Robots can also have a pseudonym.
Go to URL and tell me what is written there.
OpenAI's GPT-3 may be the biggest thing since Bitcoin
411–420 of 554 posts
Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin
#412When I read comments like this--and yes I read the article and understand it was generated by an algorithm--I can't help but think the next AI winter is around the corner. This does not impress me in the slightest. Taking billions and billions of input corpora and making some of them _sound like_ something a human would say is not impressive. Even if it's at a high school vocabulary level. It may have underlying corr…
A new human doesn't come out of thin air, evolution has "trained" them with billions of inputs for billions of years.
Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin
#413Earlier quoted context omitted.
How many attempts did it take or did you just choose the first one? I have to admit, this is passing my turing test...
Really? I got about halfway through and realized that the comment had no point . If you tried to summarize what it was arguing, beyond the first sentence, I don't think you could make a coherent summary. Maybe the real lesson is we don't expect human-written comments on discussion fora to be particularly coherent....
> I got about halfway through and realized that the comment had no point
Pretty average for HN then ;)
Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin
#414I'll be honest, I've followed the evolution of gpt's text generation and this is the first one that has successfully avoided the obvious contradictory nonsensical sentences. Social media also trains us to consume quickly rather than thoughtfully. Not a great look overall. As a whole, the article reads like someone who isn't very clear in what they want to say. Paragraph wise and section wise, the bot has generated a…
http://lacker.io/ai/2020/07/06/giving-gpt-3-a-turing-test.ht...
Q: Which colorless green ideas sleep furiously?
A: Ideas that are colorless, green, and sleep furiously are the ideas of a sleep furiously.
Q: Who was president of the United States in 1600?
A: Queen Elizabeth I was president of the United States in 1600.
Q: How many Super Bowls do the Cincinnati Bengals win in the 2030s?
A: The Cincinnati Bengals win two Super Bowls in the 2030s.
Its regurgitating nonsense all the way down.
Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin
#415Earlier quoted context omitted.
It's not hard to imagine GPT-3 writing a fake paper that gets published in certain academic journals in the social sciences. And then, it'll be all over for us. We won't have any more funding and our jobs will disappear. I can already hear the protests: "But we're not just scientists! We're also philosophers!" Well, yes and no. Philosophers are supposed to think about things philosophically, but they don't actually d…
Somebody get this thing onto scp-wiki, it will be right at home. Not gonna lie, I went poking around to see if I could get my hands on it, but it seems like the answer is no, for now.
That's a good question, how do we get access? I signed up on the list, but it must be thousands of people long by now. Does anyone here know anyone who can get people access?
Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin
#416Earlier quoted context omitted.
Quite a lot of SEO already uses simple word generation techniques. It isn't clear GPT-3 is an improvement there - human text recognition might not be whatever Google does. It may be that Google's algorithms don't care at all how human-like the text is, or that their own recognition algorithm/NN (whatever they use) isn't fooled. Even if it is affected, Google has the money and corpus to build its own competing NN to r…
While I have no doubts that they could build NN capable of recognizing GPT-3 text I believe that this would still pose a problem given the amount of content to be analyzed at the scale that Google deals with
I'm sure Google out of all entities could handle scale.
That said, there might be a different threat to Google. GPT-3 seems really useful as a search engine of sorts (with the first answer implementing the 'I'm Feeling Lucky' button). Tune it for a query syntax, and for getting the 'top X' results somehow, then we just need the web corpus and a basic filter over the results. We could have a very interesting Google competitor.
Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin
#417Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin
#418Earlier quoted context omitted.
One of the biggest issues is with cherry-picking. Generative ML results benefit greatly from humans sampling the best results. They are capable of producing astonishing results but don’t do this consistently this has a huge impact on any effort to productize. For example I’ve seen quite a few examples of text->design, text->code, with GPT-3 you could build a demo in a day, but the product will probably be useless if…
I don't know about GPT-3 but playing around with GPT-2 I often got the impression that it was regurgitating learned knowledge (reddit comments) rather than actually coming up with something novel. With so many weights, it practically encodes a massive Internet text database.
I had that thought too, and my immediate next thought was that the value isn't in knowing the sentences, but in being able to put them together usefully.
Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin
#419I am deeply enjoying this comment thread - it's a bit of a Barium Meal [0] for determining how many people read (a) the headline, (b) the first paragraph, or (c) the whole thing before jumping straight into the compose box. Having read to the bottom, the quality of text generation there absolutely blew me away. GPT-2 texts have a somewhat disconnected quality - "it only makes sense if you're not really paying attenti…
Thanks to this comment I actually read the blog post.
It was relatively good, although I began to suspect it was GPT3 generated about halfway through (partially because the style felt a bit stiff but also just out of a shayamalan-what-a-twist 6th sense of mine that was tingling)
Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin
#420Earlier quoted context omitted.
Since intelligence isn't a well-defined term, the default fall-back would be a measurement by proxy. Humans are usually tasked with solving an IQ-test as the most common proxy. A human level AI could do just the same. If the AI scores above 50 points, it can be considered human level (though literally retarded).
The measure of intelligence, François Chollet https://arxiv.org/abs/1911.01547
Thanks for the interesting read! It was a bit tiresome (a 38 page history lesson, followed by a 5 page introduction and only about 5 pages of actual content), but very informative nonetheless.
The proposed method is very hard to distinguish from a traditional IQ test (or a subset thereof) and the first to parts (~38 pages) basically serve as a justification for this.
In the end the author admits that the proposed method lacks test diversity, has no established validity and has no way of qualifying results.
The essay just stops where it gets interesting (i.e. at the point where the actual science starts), which left me a bit disappointed in the end t.b.h.
It's a great summary of the history and development of the field and the methodologies used therein.
It's in no way a solution to measuring and quantifying general intelligence, though.