I posted about microtubuals here many years ago and people lost their minds. Now, here it is again in an article where an AI wrote it and I can't tell what is real and what isn't anymore.
OpenAI's GPT-3 may be the biggest thing since Bitcoin
211–220 of 554 posts
Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin
#212> it is almost like a word-salad
Like Trump!
Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin
#213Earlier quoted context omitted.
This kind of facile moving the goalposts is imho a cheap shot and (not imho, fact) is a recurring phenomenon as we make incremental progress toward AI. Progress is often made with steps that would have been astonishing a few years ago. And every time the bar is raised higher. Rightly so, but characterizing this as doing the wrong thing is missing the point of what we, and the system, are learning. Yes it's not intell…
> This kind of facile moving the goalposts is imho a cheap shot and (not imho, fact) is a recurring phenomenon as we make incremental progress toward AI. I think you missed my point. I think we're going in the wrong direction for AI entirely, and these "advances" are fundamentally misguided. OpenAI is explicitly about "intelligence," and so we should question if this is in fact that. It's clear that humans have funda…
> 6 orders of magnitude less input
IIRC the following is attributable to either Margaret Atwood or Iris Murdoch:
"A writer should be able to look into a room [full of people] and understand [in breadth] what is going on."
Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin
#214Now just need a plausibility checking AI to vet GPT-3 outputs so the author doesn’t have to read through 10 versions of his potential blog post.
Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin
#215It passes the Turing test.
Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin
#216Earlier quoted context omitted.
GPT-3 is a neat party trick. But the things that'll be done with web archives* in the next 20y will make it look like the PDP-8. ~love, a web archivist * GPT-3 is trained on one
Hopefully in a way that secures some funding for those making archives of the web.
I'm running the Coronavirus Archive. Largest thematic archive on the pandemic, since January. I'm also teaching community biolab techniques to people in parts of the world without ready access to commercial COVID-19 test kits, on all but zero resources at this point.
I could use… what's the word? I think it's more funding.
Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin
#217Earlier quoted context omitted.
It's very clear to me that he does not. But he does an excellent job of making GP's point.
Err, it seems very clear to me that he does realize GPT-3 is the author, and that it was easily caught by his bullshit filter. Which was my experience too -- but I am less dismissive. I regularly see human-produced bullshit get very far with less coherence than these examples from GPT-3. GPT-3 isn't AGI, but it's weapons-grade in a way that GPT-2 wasn't.
OK, but a weapons-grade BS generator is not what the world needs right now...
Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin
#218I'm extremely interested in leveraging GPT-3 to output maintainable Line of Business code when given User Stories as input.
Specially because it seems to require much less examples to learn from than GPT-2.
And before someone says this might eliminate jobs, it wont. It might do boring parts like CRUD code and validation like this or more advanced:
if (String.IsNullOrEmpty(user.Name)) {
throw new ValidationException("Please provide a name.");
}
Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin
#219Earlier quoted context omitted.
GPT-3 is a neat party trick. But the things that'll be done with web archives* in the next 20y will make it look like the PDP-8. ~love, a web archivist * GPT-3 is trained on one
The transformer model as presented in GPT-3 may be a few tweaks away from a human-acceptable reasoning, at which point we may realize that human brain is just a neat party trick as well. This may come difficult for some people to internalize, especially those who understand the technology in depth. Because it means that the medium of our reality is the consciousness.
> Because it means that the medium of our reality is the consciousness.
I agree. The environment - as the source of learning and forming concepts, is the key ingredient of consciousness, not the brain.
Re: OpenAI's GPT-3 may be the biggest thing since Bitcoin
#220When I read comments like this--and yes I read the article and understand it was generated by an algorithm--I can't help but think the next AI winter is around the corner. This does not impress me in the slightest. Taking billions and billions of input corpora and making some of them _sound like_ something a human would say is not impressive. Even if it's at a high school vocabulary level. It may have underlying corr…
> I'll be impressed the day I can see a program that can 1) only rely on its own limited experiential inputs Hasn't the typical human taken in orders of magnitude more data than this example? And the data has been of both direct sensory experience and texts from other people as well.
I think that it’s the opposite. This algorithm requires many examples of text on the specific topic. Probably more than most humans would require.
> While typically task-agnostic in architecture, this method still requires task-specific fine-tuning datasets of thousands or tens of thousands of examples [0]
I don’t know what constitutes an example in this case but let’s assume it means 1 blog article. I don’t know many humans that read thousands or tens of thousands of blog articles on a specific topic. And if I did I’d expect that human to write a much more interesting article.
To me, this and other similar generated texts from OpenAI feel bland / generic.
Take a listen to the generated music from OpenAI - https://openai.com/blog/jukebox/. It’s pretty bad, but in a weird way. It’s technically correct - in key, on beat, ect. And even some of the music it generates is technically hard to do, but it sounds so painfully generic.
> All the impressive achievements of deep learning amount to just curve fitting Judea Perl [1]
This comment was written by a human :)
[0]https://arxiv.org/abs/2005.14165 [1]https://www.quantamagazine.org/to-build-truly-intelligent-ma...