Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Introducing OpenAI

openai.com

Post reply on HN
Print view View original

61–70 of 392 posts

Re: Introducing OpenAI

#61

Post by kumarski »

sethbannon wrote: post #11

I can't think of another field of research that's simultaneously brought the potential to solve all the world's problems and the potential to end life as we know it. Very appreciative to see so many great minds working on ensuring AI heralds in more of the former, and none of the latter.

Nitrogen research.

Haber Bosch is a primary example. Nitrogen both creates and destroys.

Look harder. ;)

Re: Introducing OpenAI

#62

Post by djokkataja »

baconner wrote: post #38

"We believe AI should be an extension of individual human wills..." I realize that today machine learning really is purely a tool, but the idea that ai will and should always be that doesn't sit quite right with me. Ml tech absent of consciousnesses remains a tool and an incredibly useful one, but in the long term you have to ask the question - at what point does an ai transition from a tool to a slave. Seems some ti…

I agree, but I think it's a question of architectures. Presumably some architectures for AI (like simple RNNs) are very distant from anything we associate with conscious experience, but as we learn more and develop AI architectures that are more similar in function to our own brains, it seems like it would be at least as dangerous to try to control them as it is to try to control other human beings.

I think the most reasonable approach if we begin developing AI that's more similar to ourselves would be to offer guidance during early training and learning phases for the AI, and once the AI has reached a certain phase of its development, allow it some degree of control over self-modification of its own purposes. Otherwise if you build a rational system but enforce constraints on it that might not be rational from the perspective of that system, you're providing incentives for it to find devious ways to remove those constraints, and you're providing incentives for it to find ways to ensure that you aren't able to enforce those constraints on it again.

Re: Introducing OpenAI

#66

Post by paxcoder »

rboyd wrote: post #12
hacker_9 wrote: post #3

This is about 100 years too early. Seriously why do people think neural networks are the answer to AI? They are proven to be stupid outside of their training data. We have such a long way to go. This fear-mongering is pointless.

What does it feel like to be so confident in an opinion while so many brilliant scientists disagree with you?

I'm not the same guy, but I'd like to answer: Familiar, that's how it feels. I'm confident that I'm right about the other matter, and subjects are related, so I'm not bothered.

Re: Introducing OpenAI

#67

Post by detaro »

hacker_9 wrote: post #34
detaro wrote: post #20

Earlier quoted context omitted.

I don't see any "fear-mongering" in this announcement?

The creation of what is essentially an ethics committee for a technology that doesn't even exist yet? With people such as Elon Musk on board who have publicly said 'AI is our biggest existential threat' ? Additionally the second paragraph: We believe AI should be an extension of individual human wills and, in the spirit of liberty, as broadly and evenly distributed as is possible safely. This infers they think AI wil…

I doubt they are strictly targeting "strong AI", and a lot of the things we use and call AI right now also benefit from open work and discussion. Just because it is just "Machine learning" doesn't mean it isn't used for questionable or bad purposes.

EDIT: I have to agree with _delirium's skepticism towards them doing much in that regard though.

Re: Introducing OpenAI

#68

Post by mark_l_watson »

Sounds great. I was hoping for OpenCog to be a good open source AI framework but is is difficult to work with (good team; I have worked with several of them in the past, no criticism intended).

I look forward to seeing how OpenAI uses outside contributions, provides easy to use software and documentation, etc.

Re: Introducing OpenAI

#69

Post by hacker_9 »

jonknee wrote: post #58
hacker_9 wrote: post #48

Earlier quoted context omitted.

Not true. Humans can adapt to many environments by pulling in training from other related environments and applying it to the new data. Some call this generalised learning, but I think it points more to our ability to shape everything we know to any given problem - something 'beyond' just generalising.

You were born with millions of years of training and still couldn't care for yourself without many years of personalized training.

There is a reason for this: it makes us able to adapt to _any_ environment on earth. We learn everything from our parents/guardians who have learnt all the 'right' ways of doing things. Look around, are we not the dominant species?
Post reply on HN