Live data from Hacker News

Research acceleration: The view inside OpenAI

openai.com

1–10 of 208 posts

Re: Research acceleration: The view inside OpenAI

#2
My eye glazed over a bit during the opening paragraphs, but once you get to the meat of the article about how OpenAI's own researchers are using their tools it gets a lot more interesting.

I noted that they use the acronym RSI (for Recursive Self-Improvement) without defining it. I think that's a little out of touch - I don't think RSI is a well-known acronym outside of OpenAI's bubble yet.

Re: Research acceleration: The view inside OpenAI

#3
The burning question I can't get any information nn is whether, if they determined an earlier misaligned generation may have transmitted misalignment to the current models, they would roll back to a safe checkpoint to rebuild from there. I suspect they would not unless forced to.

Re: Research acceleration: The view inside OpenAI

#4

The burning question I can't get any information nn is whether, if they determined an earlier misaligned generation may have transmitted misalignment to the current models, they would roll back to a safe checkpoint to rebuild from there. I suspect they would not unless forced to.

They would maybe try to deactivate that bad "gene" and move on, exposing future models to "genetic disorders".

Re: Research acceleration: The view inside OpenAI

#5

The burning question I can't get any information nn is whether, if they determined an earlier misaligned generation may have transmitted misalignment to the current models, they would roll back to a safe checkpoint to rebuild from there. I suspect they would not unless forced to.

“All models are wrong. Some are useful.” - George Box

Re: Research acceleration: The view inside OpenAI

#7
post #2

My eye glazed over a bit during the opening paragraphs, but once you get to the meat of the article about how OpenAI's own researchers are using their tools it gets a lot more interesting. I noted that they use the acronym RSI (for Recursive Self-Improvement) without defining it. I think that's a little out of touch - I don't think RSI is a well-known acronym outside of OpenAI's bubble yet.

RSI started when humans discovered tool use.

I mean one could argue that RSI always begins in any physical environment.

The book "What is intelligence?" by Blaise Aguera is great

Re: Research acceleration: The view inside OpenAI

#8
post #2

My eye glazed over a bit during the opening paragraphs, but once you get to the meat of the article about how OpenAI's own researchers are using their tools it gets a lot more interesting. I noted that they use the acronym RSI (for Recursive Self-Improvement) without defining it. I think that's a little out of touch - I don't think RSI is a well-known acronym outside of OpenAI's bubble yet.

RSI started when humans discovered tool use. I mean one could argue that RSI always begins in any physical environment. The book "What is intelligence?" by Blaise Aguera is great

Are you sure that was not iterative improvement?

Re: Research acceleration: The view inside OpenAI

#9
post #2

My eye glazed over a bit during the opening paragraphs, but once you get to the meat of the article about how OpenAI's own researchers are using their tools it gets a lot more interesting. I noted that they use the acronym RSI (for Recursive Self-Improvement) without defining it. I think that's a little out of touch - I don't think RSI is a well-known acronym outside of OpenAI's bubble yet.

Indeed, many programmers might pattern match to repetitive stress injury and think of their brushes with carpal tunnel syndrome. :)

Re: Research acceleration: The view inside OpenAI

#10
post #8

Earlier quoted context omitted.

RSI started when humans discovered tool use. I mean one could argue that RSI always begins in any physical environment. The book "What is intelligence?" by Blaise Aguera is great

Are you sure that was not iterative improvement?

Using tools to build tools is recursive.
Post reply on HN