Live data from Hacker News

Spinning Up in Deep RL

spinningup.openai.com

41–50 of 53 posts

Re: Spinning Up in Deep RL

#41

Can anyone recommend some less opinionated introductory resources to learn reinforcement learning that focus on first principles?

I would highly recommend Sergey Levine's course:

http://rail.eecs.berkeley.edu/deeprlcourse/

For a more mathematical treatment, there's a beautiful book by Puterman:

https://www.amazon.com/Markov-Decision-Processes-Stochastic-...

Re: Spinning Up in Deep RL

#43
post #2

"Pray, who is the candidate's tailor?" -Hilbert Who is responsible for OpenAI's UI/UX design? It is immaculate and should be the standard for the community. I'm always dazzled by the impeccable standards of OpenAI with regards to tone, presentation, accessibility. The documentation is both familiar but distinct, an impressive achievement! I have my own personal qualms on OpenAI's ethics and virtues but am nevertheles…

This comment made me click the link in hopes of seeing some great UI/UX. But, it's just a doc.

Re: Spinning Up in Deep RL

#44
post #28
post #17

Earlier quoted context omitted.

All the blogs posted by e.g. this user [0] were generated by GPT-3. [1] Some of those reached the top of HN. That comment indeed looks a lot like it is generated. It has correlated a bunch of words, but it did not understand that the link between UI and AI is tenuous. It is probably one of the few comments where it is so glaringly obvious. There are likely a lot more comments around which are generated but which went…

Incredible. People in those threads are accusing the "author" of being GPT-3, and other commenters are chastising them for being so disrespectful as to suggest such a thing.

https://news.ycombinator.com/item?id=24165171

Re: Spinning Up in Deep RL

#45
post #17

Earlier quoted context omitted.

If that comment is generated, I will quit my current job and work full time on AI. I don't believe it.

All the blogs posted by e.g. this user [0] were generated by GPT-3. [1] Some of those reached the top of HN. That comment indeed looks a lot like it is generated. It has correlated a bunch of words, but it did not understand that the link between UI and AI is tenuous. It is probably one of the few comments where it is so glaringly obvious. There are likely a lot more comments around which are generated but which went…

That story is bogus. See https://news.ycombinator.com/item?id=24165040 and https://news.ycombinator.com/item?id=24063832.

In a way the real story is that people are so eager to believe it that it didn't matter that it was untrue. Like Voltaire's God, if it didn't exist it was necessary to invent it.

Re: Spinning Up in Deep RL

#46
post #44
post #28

Earlier quoted context omitted.

Incredible. People in those threads are accusing the "author" of being GPT-3, and other commenters are chastising them for being so disrespectful as to suggest such a thing.

https://news.ycombinator.com/item?id=24165171

To be clear, I'm not saying that person was wrong to criticize the other post necessarily. I just think it's a testament to the abilities of GPT-3 that it could fool a reasonable person.

Re: Spinning Up in Deep RL

#47
post #2

"Pray, who is the candidate's tailor?" -Hilbert Who is responsible for OpenAI's UI/UX design? It is immaculate and should be the standard for the community. I'm always dazzled by the impeccable standards of OpenAI with regards to tone, presentation, accessibility. The documentation is both familiar but distinct, an impressive achievement! I have my own personal qualms on OpenAI's ethics and virtues but am nevertheles…

I got an email asking what's HN's policy on GPT-3 generated comments. I think it's covered by the fact that we don't allow bots on HN (https://hn.algolia.com/?dateRange=all&page=0&prefix=false&qu...). The purpose of the the threads is human conversation.

Obviously there's an infatuation right now with GPT-3. That's normal. If people keep posting these without disclosing them, I imagine there will be two consequences. One (good for HN) is readers scrutinizing comments more closely and raising the bar for what counts as a high-quality comment. The other (bad for HN) is readers accusing each other of posting generated comments.

Accusing other commenters of being bots is not a new phenomenon ("this sounds like it was written by a Markov chain" has long been an internet swipe) but if it gets bigger, we might have to figure something out. But first we should wait for the original wave of novelty to die down.

Re: Spinning Up in Deep RL

#48
post #2

"Pray, who is the candidate's tailor?" -Hilbert Who is responsible for OpenAI's UI/UX design? It is immaculate and should be the standard for the community. I'm always dazzled by the impeccable standards of OpenAI with regards to tone, presentation, accessibility. The documentation is both familiar but distinct, an impressive achievement! I have my own personal qualms on OpenAI's ethics and virtues but am nevertheles…

Some of you are commenting on the fact that this might be a generated comment. I get that a lot. My sporadic thought feels generative, I get that, fair observation. But please be more kind to other users. I'll work on my own diction to provide more insightful and constructive comments above light praise.

Note: I know this is generated by Sphinx. I'm commenting more on the actual content and their overall work towards presentation. Again, I should be providing more concrete examples to highlight my points.

Re: Spinning Up in Deep RL

#49
post #29

Earlier quoted context omitted.

I believe he's referring to the absurdity of this statement, especially in relation to SpinningUp (it doesn't have any UI as it's a RL library, and the docs site are generated using standard Sphinx doc generator)

OP might have just clicked through to the main OpenAI site and mixed the UI part in. The bulk of the comment is about documentation and presentation in general and viewing that in the context of the general great UX of OpenAI. I know that GPT3 is impressive, but I'm not as convinced as some of the other commenters here that it's a generated comment. If a similar comment were posted on a non-AI related post, nobody wo…

That's exactly right, I should've been more astute to point out that it was Sphinx in my comment and dwell more on the general demeanor of the documentation with more examples.
Post reply on HN