Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: This Question Does Not Exist

stackroboflow.com

Post reply on HN
Print view View original

31–40 of 143 posts

Re: Show HN: This Question Does Not Exist

#31

Post by TheAsprngHacker »

yeldarb wrote: post #30
TheAsprngHacker wrote: post #23

Huh, in this question, there are a lot of words that get repeated five consecutive times: https://stackroboflow.com/#!/question/13733 Is there a reason why? (I don't know anything about AI.)

The way the language model is trained is by rewarding it for correctly predicting the next word in a sequence. The output of the model is a predicted probability distribution of the next word and a “state” — the next iteration takes the state output of the previous interation and generates another word and state (and this process repeats many times). Since there’s a probabilistic dimension, what may have happened in…

Thanks for the explanation. Your description superficially reminds me of a Markov chain (https://en.wikipedia.org/wiki/Markov_chain). Is this related or is it totally different?

Re: Show HN: This Question Does Not Exist

#32

Post by aboutruby »

I think it would still be considered a "Does Not Exist"-valid website if the generated questions would have some auto-formatter for the code. Main issue I see is extra spaces everywhere, often in a syntax breaking way (and missing spaces for formatting) (not that all SO questions have those).

Re: Show HN: This Question Does Not Exist

#33

Post by cpeterso »

jdefr89 wrote: post #25
chrisco255 wrote: post #18

Earlier quoted context omitted.

I'm trying to imagine a productive use case for this? Maybe in reverse for attempting to answer questions?

Think things like election meddling. Propagating truly fake news to cater to the emotions of what people simply want to be true. Humans are weak against Confirmation Bias, ten minutes on Facebook will show you for sure.

Yes. That was the rationale OpenAI made just a few weeks ago to not release their new language models:

http://approximatelycorrect.com/2019/02/17/openai-trains-lan...

Re: Show HN: This Question Does Not Exist

#34

Post by yeldarb »

aboutruby wrote: post #32

I think it would still be considered a "Does Not Exist"-valid website if the generated questions would have some auto-formatter for the code. Main issue I see is extra spaces everywhere, often in a syntax breaking way (and missing spaces for formatting) (not that all SO questions have those).

Yeah this is a shortcoming of the tokenizer. It splits things up in ways that are not 1:1 mappable back to their source unfortunately.

I did a bit of post-processing to get it formatted a bit better (re-combining the “would“ and “n’t” tokens and changing html tags to markdown for example) but there’s still room for improvement.

Spacing specifically is different based on the context. Outside of code blocks you want a space after a period. Inside you probably don’t. But since the tokenizer has one in both places there’s no opportunity for the neural net to learn this (it can’t see any difference). And my naive formatted doesn’t know the difference either. (If you’re curious you can find it in the JS file)

Re: Show HN: This Question Does Not Exist

#35

Post by iforgotpassword »

Angostura wrote: post #10
natch wrote: post #6

Fascinating. I wonder if our current discussion boards on the interwebs can survive the coming influx of content like this and the next generations of it that follow. There are a lot of SO questions posted by very weak non-native speakers of English and some of these are hard to distinguish from those. Kind of scary! What possible positive outcomes do you see for this kind of (admittedly inevitable) capability?

I was thinking the same, as my immediate reaction was to attempt to understand the question and formulate a solution

I was clicking through a couple funny ones but as soon as I got one[1] that fell into this uncanny valley I immediately forgot this was generated and tried to understand it, getting super confused.

[1] https://stackroboflow.com/#!/question/13535

Re: Show HN: This Question Does Not Exist

#36

Post by yeldarb »

kristianc wrote: post #22

Awesome. Can you create a neutral net that arbitrarily closes questions as off topic or non constructive? ;)

It’s something I’m interested in!

Unfortunately I’ve come to the conclusion that upvotes on Stackoverflow aren’t correlated with question content (or I’m not skilled enough to be able to differentiate between “good” and “bad” questions). Check out the linked write up for more detailed info.

Re: Show HN: This Question Does Not Exist

#37

Post by iforgotpassword »

yeldarb wrote: post #17
deepsy wrote: post #16

This is similar to thispersondoesnotexist.com thisresumedoesnotexist.com

Yes, I was heavily inspired by them :) Glad someone made the connection! I actually hadn't seen thisresumedoesnotexist.com yet; but I loved https://thiscatdoesnotexist.com and https://thisrentaldoesnotexist.com

https://thiscatdoesnotexist.com

Oh my god, some of these look terrifying, pure nightmare fuel.

Post reply on HN