Live data from Hacker News

Show HN: This Question Does Not Exist

stackroboflow.com

81–90 of 143 posts

Re: Show HN: This Question Does Not Exist

#82
post #24

Earlier quoted context omitted.

AI will render political discussion between honest human strangers impossible on the open internet. At some point this technology will extend into what's left of print, then talk radio, then TV. An endless supply of Markov punditry.

"Markov punditry" Nice coinage there.

:) I doubt it's original; it reminds me of the character Markov Chaney from Robert Anton Wilson's books.

Re: Show HN: This Question Does Not Exist

#83
post #36

Awesome. Can you create a neutral net that arbitrarily closes questions as off topic or non constructive? ;)

It’s something I’m interested in! Unfortunately I’ve come to the conclusion that upvotes on Stackoverflow aren’t correlated with question content (or I’m not skilled enough to be able to differentiate between “good” and “bad” questions). Check out the linked write up for more detailed info.

Could you not also train a classifier that correlates question content with mod decision? Questions like "what is the best X? " that are obviously subjective , for example.

Maybe even some kind of crazy generative model that learns to post questions that aren't closed by the AI moderator!

Re: Show HN: This Question Does Not Exist

#84
post #13
post #6

Fascinating. I wonder if our current discussion boards on the interwebs can survive the coming influx of content like this and the next generations of it that follow. There are a lot of SO questions posted by very weak non-native speakers of English and some of these are hard to distinguish from those. Kind of scary! What possible positive outcomes do you see for this kind of (admittedly inevitable) capability?

I am actually a bit worried that I’m already starting to see search engine traffic coming in... I hope that the good will outweigh the bad. I’d love to create an answer generator, for example. Once enough questions are generated I’m going to try creating a classifier to see if a neural net can differentiate between real questions and fake ones.

> I am actually a bit worried that I’m already starting to see search engine traffic coming in...

Brilliant, now you only need to come up with a way to use this for good and keep (at least slightly) ahead of the cost in the long run.

Re: Show HN: This Question Does Not Exist

#85
post #79

Absolute gold: "Is there a animal out there that someone can apply to do the sort of thing I'm looking for?" Not sure what happened to the title that time. https://stackroboflow.com/#!/question/11716 (perhaps op is a vim user)

Try a Python or a Pony, or maybe even an OCaml.

Re: Show HN: This Question Does Not Exist

#87
I propose a new kind of Turing Test.

Gather equal numbers of the least intelligible questions from SO (possibly using a metric based on low views/upvotes/comments/answers over long time) and a random selection from stackroboflow.

Present human judges with both sets of questions and ask them to tell the difference.

Having read numerous SO questions from newbie developers whose grasp of English was tenuous at best, I doubt I could tell the difference.

The next step up: the same test, but with mathematics or scientific papers judged by non-experts in the field.

We may actually be there already - I'm not sure.

All of which makes me wonder when we'll reach the point where the bar has been raised so high that the comparison will need to be against the best SO questions and scientific/mathematics papers judged by subject matter experts.

Re: Show HN: This Question Does Not Exist

#88
post #62

"I have creating a PNG Image file where I am printing out the image's with different colors and Image Types. Now I am sure I am drawing properly, but what I'm seeing is that the image is not differently jpeg (ie FF or Chrome) and Safari (for Firefox) is different from the one in Firefox. " As a bit of a connoisseur of babblebots over the decades, one of the interesting things about this generation is that it is produ…

The experience you are describing reminds me of the comparative illusion [0], which is a grammatical illusion where certain sentences seem grammatically correct when you read them, but upon further reflection actually make no sense, example:

"More people have been to Berlin than I have."

[0] https://en.wikipedia.org/wiki/Comparative_illusion

Re: Show HN: This Question Does Not Exist

#89
post #2

I created this site using a Fast.ai trained language model using the Stack Overflow data dump. Full writeup available here: https://stackroboflow.com/about/index.html Interesting things I’ve noticed so far: * It does a remarkably good job of context switching between programming languages based on the semantics of the question! If the question is about SQL it often includes SQL in tags. If it’s about JavaScript it wi…

I found this part of the about page interesting:

> Originally, I wanted to predict the number of upvotes and views questions would get (which, intuitively, I thought would be a good proxy for their quality). Unfortunately, after working on this for about a week straight I've come to the conclusion that there is no correlation between question content and upvotes/views.

> I tried several different models (including adapting an AWD_LSTM classifier, a random forest on a bag of words, and using Google's AutoML) and none of them produced anything better than random noise.

> I also tried using myself as a "human classifier" and given two random questions from StackOverflow I can't predict which one will be more popular.

Re: Show HN: This Question Does Not Exist

#90
post #30

Earlier quoted context omitted.

The way the language model is trained is by rewarding it for correctly predicting the next word in a sequence. The output of the model is a predicted probability distribution of the next word and a “state” — the next iteration takes the state output of the previous interation and generates another word and state (and this process repeats many times). Since there’s a probabilistic dimension, what may have happened in…

Thanks for the explanation. Your description superficially reminds me of a Markov chain ( https://en.wikipedia.org/wiki/Markov_chain ). Is this related or is it totally different?

I haven't read the paper the work is based on, but if the RNN outputs a probability distribution for the next letter/word then they form Markov Chains (since then they only depend on the current state and not the previous state)!

RNNs are just fancy parametric functions that take a (state, input)-pair and return a new (state', output)-pair.

Post reply on HN