Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ask HN: What do you use Machine Learning for?

news.ycombinator.com

Post reply on HN
Print view View original

61–70 of 165 posts

Re: Ask HN: What do you use Machine Learning for?

#61

Post by jmstfv »

wyldfire wrote: post #28
jmstfv wrote: post #21

I use Stanford NER to extract book titles and authors from HN comments. Previous thread: https://news.ycombinator.com/item?id=14202557

How do you disambiguate similar/identical titles? Did you evaluate other NER against CoreNLP? e.g. how does spacy compare? EDIT: answering my own question -- research here [1] ranks CoreNLP as the winner among CoreNLP, NLTK, spaCy, Lingpipe but AFAICT spaCy is competitive. [1] https://aclweb.org/anthology/W/W16/W16-2703.pdf

I found spacy's documentation lacking in details on how to train NER from scratch (at least I couldn't make sense of it). That's why I decided to stick with Stanford's NER.

Regarding disambiguation: People usually mention books with their respective authors, so it takes one query against the local database to check whether entity is indeed a particular book by a particular author. When no author is mentioned, I check parent comment (if any) to find if the given book is mentioned there. Well, and if comment turns out to be standalone then I query Goodreads / Google Books API. Given books with identical titles, these APIs return the most popular option.

Re: Ask HN: What do you use Machine Learning for?

#62

Post by highd »

danvoell wrote: post #27
highd wrote: post #17

-Customer analysis / clustering / behavior visualization -Financials analysis / predictions -Image classification

bump on this one. - Sales Promotion/Offer Prediction - Customer Analysis / Clustering / Site Content Display

I've got a client that's wrangling their data into a place where I can do some targeting for upselling, end-to-end - I'm really looking forward to that. Lots of value on the table, IMO, and really interesting and unusual datasets.

Re: Ask HN: What do you use Machine Learning for?

#64

Post by __erik »

We use ml to identify users who might try to commit fraud when purchasing things from our site, as well as prevent identify fraud when users verify their ID with us. We are also looking into taking advantage of adaptive design to improve ux and conversion.

Re: Ask HN: What do you use Machine Learning for?

#65

Post by highd »

ollin wrote: post #38

I'm using it to isolate acapellas from music for making mashups/remixes. Not quite "real world" yet, since even my most recent models aren't perfectly reliable, but it's getting there.

Could you share what sort of model you're using? Something WaveNet inspired?

Re: Ask HN: What do you use Machine Learning for?

#66

Post by writeslowly »

I've been working with clustering algorithms to create a personal news aggregator from sitemaps and RSS feeds, using an NLP library (Stanford CoreNLP) to do feature extraction. [1] I'd like to extend it to classify articles into different categories so I could filter things like transcripts, opinion columns, web scrapes gone wrong, but I'm not sure how to set that up yet.

[1] Very rough prototype: https://confabulator.io/newsclustering/

Re: Ask HN: What do you use Machine Learning for?

#68

Post by kayoone »

jedberg wrote: post #33

I'm not using it at this moment, but in a couple of weeks I'll have a newborn, and I was thinking of taking pictures of him every time he is upset, and then tagging the photo with what ends up being the resolution (feed, change, or nap) and seeing if I could build a classifier that could figure out what he needs just from a picture of his angry face. Semi-related, but if anyone is using the AWS tools for their AI, pl…

imagine a mobile app that parents can use to identify what their angry new born needs, brilliant :)

Re: Ask HN: What do you use Machine Learning for?

#69

Post by abrichr »

leanthonyrn wrote: post #58

I work for a large multi-hospital corporation. We use machine learning to predict the risk of a patient, after an inpatient admission, being readmitted in 30 days post discharge. If the risk is high, we proactively put process in place to reduce the readmission risk.

Can you reveal which corporation?

Re: Ask HN: What do you use Machine Learning for?

#70

Post by hasbroslasher »

ashark wrote: post #60
hasbroslasher wrote: post #55

Earlier quoted context omitted.

I'm a person (software engineer) who knows some ML and I tell this to my coworkers when they express similar sentiments: If you're worried about ML taking your job then you're not thinking straight. If the world has automated to the degree where programmers are non longer needed in 3 or 10 years then you will definitely have other things to worry about. Truckers, farmers, taxis, cops, and construction crews will like…

It's more like concern that not having those skills (or something comparably advanced, but also with no immediate use in my work or life) will force me to slide down, rather than up, if/when competition from overseas finally hollows out the middle of the US developer market—though I'm not sure why this hasn't already happened, so maybe I'm wrong to worry about that at all. Not concern that ML programs will start writ…

Overseas competition? I'm not sure what you're on about now - it's currently the hardest[1] time in history to get an H1-B with Cheeto man in the White House. Also I think that USA-born and educated developers are still significantly more sought after because of language barriers. If you've tried to get a job in tech recently you'll notice that... it's pretty damn easy.

Honestly it sounds like you're paranoid about your job security and externalizing it. "It's ML, no it's foreigners, no it's the aliens!" I'm a programmer, not a psychologist, though, so don't take my word for it. You can have a look at the sklearn docs though, good place to start on your ML quest.

http://scikit-learn.org/stable/

[1] Not intended to be a factual claim, just a point about the current political climate

Post reply on HN