Live data from Hacker News

Launch HN: Thematic (YC S17) Customer Feedback Analysis via NLP

news.ycombinator.com

1–10 of 33 posts

Launch HN: Thematic (YC S17) Customer Feedback Analysis via NLP

#1
Hi! I’m the CEO of Thematic, http://www.getthematic.com. We analyse customer feedback to tell companies how to increase customer satisfaction and reduce churn.

We are one of the handful of companies that got into YC through the Startup School, and (I have to say) the only company that signed YC itself as a customer!

I have a PhD in NLP and ML and was consulting when two large media companies came to me with a problem: They collect tons of customer feedback in free text as part of their NPS surveys, but don’t have the time to sift through the responses.

This turned out to be common. Most companies collect feedback but, especially in large companies, nobody reads this data, and definitely not people who are in charge of strategy. Customers are screaming what’s wrong and what they want, but nobody is listening.

I tried a few open-source packages but found that none worked well. Developed on canonical text like news article or Wikipedia, they either failed to understand the variety of expressions, or were too hard to explain. I wrote a new approach capitalising on my PhD and new Deep Learning approaches. It's completely unsupervised: just needs raw data but, unlike topic modelling, produces clear and specific themes. My husband Nathan joined as a co-founder and for the next year we learned how to solve this problem in a way customer insights professionals find valuable.

Those media companies became customers and we quickly bootstrapped into a profitable startup. This is when Nathan signed up for YC’s Startup School. We grew 20% in those 10 weeks, loved the accountability and the focus. Our mentor suggested we apply for YC, which seemed like a crazy idea, but we gave it a go.

Fast-forward another 2 months, and we are just before Demo Day! Thematic grew 3x in that time, and we are working with brands like Vodafone, Air New Zealand, Stripe, Ableton, and Manpower Group.

Hope you found our story interesting, and happy to answer any questions.

Re: Launch HN: Thematic (YC S17) Customer Feedback Analysis via NLP

#3

would you say that your solution provides a sentiment analysis, similar to Quid, or do you focus on action items and things that product managers can actually address?

We do provide sentiment but the main benefit is definitely the themes which form the action items that can be addressed.

We show what areas to improve, not just how people feel (although that is important in deciding)

Re: Launch HN: Thematic (YC S17) Customer Feedback Analysis via NLP

#4
post #3

would you say that your solution provides a sentiment analysis, similar to Quid, or do you focus on action items and things that product managers can actually address?

We do provide sentiment but the main benefit is definitely the themes which form the action items that can be addressed. We show what areas to improve, not just how people feel (although that is important in deciding)

Awesome, thanks!

Re: Launch HN: Thematic (YC S17) Customer Feedback Analysis via NLP

#6
This is super cool, I also appreciate the demo's you have on your website (airlines, MBA schools etc.). Makes the end result super clear.

I don't know much about NLP but are you only using unsupervised learning on the raw data? I would think you would need an NLP layer as well that sorts out basic synonymical issues, phrasing differences etc.?

Re: Launch HN: Thematic (YC S17) Customer Feedback Analysis via NLP

#7
post #6

This is super cool, I also appreciate the demo's you have on your website (airlines, MBA schools etc.). Makes the end result super clear. I don't know much about NLP but are you only using unsupervised learning on the raw data? I would think you would need an NLP layer as well that sorts out basic synonymical issues, phrasing differences etc.?

Thank you! No training data is required to use Thematic and customers don't need to tell us what they want to find in the data. Hence we say "unsupervised". And yes, we extract synonyms and paraphrases from raw data.

However, we do have tools to review and adjust the results of Thematic by hand. For example, we have an internal drag and drop interface. Some customers really like to change the themes based on their view of the data. But it also helps to remove any inaccuracies, e.g. an incorrectly merged theme.

Re: Launch HN: Thematic (YC S17) Customer Feedback Analysis via NLP

#8
Congratulations on your launch! This is very interesting and it's something that has great applicability. Being in financial services, we collect a ton of feedback and audio but not enough manpower to process it all. I love the themed approach but am curious about the subthemes. Would you be able to shed any light on that?

I'm also happy to make introductions if you're ever thinking about expanding up north to Canada.

Re: Launch HN: Thematic (YC S17) Customer Feedback Analysis via NLP

#9

How do you go about evaluating the accuracy of the themes and action items? Do you create a test set with obvious themes and actions and check the results for example?

Good question! Accuracy of themes is subjective. We run several studies where we used opinions of several people on what the themes should be and then compared the overlap between people with the overlap Thematic has with each of them. This is also referred to as "indexing consistency" in Information Science.

You can check specific examples in our white paper: http://www.getthematic.com/net-promoter-score-verbatims/ (Don't need to download it, the bulk of the results is published on the page.)

In practice, some customers have read samples of responses and expect certain themes. Others have manually tagged them in the past. They compare their results with their fundings and can see straight away if our results are accurate and reliable.

Re: Launch HN: Thematic (YC S17) Customer Feedback Analysis via NLP

#10

Congratulations on your launch! This is very interesting and it's something that has great applicability. Being in financial services, we collect a ton of feedback and audio but not enough manpower to process it all. I love the themed approach but am curious about the subthemes. Would you be able to shed any light on that? I'm also happy to make introductions if you're ever thinking about expanding up north to Canada…

Subthemes are basically more specific versions of the themes. Check out an example on our Twitch demo: https://demo-twitch.getthematic.com/#!/demo/main/dashboard/2... You will see a base theme "use chat", with subthemes like "chat in landscape mode", "chat on a tablet", "type in chat" etc. Does this help?

Thank you so much for the offer of introductions. Definitely interested, as we sell internationally, not just in the US.

Post reply on HN