Live data from Hacker News

LLM-based sentiment analysis of Hacker News posts between Jan 2020 and June 2023

outerbounds.com

51–60 of 79 posts

Re: LLM-based sentiment analysis of Hacker News posts between Jan 2020 and June 2023

#51

Earlier quoted context omitted.

And yet, it's so much easier to deploy an LLM, either through a service or on prem.

It's easier to do a lot of things. That doesn't make it better.

But it does make people to feel like that action is now possible. And once someone believes something is possible, they're more likely to do it

Re: LLM-based sentiment analysis of Hacker News posts between Jan 2020 and June 2023

#52
post #16

I wonder if using prompts to get the sentiment in LLM is enough? So we do not need to do any fine-tuning anymore?

I think you raise a reasonable question.

I also think it *could* be less of a problem than you might think. If we treat the scale as arbitrary (which I think is a safe thing to do), then movement along the scale could be sufficient to ascertain *something*

Re: LLM-based sentiment analysis of Hacker News posts between Jan 2020 and June 2023

#53

what's up with the title flips from > 350M Tokens Don't Lie: Love And Hate In Hacker News, to > LLM-based sentiment analysis of Hacker News posts, to > LLM-based sentiment analysis of Hacker News posts between Jan 2020 and June 2023

A/B testing? Possibly increasing accuracy from high click-bait, low signal to low click-bait high signal?

Re: LLM-based sentiment analysis of Hacker News posts between Jan 2020 and June 2023

#54
post #50

Earlier quoted context omitted.

Because LLMs WILL dominate all NLP use cases, whether you like it or not. Its like the linux of operating systems. Sure you can handwrite up some custom OS more specialized for a purpose. But its much easier to just use linux, which everyone understands on a basic level and is extremely robust, and modifying it slightly for the end goal. And saying "Traditional sentiment analysis" tools are "Battle tested" is laughab…

Aside from a half dozen or so zeros, you're right on.

on what, the spending? Facebook alone said that it will spend $40b this year on AI. probably not all of it is on Llama but a sizable portion is.

Re: LLM-based sentiment analysis of Hacker News posts between Jan 2020 and June 2023

#55

Earlier quoted context omitted.

I'm wondering how their LLM parsing 250 mil words in 9 hours compares with performance of traditional sentiment analysis. Also, many exisiting sentiment analysis tools have a lot of research behind them that can be referenced when interpreting the results (known confounds etc). I don't think there is yet an equivalent for the LLM approach

And yet, it's so much easier to deploy an LLM, either through a service or on prem.

What do you mean? Deploying something like spaCy is far easier than deploying an LLM in my experience.

Re: LLM-based sentiment analysis of Hacker News posts between Jan 2020 and June 2023

#56

Earlier quoted context omitted.

And yet, it's so much easier to deploy an LLM, either through a service or on prem.

What do you mean? Deploying something like spaCy is far easier than deploying an LLM in my experience.

By "deploy", they almost certainly mean "set up to use" and they may have also included "learn how to use" and all its various forms, as well.

LLMs really are almost magic in how they can help in this space; and setting them up is often just getting an API key and throwing some money and webservice calls at them.

Re: LLM-based sentiment analysis of Hacker News posts between Jan 2020 and June 2023

#57

Earlier quoted context omitted.

And yet, it's so much easier to deploy an LLM, either through a service or on prem.

It's easier to do a lot of things. That doesn't make it better.

Often makes things built on top of them better because of improved speed of iteration.

Re: LLM-based sentiment analysis of Hacker News posts between Jan 2020 and June 2023

#58
post #22

Why is everything only plotted between 4 and 8 if the scale of the least liked topic should be 0 and most liked should be 9. Also 4.5 is the midpoint, but 4 is displayed as bright red and 6 is a muted gray blue, why? This makes no sense except to be psychologically disingenuous. And no 5s? What is even going on in that LLM?

> "It's a scale of 1 to 13, but it goes up and back down. Eight is the highest score on the scale." - Jason Mendoza

It's nice to see this scale used outside of The Good Place.

Re: LLM-based sentiment analysis of Hacker News posts between Jan 2020 and June 2023

#60

> Hate : Torture Great work folks, glad we can all agree on that one. Interesting that they used an LLM for this. I mean it makes sense and the data seems to pass the pub test but I, in my ignorance, would not have assumed that a language model would be well suited for number crunching.

Seems we mostly agree on hating Atlassian, too, so it's working as intended.

Conveniently sandwiched between War on Terror and CSAM.
Post reply on HN