Live data from Hacker News

We ran Anthropic’s interviews through structured LLM analysis

playbookatlas.com

21–30 of 91 posts

Re: We ran Anthropic’s interviews through structured LLM analysis

#21
I'm a scientist and I mostly agree with the scientist part, but I am definitely collaborating with my bot, I don't view it as "just a tool". I know this because this morning I had to do a forced reboot and my VsCode wasn't connecting to our remote servers, it took like over 5 minutes after reboot to reload my bot chat, and from like minutes 3-5 I had the distinct feeling of losing a valuable colleague.

Re: We ran Anthropic’s interviews through structured LLM analysis

#22

Earlier quoted context omitted.

If anything, the AI bubble is reinforcing to me (and hopefully many more people) that the "markets" are anything but rational. None of the investments going on have followed any semblance of fundamentals - it's all pure instinct and chasing hype. I just hope it doesn't tear down the world for the 99% of us unable to actually reap any benefits from it. AI is basically a toy for 99% of us. It's a long long ways away fr…

> AI is basically a toy for 99% of us. So you're at the "first they laugh at us" stage then.

OK, but not everything that gets to that stage moves on to the next, let alone the stage after that.

But I will give you this, the "first they ignore us" stage is over, at least for many people.

Re: We ran Anthropic’s interviews through structured LLM analysis

#24
Another thing I might throw out there is that there are so many domains and niches out there that person A and person B are almost certainly having genuinely different experiences with the same tools. So when person A says "wow this is the best thing ever" and person B says "this thing is horrible" they might both be right.

Re: We ran Anthropic’s interviews through structured LLM analysis

#25
post #6
post #3

The story that’s solidifying is the tech is cool, it’s useful for certain things (eg, meeting note taking), but business have run a ton of “innovation lab” pilots that have returned little to no measurable value with leaders getting frustrated at the invested red ink. In short the substance isn't living up to the hype. Everywhere I look the adoption metrics and impact metrics are a tiny fraction of what was projected…

I actually think things improved substantially when compared to last year. The latest batch of sota models is incredible (just ask any software engineer about what’s happening to their profession). It’s only a matter of time until other knowledge workers start getting the asphyxiating “vibe” coding treatment and that drama is what really fascinates me. People are absolutely torn. It seems that ai usage starts as a cl…

> just ask any software engineer about what’s happening to their profession

I'm a professional developer, and nothing interesting is happening to the field. The people doing AI coding were already the weakest participants, and have not gained anything from it, except maybe optics.

The thing that's suffocating is the economics. The entire economy has turned its back on actual value in pursuit of silicon valley smoke.

Re: We ran Anthropic’s interviews through structured LLM analysis

#26

Earlier quoted context omitted.

To each his own, but multi-tasking feels bad to me. I want to spend my life pursuing mastery of a craft, not lazily delegating. Not that everyone should have the same goals, but the mastery route feels like it's dying off. It makes me sad. I get it that some people just want to see the thing on the screen. Or your priority is to be a high status person with a loving family etc.. etc... All noble goals. I just don't f…

> I want to spend my life pursuing mastery of a craft, not lazily delegating. And yet, the Renaissance "grand masters" became known as masters through systematizing delegation: https://smarthistory.org/workshop-italian-renaissance-art/

I like how you compare people to renaissance painters to inflate their egos

Re: We ran Anthropic’s interviews through structured LLM analysis

#27

Earlier quoted context omitted.

> I want to spend my life pursuing mastery of a craft, not lazily delegating. And yet, the Renaissance "grand masters" became known as masters through systematizing delegation: https://smarthistory.org/workshop-italian-renaissance-art/

I have wondered about that actually. Thanks, I'll read that, looks interesting. Surely Donald Knuth and John Carmack are genuine masters though? There's the Elon Musk theory of mastery where everyone says you're great, but you hire a guy to do it, and there's the theory where you make average income but live a life fulfilled. On my deathbed I want to be the second. (Sorry this is getting off topic.)

Masters of what though?

Steve Jobs wrote code early on, but he was never a great programmer. That didn’t diminish his impact at all. Same with plenty of people we label as "masters" in hindsight. The mastery isn’t always in the craft itself.

What actually seems risky is anchoring your identity to being the best at a specific thing in a specific era. If you're the town’s horse whisperer, life is great right up until cars show up. Then what? If your value is "I'm the horse guy," you're toast. If your value is taste, judgment, curiosity, or building good things with other people, you adapt.

So I’m not convinced mastery is about skill depth alone. It's about what survives the tool shift.

Re: We ran Anthropic’s interviews through structured LLM analysis

#28
post #23

This article is rife with unedited llm signals. This makes me question their methodology here. I want you believe what they found, but I don't trust this analysis. If they were this sloppy with the write up, how sloppy were they with the science?

We have a full page on the methodology we used! Let me know if you’d like access to the dataset we created for this. The aim was not to be scientific but to flush out some deeper meanings from these interviews that typical nlp techniques struggle with. Ps: Of course we used llm tools as a writing aid, I’d be willing to bet those “signals” probably come from my own writing though and my appreciation of Tom Wolfe. I’ve been told it can be “sloppy” sometimes.

Re: We ran Anthropic’s interviews through structured LLM analysis

#29

Earlier quoted context omitted.

> I want to spend my life pursuing mastery of a craft, not lazily delegating. And yet, the Renaissance "grand masters" became known as masters through systematizing delegation: https://smarthistory.org/workshop-italian-renaissance-art/

I like how you compare people to renaissance painters to inflate their egos

Inflate whose ego? Mine? It seemed more like a swipe than ego-inflation, but I was happy to see the article anyway.

Re: We ran Anthropic’s interviews through structured LLM analysis

#30

Earlier quoted context omitted.

> I want to spend my life pursuing mastery of a craft, not lazily delegating. And yet, the Renaissance "grand masters" became known as masters through systematizing delegation: https://smarthistory.org/workshop-italian-renaissance-art/

I like how you compare people to renaissance painters to inflate their egos

The other surprising skill from this whole AI craze is, it turns out that being able to social engineer an LLM is a transferable skill to getting humans to do what you want.
Post reply on HN