Live data from Hacker News

LLMs reward expertise

seangoedecke.com

131–140 of 605 posts

Re: LLMs reward expertise

#131
So we could run a lighter LLM in front of humans, which translates from 'no domain knowledge' to 'domain expert' and in turn prompts over to the larger LLM.

Then the larger LLM gets all the right lights on, yields better outputs and we translate back into user domain.

I kinda thought the chain-of-thought reasoning already did this, no?

Re: LLMs reward expertise

#132
post #14

I do find that "signalling expertise" is important. "I have a significant background in biblical scholarship. You can assume I've read the most important works in NT studies in particular. Do not translate Greek, Latin, Hebrew, or Syriac. Now, I would like to know . . ." That changes things significantly. So does telling it you have 20+ years of experience with C programming, that you have a robust understanding of m…

For sure. On a personal coding project I said "I'm a professional software engineer, and while this is a hobby project I'm not just vibe-coding and want to build reliable software" and the agent suddenly started suggesting all kinds of things to make its code more robust.

LLMs skew toward over-focusing on things that you mention.

The reason "the agent suddenly started suggesting all kinds of things to make its code more robust" is because you said you "want to build reliable software".

It's not a signal of good judgment or understanding. It's just how LLM attention works.

Re: LLMs reward expertise

#133
i find this post re-assuring (as who doesn't like to feel like they are an expert at something and llm definitely strips that away)... but it still feels like you are rewarded just as much for being a 6/10 expert as you are for being a 9/10 expert. It definitely is an equalizer it is just a question of to what degree.

Re: LLMs reward expertise

#134
post #122

Earlier quoted context omitted.

So, since you care so much and caring requires knowing everything about everything that even remotely intersects with your project, as (presumably) a software developer presumably you understand in detail how every bit of the CPUs you're targeting, plus the lithography, chemistry, and how solid state physics, and the underlying quantum mechanics work?

You seem to be massively exaggerating here for effect. I think the main point is, if you're building frontend web apps, you should probably know how HTML, CSS, and JavaScript interact to some decently high level. Can you look stuff up on the margins via AI, or StackOverflow, or whatever? Sure. If you're building , you should probably know the core tools and concepts at the appropriate level to build them. No we do no…

I think it's pretty obvious from the context of "if you had technical gaps (say, you couldn’t write CSS)" that this isn't about someone that regularly works on frontend web apps, it's about someone that is having to do something that is not normal for them. E.g. I mainly work on HPC code, maybe once in a year or two I need to throw together an animated poster to accompany a printed one. It's obviously ridiculous to claim that this means I have to learn frontend web dev.

Re: LLMs reward expertise

#135

> Of course both are useful, but I’d rather have familiarity with the codebase than a deep general understanding of software systems. In my experience, getting that familiarity with a particular codebase in a way that isn't surface-level has always been a hands-on process. E.g. just because I know many general things about software, I need to know the particulars of the current codebase I'm in to know what is reasona…

Read the code.

Re: LLMs reward expertise

#136
post #74

Earlier quoted context omitted.

We don't need to learn CSS anymore. Just like we don't need to learn ASM since GCC does a great job generating it from higher-level code.

Honestly, we don't really need to learn any more. These days, I mostly copy and paste from tickets to the LLM, and then rubber stamp the output. I have people in my team that try to care about what they're making, but they're generating less code, and filling tickets more slowly, than I am. Even when it comes to system design and architecture, the LLMs aren't great at it, but honestly, they're better than my coworker…

> Honestly, we don't really need to learn any more.

Perhaps for your task of closing Jira tickets that’s true - but the you have a decision to make: wait until you’re eliminated or try to anticipate where future competitiveness comes from.

Re: LLMs reward expertise

#137
post #73

The amplifying mirror analogy works best here. LLMs are ultimately a reflection of your own interactions with its weights, the tone you use, the structure with which you construct your prompt, aspects of an issue you tend to focus on, your breadth of vocabulary and world knowledge and whatnot. People who (carefully) use it as an extension of their own mind and senses will very likely thrive, and those who use it as a…

That sounds useful. Can you share that skill?

Re: LLMs reward expertise

#138

> Of course both are useful, but I’d rather have familiarity with the codebase than a deep general understanding of software systems. In my experience, getting that familiarity with a particular codebase in a way that isn't surface-level has always been a hands-on process. E.g. just because I know many general things about software, I need to know the particulars of the current codebase I'm in to know what is reasona…

the devil is always in the details. those details are on every level you look at: human minds, nature around us, space. so if your inputs are vague, you should only expect outputs that are vague and generalized

Re: LLMs reward expertise

#139
post #14

I do find that "signalling expertise" is important. "I have a significant background in biblical scholarship. You can assume I've read the most important works in NT studies in particular. Do not translate Greek, Latin, Hebrew, or Syriac. Now, I would like to know . . ." That changes things significantly. So does telling it you have 20+ years of experience with C programming, that you have a robust understanding of m…

For sure. On a personal coding project I said "I'm a professional software engineer, and while this is a hobby project I'm not just vibe-coding and want to build reliable software" and the agent suddenly started suggesting all kinds of things to make its code more robust.

>build reliable software

this feels like "make no mistakes" level of prompting. reliable software isn't as simple as making it reliable, it's about choosing the trade-offs in the areas that don't matter as much as the areas that do. if you keep prompting the LLM to make your software more robust it will keep giving you things to do. they aren't all good things. eventually you'll end up needing kubernetes to run a calculator app.

Re: LLMs reward expertise

#140
post #87

Earlier quoted context omitted.

Yes, I do. And it wouldn't take you that long to learn, either.

Who is more productive? A python dev who learns about x86 registers in his free time or one that uses AI at work?

The one who uses AI at work will eventually be replaced by someone cheaper who uses AI at work.

The one who learns about x86 registers is much more likely to continue to evolve

Post reply on HN