Live data from Hacker News

LLMs reward expertise

seangoedecke.com

551–560 of 607 posts

Re: LLMs reward expertise

#551

I haven’t experienced this - or maybe the training data for aviation is limited. But ask a an llm for aircraft performance / flight planning data and it’s scary how bad the advice /feed back is.

For anything where "the answer" wasn't already in the training data you just get some arbitrary correlated tokens out, as that's all a LLM can do. Of course the meaning of these tokens is just random.

(And even for things that were in the training data you don't have any guaranty they will be reproduced correctly, there is just some chance something meaningful comes out, or it doesn't, it's random.)

The whole idea to use a next token predictor as "answer machine" is completely flawed. This can't work like advertised, and that's by construction.

Re: LLMs reward expertise

#552

I did a test a few months ago. A friend of mine wanted to develop what i understood to be a simple single page web app. But since she didn’t have any software engineering experience she asked me to help. Around that time everyone was talking about how literally anyone can develop software with LLMs i asked her if she could give it a try first, and if I could watch the attempt. I was fully expecting that writing the c…

I'm wondering: What did she tell you that made you build the website? Did she ask the same thing from the AI? Did you bridge any gaps the AI didn't do for you? I don't know the answer, but I suspect that she treated the AI differently and would've gotten better results if she had asked what she told you. At least if it's an agentic coding assistant like Claude Code or GitHub Copilot. Of course a simple chat will leave manual tasks for you.

Re: LLMs reward expertise

#555
post #163

Earlier quoted context omitted.

I've been using a prompt that comes from the opposite direction for non-programming stuff: "Assume the user is an expert in all fields; while this is clearly logically untrue on a literal level, the user prefers to see a field's technical terminology and then ask the AI about terms the user does not understand rather than get an inaccurate statement about some issue." Whether you have to reassure the LLM that this is…

Off topic, but stretching is absolutely useless for ... stretching. And vital for retaining and enhancing usable range of motion (not static stretching, still, but dynamic stretching / mobility under tension). The wildest thing is, there's no evidence that I can find that static stretching does... anything? It increases pain tolerance through the range of motion, but not any more than just asking people to try harder…

Most of this comment is not true. Static stretching does increase flexibility over time - it’s not the most efficient tool for it, but it’s certainly effective.

Presumably the Cochrane study you’re referring to is “Stretching to prevent or reduce muscle soreness after exercise”, which as it’s title suggests, investigates a narrow question and does not support you claim that “stretching does bupkis”.

Re: LLMs reward expertise

#556

Earlier quoted context omitted.

What sort of denial are you reading into the author's post? I don't read it as denial. He is fully acknowledging the usefulness of AI.

He's saying: "Expertise improves AI-assisted work, experts can steer better and get more out of models." The obvious conclusion for anyone is "therefore experts will remain the indispensable and specially rewarded center of the production process." That this is appearing exactly now, and in this form, strikes me as extremely suspicious. I don't doubt the author's sincerity on the surface. What I suspect is that anxie…

Okay, I get your point.

However, I personally agree with the author and I don't think his argument is necessarily motivated out of an anxious fear. On the contrary I think it may be motivated out of a sense of extreme exhilaration and empowerment.

Because experts (like myself as a programmer for 15+ years) who are using AI in many fields are suddenly empowered and much more useful than we were before AI. My employability and value has gone up and not down, precisely because of being able to apply my expertise with AI, which people without expertise simply cannot do. I am a professional programmer and also owner of my own startup.

Let me give you a concrete example that I am dealing with at my startup. I'm a small business owner. Before AI if i wanted to produce production quality video for marketing it would taken such a huge budget and such a large team of people (or an expensive agency) that I wouldn't even have considered it due to the enormous cost. I'm talking about Apple quality video production which takes millions of dollars to produce.

Not anymore. A single competent person with AI can replace an entire marketing video production department or agency. But expertise is key here: knowledge of film terminology to be able to describe the effect you want, and ability to use video editing tools effectively, as well aesthetic taste. I as a programmer with no filmmaking experience don't even know how to write the prompt which makes the video that i want because I don't even have the terminology. But a person with that expertise has suddenly become more employable and more valuable to my business because I as a small business now have the capability to create Apple quality marketing videos.

So AI actually created a new job for an expert that would have otherwise not existed because it was outside the budget of small businesses. Previously somebody like that would have been employable to only a few large production studios but now they become employable by almost any small business.

Re: LLMs reward expertise

#557

I did a test a few months ago. A friend of mine wanted to develop what i understood to be a simple single page web app. But since she didn’t have any software engineering experience she asked me to help. Around that time everyone was talking about how literally anyone can develop software with LLMs i asked her if she could give it a try first, and if I could watch the attempt. I was fully expecting that writing the c…

I ran a similar test and got completely different results. My girlfriend (hair stylist/artist) with zero coding background mentioned a Telegram bot idea. I asked "Why not build it yourself?" I gave her a Windows laptop, but she said she wanted what I have instead. So I handed her a USB stick and told her she was on her own now. Fast forward: she now runs Arch Linux with Hyprland (I use Xorg/i3 though), fully riced wi…

> Arch Linux with Hyprland (I use Xorg/i3 though), fully riced with cats

I think I lack the vocabulary to understand "fully riced with cats" in context here.

Re: LLMs reward expertise

#558

Earlier quoted context omitted.

Off topic, but stretching is absolutely useless for ... stretching. And vital for retaining and enhancing usable range of motion (not static stretching, still, but dynamic stretching / mobility under tension). The wildest thing is, there's no evidence that I can find that static stretching does... anything? It increases pain tolerance through the range of motion, but not any more than just asking people to try harder…

Most of this comment is not true. Static stretching does increase flexibility over time - it’s not the most efficient tool for it, but it’s certainly effective. Presumably the Cochrane study you’re referring to is “Stretching to prevent or reduce muscle soreness after exercise”, which as it’s title suggests, investigates a narrow question and does not support you claim that “stretching does bupkis”.

[dead]

Re: LLMs reward expertise

#560

I did a test a few months ago. A friend of mine wanted to develop what i understood to be a simple single page web app. But since she didn’t have any software engineering experience she asked me to help. Around that time everyone was talking about how literally anyone can develop software with LLMs i asked her if she could give it a try first, and if I could watch the attempt. I was fully expecting that writing the c…

I find there's a lot of variation between LLMs / models...

But there's also some psychology in play too; that we (engineers) see a lot: Some people just let their imagination run away and forget to "do"; without someone in the conversation pushing for results and action, the conversation will just stay within imagination and everyone will be happy in the moment but nothing will get done.

Post reply on HN