Live data from Hacker News

LLMs reward expertise

seangoedecke.com

501–510 of 606 posts

Re: LLMs reward expertise

#501

I haven’t experienced this - or maybe the training data for aviation is limited. But ask a an llm for aircraft performance / flight planning data and it’s scary how bad the advice /feed back is.

Most Hacker News are working on simple JavaScript applications. LLMs quickly become unusable on any sort of specialist discipline except for the math marketing releases we’ve seen recently.

Re: LLMs reward expertise

#502

I did a test a few months ago. A friend of mine wanted to develop what i understood to be a simple single page web app. But since she didn’t have any software engineering experience she asked me to help. Around that time everyone was talking about how literally anyone can develop software with LLMs i asked her if she could give it a try first, and if I could watch the attempt. I was fully expecting that writing the c…

I ran a similar test and got completely different results. My girlfriend (hair stylist/artist) with zero coding background mentioned a Telegram bot idea. I asked "Why not build it yourself?" I gave her a Windows laptop, but she said she wanted what I have instead. So I handed her a USB stick and told her she was on her own now. Fast forward: she now runs Arch Linux with Hyprland (I use Xorg/i3 though), fully riced wi…

Desktop Linux has a deep and storied culture of real empowerment through learning and teaching. Even if you never sign up for a forum or hop into an IRC channel, that culture pervades a host of informal docs like the Arch wiki, and seems likely to get picked up by LLMs during training.

Maybe web development, despite plentiful tutorials, just isn't quite the same.

Re: LLMs reward expertise

#503

Not sure I agree with this. The math guy at anthropic's prompts are essentially: "suppose you’ve gotta resolve the $CONJECTURE, like absolutely have to, everything depends on it. think really hard, and try to come up with a bunch of ideas to try. but remember to trust yourself and not necessarily in conventional wisdom!!" https://claude.ai/share/25740bd5-aa97-4bd7-bf58-c4df3793fda7 https://xcancel.com/__alpoge__/stat…

Hacker News is the biggest collection of idiots who think they are geniuses, so they will upvote anything that makes them feel smarter.

Re: LLMs reward expertise

#505

Earlier quoted context omitted.

I ran a similar test and got completely different results. My girlfriend (hair stylist/artist) with zero coding background mentioned a Telegram bot idea. I asked "Why not build it yourself?" I gave her a Windows laptop, but she said she wanted what I have instead. So I handed her a USB stick and told her she was on her own now. Fast forward: she now runs Arch Linux with Hyprland (I use Xorg/i3 though), fully riced wi…

There are big differences in what people call "tinkerers". Some are INTERESTED in building things, give it a little shot and find it to be daunting, and push it no further. True tinkerers have no problem with this, because they enjoy learning how things work. Installing Linux, Steam, Portal are all relatively straightforward tasks for someone who uses computers on the regular - but to some people this is just somethi…

You can get pretty dang far asking the AI to explain things and show you where it got that info, especially with IT/DEV stuff. Thing that has been very useful to me is specifically asking AI for that vocabulary. AI is suprisingly useful for giving a vague description of something you want and asking for possible words that match. But you have to KNOW to try that. A tinkerer might have started that convo with the chatbot by asking "What are web pages built from" "Can we use those building blocks to make our own simple app" and gotten there from a place of low expertise in web development but juicing out the knowlege from a place of low expertise is itself a skill.

Re: LLMs reward expertise

#506

I did a test a few months ago. A friend of mine wanted to develop what i understood to be a simple single page web app. But since she didn’t have any software engineering experience she asked me to help. Around that time everyone was talking about how literally anyone can develop software with LLMs i asked her if she could give it a try first, and if I could watch the attempt. I was fully expecting that writing the c…

My experience is similar, people succeed with Loveable or similar platforms because they don't need to know _deployment_ and _runtime_ experience. It's like using Adobe vs Canva, most people are now used to the latter and don't even have a mental model of "runs on a server" or "database and server are two different things". This is the key difference for me compared to earlier Low Code solutions such as OutSystems that still required a SDLC mental model. However, at some point this breaks, like in your example of feature discussions, because people struggle to test out new ideas _without_ immediately showing them. So it becomes Canva vs Figma, a system-based model. And we don't even have good terminology for that ourselves yet.

Re: LLMs reward expertise

#507

I did a test a few months ago. A friend of mine wanted to develop what i understood to be a simple single page web app. But since she didn’t have any software engineering experience she asked me to help. Around that time everyone was talking about how literally anyone can develop software with LLMs i asked her if she could give it a try first, and if I could watch the attempt. I was fully expecting that writing the c…

I've seen some designers and product managers get pretty far with LLMs but mostly because they already know how to build apps just from a non-technical perspective.

Re: LLMs reward expertise

#508
post #163

Earlier quoted context omitted.

I've been using a prompt that comes from the opposite direction for non-programming stuff: "Assume the user is an expert in all fields; while this is clearly logically untrue on a literal level, the user prefers to see a field's technical terminology and then ask the AI about terms the user does not understand rather than get an inaccurate statement about some issue." Whether you have to reassure the LLM that this is…

Off topic, but stretching is absolutely useless for ... stretching. And vital for retaining and enhancing usable range of motion (not static stretching, still, but dynamic stretching / mobility under tension). The wildest thing is, there's no evidence that I can find that static stretching does... anything? It increases pain tolerance through the range of motion, but not any more than just asking people to try harder…

I can tell you if I don't stretch, my muscles feel bad and stiff. No doubt this is partly because I did karate for a few years, where stretching to increase your range of motion is absolutely required. You're not going to "just try harder" into a high kick.

Re: LLMs reward expertise

#509
post #415

This reminded me of Gaussian Processes. You start out with n-dimensional unconstrained (but strongly correlated) gaussians. As soon as constraints (data) are added (mathematically it's called conditioning), the thing goes more and more into shape. Prompting feels a lot like this conditioning phase to me. You start with an LLM in unconstrained mode, basically just a "soup" of knowledge. If you prompt wisely, you immed…

It's this https://youtube.com/shorts/OPVp_FDEkdA

Re: LLMs reward expertise

#510
A fascinating thing about the LLM/AI blogosphere and X is watching memetics in real time. An idea like this one propagates on the order of days until everyone that speaks publicly or in workplace meetings about AI is repeating it.
Post reply on HN