Live data from Hacker News

Various LLM Smells

shvbsle.in

301–310 of 312 posts

Re: Various LLM Smells

#302

I wrote a skill for this! But I’m sure a lot of you have as well lol. For those curious https://github.com/ryanthedev/oberskills/blob/main/commands/...

usually the LLM will match against the style in the context, even if the words ask it to do otherwise. since your skill sounds like an LLM wrote it, I would be surprised if it didn't make things worse. sorta like asking an LLM to get more creative with a visual design, that also never works.

Your hand rolling skills? You know they created a thing called a skill creator…

Re: Various LLM Smells

#303

I wrote a skill for this! But I’m sure a lot of you have as well lol. For those curious https://github.com/ryanthedev/oberskills/blob/main/commands/...

I'm not sure to what extent an AI-generated skill will help the AI sound less like an AI.

You must be new to skill creation.

Re: Various LLM Smells

#304
post #299
post #298

Earlier quoted context omitted.

Anonymity is a two way thing. Maybe, I don't need to use "more or less". Maybe, I'm an ultra heavy user of AI. It's even possible that I'm magnitudes better developer in every single aspects. Maybe not. I'm just waiting for somebody who send me code, which was generated by AI, not overwritten almost completely, and it's not shit. The funny thing is that some people here were so convinced that AI is great, that they r…

What I do at work is (obviously) not something I can share. Groovy ;) You must love Jenkins. At least I can rest at ease you won't fire me for that infraction. I used C and C++ most of my career and more recently Go (which I really loved when it was created but my take is a bit more nuanced these days after seeing a really large code base evolve over years). I'm confused though. You generated 100s of thousands of lin…

> I really loved when it was created but my take is a bit more nuanced these days after seeing a really large code base evolve over years

At least, I can be sure that we are not near the same level. But at least, you hopefully will recognize the same thing with new languages… without seeing them failing first.

> You generated 100s of thousands of lines of code using AI and you think it's crap?

This is a funny question. First of all, there are people whose job is to test LLMs. However, I’m not one of them. I simply tried them, generated, and still generate a ton of code with them, then I rewrite basically every single line of them. Because they use for example outdated patterns, which causes the same problems what you’ve seen with Go.

> It is repeating existing patterns or fairly simple concepts.

Yes, and most of the most popular ones are mediocre the best. Average code from which LLMs are learning are made by beginners, not experienced ones, because their sheer number. So LLMs will use those.

> I treat AI like an quick intern

This is always the funniest sentence regarding this. Before AI, it was quite well known that you don’t ever allow interns near important parts of the code. Now, people who supposed to know this, and the reasons for this, somehow forgot this aspect also, just like the review thing.

> AI enables these things to get done with very little overhead so that's a net positive.

No, it does allow to tick a ticket in Jira. And if you handle this in any other way, then you will fail miserably, as how for example Microsoft quite openly did with this.

> a little bit cleaner

Ah yes, the infamous “cleaner”, about which the exact opposite is quite well known, and it’s quite obviously not true with every single vibe coded projects, without exceptions. If that’s cleaner in any environment, then I have a bad news: you’ve never worked with even medior developers, ever. Seriously, that code quality, especially architecturally, is junior level shit.

My previous boss did these low hanging fruits, he at least would never tell anything more than “it’s better than nothing”. And only regarding non-important code, which can fail without real consequences. And can be shit, obviously. The whole point was that even shit is better than nothing. Not that it’s acceptable quality in any way.

At least, you were obvious at least, that your “success” is magnitudes different, than mine. And not regarding code quality, but when a project/product successful. I completely forgot that I’ve met people who sold that their teams completed the most tickets at a company in a given time frame as success. Probably we are closer than this, but still very far away.

Re: Various LLM Smells

#305

Earlier quoted context omitted.

I partly write words for a living. Claude is really really bad at writing prose that doesn’t make me want to vomit. I rarely write code, and only once for a living. But I feel like I’m a superhuman and one step away from being a zillionaire when Claude gives me a bunch of code it has written in seconds. I WILL CHANGE THE WORLD!! And then I remember that Claude can’t write words that don’t make me want to break things…

I’ll take “what is Dunning–Kruger” for $200 Alex.

I don’t understand this comment. It might be a pop-culture reference that has gone over my head.

But I think (I think?!) you might have misinterpreted ny comment, because I’m saying “yes, I Dunning-Kruger myself regularly with AI! BUT then I wake up from the psychosis and realise what an idiot I am and go back to my normal life”.

AI makes everyone think they are brilliant. The skill is recognising when you’re just another idiot.

Re: Various LLM Smells

#306
post #304
post #299

Earlier quoted context omitted.

What I do at work is (obviously) not something I can share. Groovy ;) You must love Jenkins. At least I can rest at ease you won't fire me for that infraction. I used C and C++ most of my career and more recently Go (which I really loved when it was created but my take is a bit more nuanced these days after seeing a really large code base evolve over years). I'm confused though. You generated 100s of thousands of lin…

> I really loved when it was created but my take is a bit more nuanced these days after seeing a really large code base evolve over years At least, I can be sure that we are not near the same level. But at least, you hopefully will recognize the same thing with new languages… without seeing them failing first. > You generated 100s of thousands of lines of code using AI and you think it's crap? This is a funny questio…

Do you have an example of a large scale open source project where you would consider that entire code base to be high quality to your standards?

I think you're saying "my bar is so high you even can't understand where it is". I've worked with hundreds if not thousands of software developers, in many companies from startups to well established ones, including producing products that are what I'd call critical infrastructure that work reliably and do what they're supposed to do. I think I have a pretty decent idea of what an "average" software developer looks like and the overall shape of that curve, and similarly the architecture/design curve of various real world projects. I've built software on my own as a team of one and I've worked with teams of more than 100 people. Anyways, if your assertion is what I wrote above then clearly LLMs can't replace the mythical programmer that you are. But that's not what they're aiming to replace. As to "vibe coded projects" I already said that's not how I use LLMs and I agree that can easily end up like a pile of garbage (but still has its place in the new ecosystem).

The only real test of software is whether it does what it's supposed to do: reliably, is maintainable, can be extended and evolve without losing these attributes. If you've shipped systems that are used by many, work well, can evolve to support new features etc. - kudos to you.

Re: Various LLM Smells

#307

Earlier quoted context omitted.

I've caught Claude Code generating some pretty egregious security vulnerabilities. I'm using it to build an AI RPG site and the goal is to use web assembly as a bridge between author submitted code and LLMs in order to help shore up state management at the game level. The language that I picked for the game runtime is Python. Claude really thought that the best way to validate user submitted Python was to bypass the…

> Business logic is disconnected. It's why agentically produced codebases are MUCH larger than they should be; every feature is developed in a vacuum. I just had Opus 4.7 build a feature twice , because it didn't close a ticket the first time. (I'm trying to solo-build a fairly large greenfield project, and am at the point where I let it go ham over my codebase because of the scale of things.) I then spent a couple o…

It acquiesed for now, soon this knowledge will slip out of its context window

Re: Various LLM Smells

#308
post #200

Earlier quoted context omitted.

>I think looking at an LLM code and thinking you're now a coder is like watching a someone play guitar and think you can just pick up a guitar and play a song. The truth is, if you want to be good, you have to do the work. So many posts here on HN claiming they created another useful tool with AI. No, you didn't create it. AI did. You only had a supporting role. You're Ringo Starr and the AI is John Lennon.

> No, you didn't create it. AI did. You only had a supporting role. You're Ringo Starr and the AI is John Lennon. It's even worse than that: you're the Ringo Starr and the AI is a a "John Lennon" who sucks and is boring and uncreative.

Basically Yoko Ono?

Re: Various LLM Smells

#309

Earlier quoted context omitted.

The second way produces more billable output tokens. Worse, when you feed that code back into the LLM service, the extra whitespace counts as input tokens.

an LF is 1 character, just like a space. Its just looks bigger to our puny human brains.

It isn't a 1:1 substitution. Indenting each parameter like in the second example adds additional space characters: in this case, 4 extra spaces per parameter.

Re: Various LLM Smells

#310

Earlier quoted context omitted.

I haven't used these things for writing recreationally for a while (since the Claude 3.X days), so my opinions might be outdated - but they definitely weren't bad - after all they had a huge library of witticisms to pull from, and like Stable Diffusion that pulls from master artists, so do LLMs from skilled writers. Pro writers did come up with an absolute dearth of interesting ideas, and there are mountains of skill…

Um. Perhaps 'pro writers did come up with an absolute crapload of interesting ideas' would be better writing than 'dearth', which means scarcity and famine? I get that it sounds clever but that's the damn problem!

Sorry, not a native speaker, so I guess I had that word misfiled, thanks for correcting me. It does sting a bit but that's a hell of a lot better than going through life mixing up words.
Post reply on HN