Live data from Hacker News

Ask HN: What was your "oh shit" moment with GenAI?

news.ycombinator.com

851–860 of 1001 posts

Re: Ask HN: What was your "oh shit" moment with GenAI?

#851

I am the CTO of a small NGO (10 people total, only 1 other junior Dev at the time). We supported two apps that were built by consultants. They were a mess. NextJS, React, about 4 micro services for a site that had 50 users per WEEK. I configured a devcontainer with the old codebase and an empty repository and asked Claude to rewrite it as an old school server side rendered Django app. Went to sleep. When I woke up it…

Your consultants were probably completely incompetent

Re: Ask HN: What was your "oh shit" moment with GenAI?

#856
Didn't had one yet. Apparently all I have is "crap, here we go again" whenever Claude is giving me a solution to the problem I am presenting to it. Because I understand where it goes and it's full of errors, but those are errors I can avoid. Together we cobble something in the end, I do learn something new as well, but was never "here is my prompt, then Claude delivered final solution next" - like so many commenters here point out they have.

Frankly, to an outsider whatever it presents looks legit, but as an expert I recognize its failures, which makes me even more entrenched in the idea to never use it outside my area of expertise.

I have a question for all them believers: If on a hypothetical scenario you, having no medical experience, find yourself and your child on a mountain, 12 hours away from nearest road, and your offspring is having appendicitis (let's assume your recognize this 100%), with a sharp knife and Claude at your disposal - would you risk to operate on your child? Or hurry the fuck down to get him to a hospital? I know I would chose to get him to a hospital, because that would be a better chance for my kid to live than me to operate on my kid with Claude's assistance. I am pretty sure I would kill my kid on that mountain. So yeah, outside my area of expertise I don't trust Claude one bit.

Re: Ask HN: What was your "oh shit" moment with GenAI?

#858
Two years ago (Dec 2023), I visited Japan and try to use ChatGPT (GPT-3 era) to translate Kanji signs, it was OK but not great. A little over a year later (late April 2025, o1 era IIRC), I visited again and saw a political rally with hand-painted-style Kanji signs. I took a picture and asked what the political party was about. The big "wow" moment was how it would write inline python code to crop analyze the image while it was thinking, then combine it with web searches to eventually find me the website with a summary of what they were about. It definitely hit home for me the potential of what these were capable of.

Re: Ask HN: What was your "oh shit" moment with GenAI?

#859
I think mine when when I got one model to generate a spec for SDL 1.2, and another to generate a reimplementation of the whole thing in rust. It was pretty amazing to see the implementation getting fleshed out and fixed as I fed back results from a real project that still compiled with SDL 1.2. Kept pushing it. Added fully functional audio in 2 prompts. Applied optimizations with another.

Terrible code, but to think you can just rewrite whole libs with AI with relatively lazy prompting + feedback and get decent enough results is kind of mind boggling for me.

Re: Ask HN: What was your "oh shit" moment with GenAI?

#860

Earlier quoted context omitted.

> projects I simply could not have ever approached alone. I think that's part of the divide between enthusiasts and naysayers. If you use GenAI on things that you couldn't approach alone, it's an incredible tool. If you use it on stuff that you're pretty good at, it's not a gamechanger (and if you're an expert, it's a minor boost at best). Many people's job are about doing what they're an expert at.

The dangerous thing is when you’re a novice and can’t identify the BS. That’s why for people with “good” and “expert” skill, it’s not a huge boost. They can identify the BS, and what’s left is modestly helpful. The highest danger in using AI comes precisely to people who stand the most to gain from it.

Exactly that. Novice don’t notice the BS. But they see the output and it looks magical. The UI is working! Hardly any time to code that in

Then they send that PR for a review by a more senior person. And that senior person doesn’t even know where to start on how to explain why it’s all wrong and likely to collapse in prod.

Tons of good use of AI. But tons of bad use of it. And when it’s bad and people don’t notice it, that gets dangerous. So because of that, now we spend a lot more time in doing reviews. Essentially creating a new bottle neck

Post reply on HN