Live data from Hacker News

Ask HN: What was your "oh shit" moment with GenAI?

news.ycombinator.com

191–200 of 1001 posts

Re: Ask HN: What was your "oh shit" moment with GenAI?

#191

A friend had the power supply die on his high-end turntable. He took a picture of each side of the supply's PCB, handed it to Claude, and it gave him back a schematic.

I mean even assuming that this was strictly a 2-layer board, you can still route traces underneath parts like ICs, connectors, etc.. I could believe it was a simple board (for a phonograph and all), but I'd be interested in seeing how well it actually matched. Did he get a new board fabbed and it just worked?

Re: Ask HN: What was your "oh shit" moment with GenAI?

#192
For me it was last February or so when I started using Opus.

But today I watched a video from Andrej Karpathy on YouTube on how LLMs works and my illusions got completely shattered. Turns out they are a glorified autocomplete. All the engineering happens actually on the harness

Re: Ask HN: What was your "oh shit" moment with GenAI?

#193

My "oh shit" moments come every time I see people glazing AI "Oh shit. My skills I spent my life building are going to go to zero value. I'm going to have to dramatically change careers in my forties or I'm just going to wind up being a schmuck prompting these stupid fucking machines for the rest of my life" Oh shit indeed

No career is safe for what's coming though. I think I'll just hang around the computer boys. The dress code is much more forgiving.

Re: Ask HN: What was your "oh shit" moment with GenAI?

#194

My furnace went out during the 2025 holiday and I couldn't get an appointment with a repair person for 2 days. It was getting very cold in my house so I went into my attic and made several videos of the furnace attempting to start and gave it to gemini. It diagnosed the issue immediately and had me spin one of the components (a small exhaust fan) while the furnace tried to fire. It came on immediately. I had to do th…

Oh yeah. I can't remember which LLM, but one helped me repair my dryer.

Re: Ask HN: What was your "oh shit" moment with GenAI?

#196
Getting the agent to write end-to-end tests but from the perspective of a user really shocked me. I only give the agent access to site via web and block access to the source code.

It's helped me to gain a level of trust that the agent isn't just writing the test to pass. That in turn allowed me to step back a lot and trust more of the output and let it run longer and on bigger problems.

Re: Ask HN: What was your "oh shit" moment with GenAI?

#199
Automating my email inbox, I just wanted to split them into folders according to the attachment name but the fields were often incomplete and ended up missing rules, and imap fetch was taking forever and kept failing. In frustration I decided to turn to ChatGPT to split them by messageid which I had never bothered with because the strings were too long to be useful. I initially intended to build a text list of messages and fetch them all one by one but I ended up making chatgpt crush all the instructions into one gigantic python dictionary using the messageid as keys and using it to generate a single pipelined imap call with success flags, dynamic folder naming, cleanup steps the whole works. I was just working on theory of what I knew was possible, and it's the ugliest table you ever saw, but it works and it runs from memory instead of reading and writing values to a temp file and I'd never been able to keep up with that level of nesting before

Re: Ask HN: What was your "oh shit" moment with GenAI?

#200

I gave chatgpt 3.5 the type signature for a co-algebraic encoding of a mealy machine: newtype Mealy s i o = Mealy { runMealy :: (s, i) -> (s, o) } And it gave a really impressive analysis. Then I scrambled all the names and asked with a fresh context like: newtype Foo z e g = Bar { blob :: (z, e) -> (z, g) } It got completely confused and generated a bunch of non-sense. It was at that moment I realized that LLMs don'…

In high school math class our teacher swapped out all the symbols in the epsilon delta definition of limits, and asked us what this equation expresses, and many students struggled to interpret it. I don't think this test shows that an LLM doesn't "understand". It shows more that it has similar failure modes as humans.

Well first of all I think there is more implicit data encoded in the symbols of the epsilon delta definition of limits. In the Mealy example they really just labels for arbitrary sets. The LLM actually failed a much simpler relabeling exercise. Setting that aside, I still think the analogy is flawed.

The student is mid learning process and its entirely reasonable for them one to be relying on pattern recognition until they have fully internalized the subject. The model is fully trained and should thus have internalized their understanding of the subject.

Additionally the student can update their understanding when pattern recognition fails. The model is fully cooked and will never do more then pattern recognition.

Post reply on HN