Live data from Hacker News

Ask HN: What was your "oh shit" moment with GenAI?

news.ycombinator.com

651–660 of 1001 posts

Re: Ask HN: What was your "oh shit" moment with GenAI?

#651
post #175

Actually seems absurdly simple now, but sometime last year I was trying to figure out what I'd need to tow my daughter's car cross country with my truck: what are the trailer/dolly options, what do they cost, can my truck actually tow the combined weight, etc. I started out prompting ChatGPT kinda how I would with Google, one small prompt at a time, asking about various details. But after one or two of those I just t…

It very plausibly might have been totally wrong. Out of laziness I several times asked Claude and ChatGPT each some torque figures and other simple, hard data related to my dirt bike. They often got it completely wrong, but full of confidence every time. I never trust LLMs with hard data, unless you RAG the PDF into the context and even then it's sketchy.

It wasn’t wrong, though, in my case.

Re: Ask HN: What was your "oh shit" moment with GenAI?

#652

I worked in an AI (or well ML) consultancy before the ChatGPT moment. I remember we had a project where we had to extract a large sum of documents (country wide, terrabytes of pdfs of scans). We had to set up a pipeline that looked a bit like this. Download pdf of scan -> Tessaract to get a text layer -> Clean it up with a language specific BERT model -> detect paragraphs of a certain type -> Look them up against a d…

I'm pretty sure that "a ChatGPT call" will happily add or fudge stuff in your scanned PDFs. That sounds like a massive liability.

It's surprisingly robust and the quality is pretty good with the right prompt and quality gating.

Re: Ask HN: What was your "oh shit" moment with GenAI?

#654
Several. Yesterday a friend with no prior coding experience or knowledge showed me an app he initially built to help him study for public administration job positions. The exams for this positions are public (spain), but the tools are scarce, expensive or he did not like. So he used lovable, then switched to web gemini and claude, then paid claude. He now has +130 very active users on an initial free tier, while he figures out. The app is on github, runs on vercel with supabase, react, tailwind, bun... he has no idea what he is doing. I even installed claude code for him, got him an ssh key so he can do it locally, etc.

Another: claude code cracked for me some software that was calling a home that did not exist anymore via headless ghidra.

Another: I am a teacher, and qualifications and feedback is very very time consuming, specially in loose workflows with several sources and tools that are not connected. During class presentations I take loose notes. Now I have a local folder where I drop my 1 student list, with names and emails, 2 my loose notes, and 3 a qualification & feedback sheet model; then claude creates a sheet per student, formats and copies the feedback to the right sheet cell, waits for my corrections, then sends everything to their school emails. Much easier, much less time consuming.

Re: Ask HN: What was your "oh shit" moment with GenAI?

#655

I could go on and on, but Claude recently decompiled the firmware of my camper van, documented all the CAN interfaces, then programmed an ESP32 module to talk to the van’s integrated systems (power, HVAC, lighting, tanks). That sort of embedded systems integration is completely out of my wheelhouse. I honestly don’t understand AI naysayers. I use Claude every day both professionally as a Solution Architect and person…

> projects I simply could not have ever approached alone. I think that's part of the divide between enthusiasts and naysayers. If you use GenAI on things that you couldn't approach alone, it's an incredible tool. If you use it on stuff that you're pretty good at, it's not a gamechanger (and if you're an expert, it's a minor boost at best). Many people's job are about doing what they're an expert at.

The dangerous thing is when you’re a novice and can’t identify the BS. That’s why for people with “good” and “expert” skill, it’s not a huge boost. They can identify the BS, and what’s left is modestly helpful.

The highest danger in using AI comes precisely to people who stand the most to gain from it.

Re: Ask HN: What was your "oh shit" moment with GenAI?

#656
post #310

I bought an Alesis QS8.1 super cheap in perfect condition (was a top grade digital piano/synth in the 90s). and then i realized that ALL of the software (which i collected from defunct websites and archived on github) related to it was ancient and after a while of getting tired of using WINE every single time i decided i wanted a cross platform modern equivalent that did everything that several of these different pro…

Related story, while applying a firmware update to my Kawai CA49 piano, I bricked it due to flashing the wrong file (The process was broken, and I got desperate and tried something stupid, which bricked the piano). Claude walked me through looking for signs of life, and since OTA from the phone app wasn't working for me, it downloaded the Kawai Android APK, decompiled the Java, figured out the hardcoded key used for…

This is truly remarkable. Congratulations!

Re: Ask HN: What was your "oh shit" moment with GenAI?

#657
In 2017 I worked tirelessly with my colleagues to implement and replicate the first transformer paper.

Yesterday I left Opus 4.8 to go do some architecture research, with GPU access.

It replicated and trained a credible baseline. It implemented some ideas I'd been thinking about, and wrote custom CUDA kernels for them. It read and summarised dozens of related papers.

It has since run dozens of experiments, with minimal supervision. When a model is unstable it kills it, documents why, fires off a new configuration.

The realisation that frontier labs are doing this at scale with unlimited GPU and token budgets.

It actually scares me a bit. The realisation that the next big breakthroughs will only have light human involvement.

The prospect of recursive self improvement feels more to real to me all of sudden

Re: Ask HN: What was your "oh shit" moment with GenAI?

#658

Several. Yesterday a friend with no prior coding experience or knowledge showed me an app he initially built to help him study for public administration job positions. The exams for this positions are public (spain), but the tools are scarce, expensive or he did not like. So he used lovable, then switched to web gemini and claude, then paid claude. He now has +130 very active users on an initial free tier, while he f…

That said, I am very critical of AI, I align with voices and reports calling for AI companies to give back, as they took much, and for AI as public infrastructure, to an extent. I see datacenters as probably inevitably future public infrastructure, with a public model that could resemble that of electricity etc (in spain) or more public (less private). I am wary of the actual and future ecological and social impact of datacenter building and other problems AI is or will create. It is difficult to negate its usefulness, though: it is like having several very fast assistants with expert knowledge on several fields, that just get better every month. We will see.

Re: Ask HN: What was your "oh shit" moment with GenAI?

#659

Not sure, but I can tell you what my "oh s** astroturfing is so bad, it's even in Hacker News" moment. And if I learned GenAI was used to make some of the astroturf, that's more an "ah s* “ than an "oh s* “ thing. I mean, the prominence, ubiquity, and breathlessness. One out of three, sure. Two out of three, maybe. And some corpo shilling definitely happens here. But this is like, well, covering an entire area with a…

> Please don't post insinuations about astroturfing, shilling, brigading, foreign agents, and the like. It degrades discussion and is usually mistaken. If you're worried about abuse, email hn@ycombinator.com and we'll look at the data.

https://news.ycombinator.com/newsguidelines.html

Re: Ask HN: What was your "oh shit" moment with GenAI?

#660
Just a loose collection of not so much oh shit moments, but moments that changed the way I think about it as a tool:

- I asked Claude a question about an obscure game for which there wasn't a lot of discussion or information on the web. It couldn't find the answer but it found the source code and was able to figure it out and give a complete response.

- I needed to make some edits to a minified lottie file (json that is used to produce an animation in svg or other formats). ChatGPT was able to understand the file well enough to make the edits and reproduce the rest of the content exactly as it was.

- I was working on some map features and I needed to take geolocation information and position HTML elements on the edges of a container that would indicate which direction from the current location they were. This required a lot of geometry and math that account for rotation and pitch and would have taken me some time to work through, but it was just a few seconds for the language model and it worked perfectly.

- I have some petunias that I haven't managed to kill and I heard that when a stem breaks off they can be replanted. I asked it how to do this and after warning me that selling these could constitute a black market, it helped me start several petunia plants that are thriving. My petunias are basically immortal now.

I empathize with the astroturfing concern, I file almost every statement released by Anthropic/OpenAI as bullshit. But they are an amazing tool given the right circumstances.

Post reply on HN