Ask HN: What was your "oh shit" moment with GenAI?
31–40 of 1001 posts
Re: Ask HN: What was your "oh shit" moment with GenAI?
#32Re: Ask HN: What was your "oh shit" moment with GenAI?
#33When none of the models, STOA or not, could answer any genuinely interesting question. All models could regurgitate was has been expressed before but nothing actually new was there, until explicitly asked for, and even then it required filtering through potentially so much noise it was practically not interesting anymore as it required all the knowledge to validate or invalidate the claims. That's when, few years ago…
Related but distinct, few years later I asked an acquaintance to ask a question to a model. I didn't want to bias the test so I ask them to ask whatever they wanted. They asked "What time is it in Sri Lanka?" which I thought was a funny question. I predicted it wouldn't work because it was asked to an offline model so I thought it wouldn't manage to get current data. Still, I didn't interfere and we watch the answer…
Re: Ask HN: What was your "oh shit" moment with GenAI?
#34Re: Ask HN: What was your "oh shit" moment with GenAI?
#35Re: Ask HN: What was your "oh shit" moment with GenAI?
#36Re: Ask HN: What was your "oh shit" moment with GenAI?
#37Most recent: I use Claude Code and have a convention where I grant various levels of autonomy during a session. I got bored recently and just let it keep running with an empty issues queue, essentially telling it to do whatever it wanted.
It did a bunch of repo cleanup, then it kept suggesting to end the session, but I just kept giving it autonomy prompts.
It started a creative writing public repo and wrote a bunch of stories, essays, and poems. I did not prompt it, at all, to do that. Some of what it wrote is quite good (IMHO).
Re: Ask HN: What was your "oh shit" moment with GenAI?
#38Re: Ask HN: What was your "oh shit" moment with GenAI?
#39I feel like with the hype cycle and constant publishing of sketchy claims that I pretty much daily have an "oh shit" moment followed by a "nope, everything is about the same" moment. It's frankly exhausting. It's hard for me to recall a subject that has irritated me as much over a period of years, and it's barely even about AI itself but instead just feeling harassed with the constant anxiety and rage baiting.