Live data from Hacker News

Ask HN: What was your "oh shit" moment with GenAI?

news.ycombinator.com

961–970 of 1001 posts

Re: Ask HN: What was your "oh shit" moment with GenAI?

#961
post #429
post #344

Earlier quoted context omitted.

Yes, those tools are extremely good at reverse engineering. With a bit of know how, it is now trivial to reverse engineer any protocol or crack any software, often in a matter of hours or less. A lot of people in the industry have vested interests in this not being discussed openly so you don't hear too much about it, but the implications are huge.

What are some of the implications? Where does widely available mythos-level hacking lead? By people with a vested interest, do you mean non-cloud software vendors?

I think companies with valuable data to scrape (e.g. media companies) will eventually lock it behind APIs that verify Apple App Attest or Google Play Integrity. And deprecate websites which are easily scraped too. Then it will be useless to reverse engineer APIs used by apps and we will have to run the unmodified client on an unmodified OS.

Re: Ask HN: What was your "oh shit" moment with GenAI?

#964

I'm still waiting for a positive "Oh shit" moment regarding LLMs. I've had plenty of "Oh shit those people have really lost all ability to think for themselves" moments though.

This. Plenty of moments "Oh shit those people have really lost all ability to think for themselves" and not a single moment of "Oh shit" yet.

Re: Ask HN: What was your "oh shit" moment with GenAI?

#967
post #747

Earlier quoted context omitted.

This is an interesting read: https://ai-2027.com/ I'm not going to say it's a perfect prediction, but I do find the trajectory of "can write something reasonable" to "oh can write snippets of code" towards larger and larger systems feels like it's played out - the common thing I see more now is that people talk of "taste" that the humans are contributing more than the raw coding part. I get what you mean with this ra…

That was a “fun” read. Like Nick Bostrom’s Superintelligence [1]. [1] https://www.goodreads.com/book/show/20527133

A book that has been thoroughly discredited by actual events.

Re: Ask HN: What was your "oh shit" moment with GenAI?

#968
I had some code for the Servant type-level HTTP API library in Haskell that does type-correct property testing on arbitrary web apis without user input, then Servant changed their type structure from a basic list-based format to a record-based one. This was a good change for lots of reasons, but adding the type-level code to make my library (roboservant) compile was absurdly hard, i burned days on it.

GPT 5.something got it in two prompts.

Re: Ask HN: What was your "oh shit" moment with GenAI?

#969

Earlier quoted context omitted.

Do your students know their feedback is AI generated? A pre-AI example from the military : course reviews and performance assessments were changes to be from a set of about 70 descriptors instead of written custom. Instructors could modify them, but many didn't or did so only trivially. The system was junked in within three years because of the obvious: those giving feedback didn't own it, and those receiving feedbac…

Feedback is not AI generated, just structured grammar corrected and pasted at the right spot. I then review the output to see if it remains within what I meant to convey with my feedback. This is relatively simple feedback, I have 'highlight' and 'to improve' fieldsm, with a few sentences in each, very focused. If the feedback felt depersonalized or its meaning or tone changed I would fix it or not use this method. F…

Reviewing if generated feedback is within scope of what you'd give is not the same as giving feedback yourself. It is wildly different in fact.

Re: Ask HN: What was your "oh shit" moment with GenAI?

#970
It was gpt 3. I have it saved.

Me: write an original song about a cat drinking milk. Make it depressing death metal

GPT:

Verse 1 Doomed to drink milk, my life so trite A soulless feline, an empty sight My claws are sharp, my eyes grow cold I'm nothing more than a feral beast, so bold

Chorus Drinking milk, drinking milk The bitter taste of my utter defeat Drinking milk, drinking milk My broken spirit so incomplete

Verse 2 Slurping and spilling, I'm consumed with grief For my life is filled with nothing but grief I'm a caged animal, my spirit so frail How I long for the sweet taste of freedom to prevail

Chorus Drinking milk, drinking milk The bitter taste of my utter defeat Drinking milk, drinking milk My broken spirit so incomplete

Verse 3 A cat abandoned, a life in chains A lifetime of sorrow, a heart in pain A life of sadness, a death so cruel No escape from this endless cycle of doom

Chorus Drinking milk, drinking milk The bitter taste of my utter defeat Drinking milk, drinking milk My broken spirit so incomplete

Post reply on HN