Ask HN: What will be the first AI “incident”?

> zeroes everyone who doesn't like ice cream.

Probably exploited some Ben & Jerry's ads on the fridge to gain access to the firmware.

I don't think there will be any single large incident. Just one day we will wake up and notice that we are mostly communicating with AI, consuming things made by AI and being judged and controlled by AI. It will be gradual, first you will have voice assistants that get more and more useful, at the same time marketers and spammers start using more and more ai-generated materials. Then most help desks will be replaced by AI, etc. Once you find out that all the culture you engage with is made by AI and all your work objectives are set by AI it will be too late, there is no going back any more.

- FluLM : Using language model to generate, synthesize and evaluate new symptoms and variants in various flu strains. (Something like "Learning the language of viral evolution and escape" https://pubmed.ncbi.nlm.nih.gov/33446556/ )

- PornDiffusion : A tailored to your need addictive auto-generated sexy Chat-bot with videos sucking your time and soul like a Succubus version of "Her".

- Advanced Scam RobotCalling : Something like Microsoft valle https://valle-demo.github.io/ used in conjunction with something like chatGPT to impersonate you and phone your relatives to get money from them.

- Kompromat collector : As first generation AI model like chat GPT have been dubbed "bullshitter", there has been more research into identifying and mine true facts from data. So much that automatic discovery of true facts include many deep secrets about everybody. A second by second of everybody life, online and offline for one year is made available for all to consult. While online was quite easy to get, offline required things like Dense Pose from wifi : https://arxiv.org/abs/2301.00250 and data from SOLI devices combined and index into a Shodan like network, that you can use in natural language to instantly dig dirt on anybody.

- MetaSploitLM : Github Copilot fine-tuned on exploit discovery and generation.

- BubblePopper : Get out of your filter bubble thanks to custom recommendation engine : Humans filter bubble exists to avoid humans being overloaded by Data they have not yet grasped. Popping the bubble too fast in an addictive way can result in an epidemic of advanced cynicism tearing societies apart, especially once revealed that most conspiracies are true :)

- DeepNuke : Once the source code of the universe had been discovered by automatic discovery tools with open data from the LHC, it was realised that it is in fact quite easy to build a Cold Fusion Nuke from household items.

For "uncensorability", you might be thinking about other technologies, like Tor or IPFS. web3 is just web with ugly monkeys.

Interesting question but seems a bit short-sighted to be looking for some "incidents" when we can easily speculate that un-augmented humans may become essentially irrelevant within a generation. It is almost inevitable that eventually some group will start building fully autonomous AIs. And already some language models meet or surpass human abilities in some fairly general tests. Many Singularitarians will throw out numbers like 1 million or 1 billion times the intelligence of a human, which seems very fantastical and unfounded to me. But two times or even perhaps five times the intelligence of a human, and with some types of cognition that humans just can't do, seems totally plausible.