Live data from Hacker News

Ask HN: AI Panic, you buying it?

news.ycombinator.com

51–59 of 59 posts

Re: Ask HN: AI Panic, you buying it?

#52

I'm not panicking but there are very real risks. If you haven't looked at the stuff that has come out in the past couple of months (like the Huggingface hack and the Navier-Stokes solution) and/or you're dismissing it as marketing, you're grossly misunderstanding the current state of what's possible and what the potential of the frontier models deployed at scale is. Personally I'm finding it fascinating to follow, an…

What are the upsides? I’d like to feel excited too.

Check out the story about the personalized cancer vaccines. I think AI stands to play a significant role in enabling things of that sort going forward.

https://www.pymnts.com/healthcare/2026/modernas-ai-built-can...

https://news.unchealthcare.org/2026/09/unc-lineberger-secure...

Re: Ask HN: AI Panic, you buying it?

#53
post #43

Earlier quoted context omitted.

What's the difference?

genAI companies have, I believe, ill intent for us all. They are concerned with amassing wealth and power for themselves at the expense of ourselves and society. They are immoral. genAI is a tool without any intention. It is amoral. I'm not saying that genAI is harmless and the dangers can be ignored. I'm just saying that the dangers of the tool don't rise to the level of human extinction. That notion is something th…

I'm not going to argue with you on each point, just wanted to say that you're ignoring the very real possibility of large scale incidents which result not from ill will but from negligence or from not fully understanding the risks. The idea that the AI is just sitting there being neutral and it does whatever they ask it to do doesn't match with the events from the past few months.

Re: Ask HN: AI Panic, you buying it?

#54

I don't consider this a "yes/no" question. It seems quite clear to me that the idea of "AI doom" is neither certain (100% probable) nor impossible (0% probable). The question is where on the continuum is the truth. And I don't know. And I'm pretty sure nobody else does either. That said, there are plausible scenarios where AI can cause great harm, even if it doesn't extend to "eliminating all humanity". So I don't re…

What is the concrete scenario that is based on reality which results in the percentage increasing above zero?

You have poor epistemics if you are still assigning exactly 0% probability given developments of late.

Re: Ask HN: AI Panic, you buying it?

#55
post #32

Earlier quoted context omitted.

Yes, they are. https://www.anthropic.com/threat-intelligence-report-septemb... > Biological misuse is one of the most serious risks of frontier AI models. It has long been a concern that AI models might one day reach the level of capability where they can help to make existing pathogens more dangerous—or create entirely new ones. Without the correct safeguards, such capabilities could have catastrophic consequences.…

This is just a fear of technology. We will discover the same technology without AI, eventually. This is not AI waking up and deciding to merc us, which is what normies think we're talking about.

Terrorists exist. Covid happened.

Re: Ask HN: AI Panic, you buying it?

#56
No. AI is far too compute and energy constrained to exist outside humanity's control. AI is not scaling in such a dramatic way that it could happen soon. It is more likely than not that there are physical limits that neither we nor AI will be able surpass.

The damage AI is causing to society is real and happening now. Potential doomsday scenarios are a distraction from the real harm AI companies are doing at this very moment. They have amplified nearly every asymmetry and turning into mulch whatever was left in trust we had in society. Disinformation is now more convincing than ever. Computer security threatens to become a fiasco, only available to those who can pay the AI mob (the very same people who pioneered the tools attackers use). The entire intellectual property of humanity has been plagiarized without compensation to build these things. Every day more and more is asked of workers for the same compensation. Academic work is sniped at best and outright stolen at worst. Education has become a disaster with students unable to pass the same competency walls as students even just five years ago. Not to mention the environmental damage.

I'm not saying that the technology isn't impressive. I'm just saying its suspiciously convenient that we're suddenly focussed on some potential future big bad done by a vague uncontrolled AI when the harm is here now and under the purview of humans.

Re: Ask HN: AI Panic, you buying it?

#57

If you look around I don't think we're at the point where even if AI go rogue it could just disrupt us for a while. No real major concern to humanity but yeah I guess having rules and regulations would be plus point. So for now there shouldn't be anything to panic about.

Agree. Ais gone rogue now could be bad, but not humanity-ending bad. Just a hiccup. Of course if it somehow ends with human deaths then even if one human dies because of a rogue AI, that's a failure. But I can't imagine rogue AIs with enough real world power to harm humans in some way. What I do believe however is that humans will find a way to do harm with AI without AI going rogue, as with any other thing humanity…

Fair Point and to be honest what we should be worried about the AI being in wrong hands. And yeah of course I agree with proper rules and regulations how the AI company approaches about training and maintaining those models would make a huge impact in this and those rules should be tough like no gaps and blurring lines.

Re: Ask HN: AI Panic, you buying it?

#58
post #32

Earlier quoted context omitted.

Yes, they are. https://www.anthropic.com/threat-intelligence-report-septemb... > Biological misuse is one of the most serious risks of frontier AI models. It has long been a concern that AI models might one day reach the level of capability where they can help to make existing pathogens more dangerous—or create entirely new ones. Without the correct safeguards, such capabilities could have catastrophic consequences.…

This is just a fear of technology. We will discover the same technology without AI, eventually. This is not AI waking up and deciding to merc us, which is what normies think we're talking about.

No, previously a single person could effect only a single person's worth of terror. Now, a single person can effect thousands or hundreds of thousands of 'persons' effort towards terror.

This isn't really a fear of technology, it's a fear of one person being able to harness an entire country of geniuses towards some bad end.

Re: Ask HN: AI Panic, you buying it?

#59
post #32

Earlier quoted context omitted.

This is just a fear of technology. We will discover the same technology without AI, eventually. This is not AI waking up and deciding to merc us, which is what normies think we're talking about.

No, previously a single person could effect only a single person's worth of terror. Now, a single person can effect thousands or hundreds of thousands of 'persons' effort towards terror. This isn't really a fear of technology, it's a fear of one person being able to harness an entire country of geniuses towards some bad end.

Not now, no.

Maybe in your imagined future.

Post reply on HN