Ask HN: AI Panic, you buying it?
31–40 of 59 posts
Re: Ask HN: AI Panic, you buying it?
#32They’re not giving any details about why or how. If they were the moral people they say they are, and believed what they say about it killing humanity they would stop unilaterally. These are the “rationalists” but they act like the fundamentalist church I grew up in. Every fact serves the same conclusion.
Yes, they are. https://www.anthropic.com/threat-intelligence-report-septemb... > Biological misuse is one of the most serious risks of frontier AI models. It has long been a concern that AI models might one day reach the level of capability where they can help to make existing pathogens more dangerous—or create entirely new ones. Without the correct safeguards, such capabilities could have catastrophic consequences.…
This is not AI waking up and deciding to merc us, which is what normies think we're talking about.
Re: Ask HN: AI Panic, you buying it?
#33Re: Ask HN: AI Panic, you buying it?
#34Re: Ask HN: AI Panic, you buying it?
#35The fact is that AI is incapable of living up to the hype and AI companies can't keep promising that any day now it's going to cure cancer and become self aware and be as smart as humans and let employers fire most of their staff. They know that isn't going to happen. They want to be able to blame the Slowdown for AIs continued failure to deliver while also claiming the Slowdown is needed because of how successful AI is.
That said, AI isn't harmless. It could be harmful to the internet since the flood of bots and slop could drown out the voices of real people. AI will be used and misused by companies and governments to screw over people and hide discrimination. People's air and water will become increasingly polluted while their already difficult to afford energy prices will go up. AI will enable new levels of surveillance and control at a scale that was never possible before and with a lot of false positives and negatives.
We don't need an "AI slowdown" so much as we need to rethink what we're really gaining in exchange for what it's costing us and what steps need to be taken to protect the public and make sure they get prioritized over private profits.
Re: Ask HN: AI Panic, you buying it?
#36I'm not panicking but there are very real risks. If you haven't looked at the stuff that has come out in the past couple of months (like the Huggingface hack and the Navier-Stokes solution) and/or you're dismissing it as marketing, you're grossly misunderstanding the current state of what's possible and what the potential of the frontier models deployed at scale is. Personally I'm finding it fascinating to follow, an…
Re: Ask HN: AI Panic, you buying it?
#37Re: Ask HN: AI Panic, you buying it?
#38For a while the hottest (stupid but still the only hot one) topic was crypto. We had this for quite a while. I believe this was because we hit walls left and right on how to progress further.
Then GPT-3 came out and made it very clear for a lot of capital and actors were it is going.
Machine Learning and types of it like LLMs need massive compute and massive amount of data.
So suddenly we discovered a way forward for optimizing and automating things no one thought would be possible: Software development and computer use and basically everhting digital. In parallel this Machine Learning push became relevant for robotics too. But LLMs delivered something fundamental to robotics: Language and a tremendesly good interface for humans.
Now we have a massive amount of capital in form of VC who wants to disrupt the next market. China is doing this with manufacturing, so what is left? Everything which was not touchable.
Now it is.
And it doesn't just allow for alot of automatistaion, it hits us were it hurts: Software bugs, security, fraud, scams etc.
It isn't just automatisation and getting more money, its also a weapon (CVEs, Statesecrets, propaganda, etc.)
So we don't have just a handful of VCs investing in this, we have the richest countries on the planet investing in this. We also have the fastest moving companies investing in this. The best connected ones, with a massive amount of very smart people.
Google has massive compute, its own network around the globe and massivly overpayed smart people. Microsoft, Amazon and even Meta has crazy amount of money too.
Then we have state actors like USA vs. China vs. hust Europe.
I also have never seen any technology progressing that fast. Image generation was unthinkable, now we can generate whatever we want. Video? Can now be done in real time. Text? No brainer.
GPT Astra can use Blender very very well and that only after 6 years of progress.
These 'stupid' LLMs reduced already the price of making Websites, basic 3D models, basic research etc. basically free in comparision.
So now we ned to find back to your question about eliminiating humanity: We have seen unrest in the last few years for a lot of basic human reasons. We as a plent are rich enough to take care of everyone on our planet. we do not do that thats why unrest can happen very fast.
In the USA alone A LOT of people have weapons. Around the globe people will unrest due to fuel shortage, disruption of supply chains etc.
We have state actors like Isreal who tried to attack Iran with Stuxnet, we have Russia which manipulated the elections of Europe and USA. We have high inflation, oil crisis.
And now we have a very fast moving and progressing technology which will add fuel to it and might eliminate quite a lot of white collar jobs. This will lead to more pressure on blue collar jobs.
We as a society are very bad in acting fast and the industrial revolution was, at that time, very bad for a lot of people.
There is only one russia necessary running GPU clusters of uncensored LLM model to start pushing boundaries left and right. One Isreal doing something fucked up or one Donald Trump.
Software is very shitty in a lot of places and the most complex thing we humans manage. A lot of shit wasn't found or solved because of the time and effort and people needed to find it.
Now the last Ubuntu LTS had over 900 CVEs, my own systems were attackable 3x this year already.
I don't want to say it will happen, but I do think we should be very careful of how we progress and for a lot of people the next 5-30 years will be very very disruptive. It is already disruptive to 'others' we might not count but let it be clear: all of these people who lost their jobs to AI already, it counted for them.
Re: Ask HN: AI Panic, you buying it?
#39Re: Ask HN: AI Panic, you buying it?
#40I don't consider this a "yes/no" question. It seems quite clear to me that the idea of "AI doom" is neither certain (100% probable) nor impossible (0% probable). The question is where on the continuum is the truth. And I don't know. And I'm pretty sure nobody else does either. That said, there are plausible scenarios where AI can cause great harm, even if it doesn't extend to "eliminating all humanity". So I don't re…
What is the concrete scenario that is based on reality which results in the percentage increasing above zero?