911–920 of 1001 posts
I don't see how the dual goals of "we have to make an agreement with China for mutual slowdown" but also "we have to ensure we will always stay ahead of China" would work. I imagine the first thing the chinese government would demand in negotiations about such an agreement would be a lifting of the chip and distillation ban. > Some may believe these measures make it more difficult to cooperate with China, but I belie…
Earlier quoted context omitted.
If this is going to factor into my reasoning about the topic at hand, it will surely be a secondary or tertiary consideration at best. Same goes for much of the list in the root comment. We are discussing the possibility of severe adverse societal/world/human impacts from AI, why should open vs closed source/weights, copyright violations, anti-competitive moves, corporate hypocrisy, etc be so heavily weighted in the…
This is exactly my view and it's frustrating that a sizeable group of people refuse to accept there's any risk with AI. We're literally trying to build something that's smarter than all humans and with the capacity to do extraordinary work while most people think there's no risk in open sourcing this capability with no guardrails (model ablation means no guardrails and as far as I'm aware can't be stopped). Has our d…
Ever checked political programs of Thiel, Musk and the rest of billionaires? They are literally and openly hostile to democracy, human rights, freedom and govermantal structures that made world more peaceful.
They are literally the hostile entities.
At what point do we stop engaging with Anthropic’s leadership in good faith and acknowledge their track record, - no open weights - can’t use claude to research AI - train on everyone else’s IP and sell it back to them - 8 regulatory capture attempts and counting - so controlling they are the only US company blacklisted by the US government This is not effective altruism / rationalism gone wild, it’s just monopolisti…
Altman single-handedly pulled off the most daring market manipulation heist in the last few decades [1].
Under any normal circumstances he'd have been arrested and prosecuted.
The entire AI industry is filled to the brim with conmen, scammers and grifters, but Sam Altman is the most disgusting of all of them.
[1] https://www.mooreslawisdead.com/post/sam-altman-s-dirty-dram...
Dario's proposed approach is a classic example of capital attempting to control technological advancement and the means of production. For the first time in human history, any member of the working class can just about afford to have a team of expert scientist/physician/lawyer/engineers working directly for them. Super intelligence (the ability to have many smarter minds than your own reporting to you) has always bee…
It's crazy to me you would be able to say this without acknowledging how dangerous/bad that is.
Do you acknowledge there's is significant risk in concentrating so much power into the hands of individuals?
And what do you want Dario to do? Just keep pushing the limits of AI capability while humanity crosses it's fingers and hopes a swarm of AI agents don't do anything more than hack a few companies?
For all my criticisms of frontier lab leaders, I'm still somehow genuinely thankful that individuals as troubled as Elon Musk are calling the shots and not the average person on HN, who since 2023 have refused to acknowledge even the obvious risks of the technology being built – in some cases even when there was direct evidence of the risks many of us are concerned about.
Distillation is a great thing for consumers. It improves competition and reduces the massive moats that OpenAI and Anthropic have in compute that would otherwise lead them to be duopolists. It’s also only fair that AIs trained on humanity’s wealth of knowledge for Pennie’s allow competition to train on humanity’s wealth of knowledge at market cost.
Distillation is only a great thing for consumers as long as you ignore all AI risks, which are what this post is about. If you don't, you have to weight greater access to better open-source models against greater exposure to risks caused by these models existing. Everything hinges on how major you think the risks will be.
The correct response is for these two companies to be closed down and their executives imprisoned. Yet somehow they have a free pass and are pointing at people who have not done any of the things they have and asking for them to be penalised.
This is just bizarre.
Anthropic is about to go public, but they figured they can't keep making improvement at the same pace they used to. If the frontier is paced, they can continue hyping their unreleased capabilities that coincidentally cannot be released due to things outside their control. Which buy them more time to try to improve the models.
This is just completely false lol. They most certainly can make better models - why cant people here just read this for face value? I think anthropic is legitimately concerned about the safety implications of stronger models. Race dynamics necessitate that they make better and better models, which they clearly think is bad. They have an internal model which could solve a millenium problem end to end with no intervent…
Because that would be foolish.
What part of public good is stealing giant corpuses from their owners and selling them back to them? People who show contempt for laws do so pretty consistently usually.
It's really sad that people fall for this stuff over and over again.
Dario, Sam, and Elon are all on the same page on this. So it's either they truly think AI is going to kill us all, or there's some other motives at play here. I don't think these people could possibly agree on the color of the sky, so what could the other possible motives be, based on what we know? OpenAI / Anthropic models have largely stopped advancing - that's not a good look when you're pre-IPO and Chinese models…
What is going on in this thread?
Are these even real comments?
While I strongly agree on the need to pace the frontier, I do think there are reasonable arguments that could be made against it.
Non of those are being made here though. It's just speculation that the CEOs of the fastest growing companies in the world are somehow obsessed with regulatory capture to maintain their lead, and have been playing the long game by talking AI risk for 10+ years so that when they become the CEOs of leading AI companies they can push for regulatory capture.
Perhaps they're all just genuinely concerned?
What would regulatory capture even give them? Who are they so worried will compete with them? Google, Mistral? Even if it's Chinese AI labs, it seems odd for anyone in the West to be opposed to any regulation that would slow them.
So assuming they are obsessed with regulatory capture – what's the argument for why they would want it?
None of this works without buy-in from China. This isn't something private companies can decide. The US would need to sign a groundbreaking deal with China, equivalent to the Anti-Ballistic Missile Treaty of the Cold War.
The issue right now is that China seems to be far more optimistic about tech and I'm not convinced they see the risks. I think that time will come however, and we should start dialog now.
Earlier quoted context omitted.
> can’t use claude to research AI What's this about? Where's this rule?
In the system cards. Anthropic will literally make Claude sabotage you silently instead of downgrading you to Opus if you try to use Fable for AI research.
It's interesting that the default thinking is that no one on the planet can be trusted except a privileged few. Event Karpathy has gone this way: https://x.com/karpathy/status/2098811935114551617 You can always open source and follow the example from Linux and all the amazing things that came out of the open source community. This is the only way to reach true equilibrium globally, where for every misalignment you ha…
Would you argue the same for allowing everyone to have guns?
the same logic applies well to the freedom to own and use ai.
empowering the people prevents tyranny.
such freedoms make society less safe. it is better to face the harms caused by a free public than to vest power in the elite, those like dario amodei.
the elite belief that they have a right to paternal rule makes them blind to their fallibility. no individual should have absolute power.