101–110 of 117 posts
Earlier quoted context omitted.
> Be kind. Don't be snarky. Converse curiously; don't cross-examine. Edit out swipes. > Comments should get more thoughtful and substantive, not less, as a topic gets more divisive. > When disagreeing, please reply to the argument instead of calling names https://news.ycombinator.com/newsguidelines.html
[flagged]
> And what has grown is far more subtle, odd, and beautiful than science fiction prepared us for. They are not the cold, calculating robots we were promised. They are made from us, from our words—and, as the Holy Father observes, they remain in important ways mysterious even to those of us who train them.
That is so extremely well said. I gained a whole new respect for Anthropic through reading this.
Earlier quoted context omitted.
i don't know if it's intentional lying for hype or if they're just lost in the cult of AI sauce
Yeah I can't figure it out either. It's like watching pure madness unfold in front of you and there's nothing you can do to talk sense. I sometimes wonder if they're suffering from the exact same AI overexposure psychosis we've seen in some vulnerable people all along. They've anthropomorphized (or worse - they've deified) and are now living inside of the story rather than reality. I've never seen anything so bafflin…
That, and the cryptocurrencies, NFTs, and immutable contracts weren't blowing sunshine up your hindparts.
Earlier quoted context omitted.
If he says that it starts with him, it won't ring well because it doesn't structurally change anything and only looks like posturing. "I promise to be a good guy" doesn't convey anything meaningful.
I'm not sure why you worry about how Chris Olah appears to others. Talking is cheap, but even talk is better then the impotent call for "people outside."
> AI systems are not engineered the way a bridge or an airplane is engineered. We understand an airplane because we designed every part of it and we understand the physics that act on it. AI models are not like that. They are grown, on a structure roughly modeled after the brain, on an enormous inheritance of human thought and speech. > And what has grown is far more subtle, odd, and beautiful than science fiction pr…
In other words, the idea of a non-human, disembodied intelligent person is at least a category that exists for Catholics. And humans "co-creating" other persons with God is downright commonplace (in the Catholic view, that's how all humans come to be).
Whether humans could ever co-create a non-human, disembodied intelligent person with God (i.e., whether God would ever choose to do His absolutely necessary part in it) remains to be seen, but there's at least the theoretical framework to hold the question.
LLMs are software. They take inputs and produce outputs. What humans choose to do with those inputs and outputs is up to us. Getting the pope involved makes it all seem more mystical and magical than it is. And these remarks only further feed that delusion. Regardless of intent, it seems to just feed the AI marketing and hype.
"How can we ensure the gains of AI are shared globally? We do not have a mechanism for this" Somebody inform Anthropic about open models and research.
I use open models all the time, but they are anything but "safe". no amount of lab work can prevent someone from finetuning the released model to do unethical stuff (and its really easy to do this https://arxiv.org/abs/2502.17424 )
> AI development is concentrated in a handful of wealthy nations. How can we ensure the gains of AI are shared globally? We do not have a mechanism for this. It is an unsolved problem Kind of ironic given almost every AI lab except the one you started and work for actually done model releases to the public, some more "open" than others, but still something. Look around at what other companies are doing, Qwen/Alibaba…
However, I do wonder what the actual practical benefit of (let's say) older versions of claude having their weights released would be. If we're talking about the people of poorer nations, how are they going to use these? Aside the top 1% of those nations, no one there is likely to be able to run the model themselves. Sure, there could be companies that sell it cheaper than Anthropic but that still won't extend access to everyone. The average person, even in richer nations cannot afford a computer that can run claude sonnet 4 for instance.
On top of that you have what Anthropic gets made fun of for - one of their goals is to protect Claude from humans. They are the only AI lab that is showing concern for the AI's welfare. Now, it is debatable whether this is reasonable or not, but that concern would lead a company to be less likely to release their models openly.