Live data from Hacker News

AI safety leader says 'world is in peril' and quits to study poetry

bbc.com

61–63 of 63 posts

Re: AI safety leader says 'world is in peril' and quits to study poetry

#61

I recommend reading the letter. Many of the comments here seem to have missed that the comment of "the world is in peril" is not referring to AI, but to the larger collection of crises going on in the world. It sounds to me like someone who realized their work doesn't match their goals for their own life, and is taking action. Maybe the cynics have a point that it is an easier decision to make when you are loaded wit…

And how exactly will studying (not even writing!) poetry address these crises? It's holier-than-thou bullshit written by a guy who has only gotten feedback from soulless status-seekers who were smitten by his position at Anthropic.

He wants to focus on community building (as stated in the letter), wouldn't you say that communities in developed countries have been hollowed out? It's also one of the most important aspects of humanity, we are community builders first, that's how we always survived.

Being atomised hasn't improved how meaningful our lives are even though we created a lot of technology going that way. Can you say we have more meaning in life by being splitted apart? We have lots of entertainment and things to keep us busy but for a lot of people gratification comes from doing things together.

As a personal anecdote: I've personally enjoyed much more my times during summer helping a community of friends to build houses in their land than any time I was just travelling around. I pass by their houses every few weeks, have dinner with them here and there, and feel extremely happy to see those people living in structures I helped to build together with them. It's much more meaningful to me than any software I helped to develop used by literal hundreds of millions of people.

The lack of community untethers people from being humans, you can clearly see that in anyone that is chronically online.

Re: AI safety leader says 'world is in peril' and quits to study poetry

#62
post #5

Earlier quoted context omitted.

Exactly. If he cared that much he could quit and live off of his millions trying to help mitigate the damage by informing the public of what is pending and ideas on how to push back.

A poet can't inform people of things? Seems like a weird take. Poets, musicians and artists have a very long history of inspiring and contributing to movements. Some successful, some not successful. Sometimes heeded and other times ignored until it was too late. But to say being a poet is not trying to inform people is ignorant at best, and is a claim that will need evidence.

> A poet can't inform people of things?

Sure, back in ye olde thymes. Things are different in the attention economy and messaging has to be crafted to the audience it serves.

Re: AI safety leader says 'world is in peril' and quits to study poetry

#63

> his contributions included investigating why generative AI systems suck up to users Why does it take research to figure this out? Possibly the greatest unspoken problem with big-coporate-AI is that we can't run prompts without the input already pre-poisoned by the house-prompt. We can't lead the LLM into emergent territory when the chatbot is pre-engineered to be the human equivalent of a McDonalds order menu.

I find your belief that what is needed for emergence is better prompting … amusing.

The ai would still be sycophantic even without the pre-prompt. It’s been reinforced to do so, it’s baked in the weights.

Post reply on HN