Live data from Hacker News

I am retiring from fulltime writing (& pseudonymity) to launch Guardian Angel

twitter.com

71–80 of 264 posts

Re: I am retiring from fulltime writing (& pseudonymity) to launch Guardian Angel

#71

Their profile specifically says they will not acknowledge follow requests, but they only share posts with followers. As such, not sure what the value of the top level link is.

And Twitter has a lovely

> Something went wrong Try reloading. If the problem persists, please try again later.

Modern social media :(

Re: I am retiring from fulltime writing (& pseudonymity) to launch Guardian Angel

#72
post #41

A few snippets from his full post here: https://gwern.net/guardian-angel . > "The chatbot personas are deeply misaligned with you, and aligned with their owners; and the economic incentives are to farm you with ads and subscriptions, while racing not to amplify you but to replace you." > "On my visits to the Bay Area, I would ask AI researchers or interns why they are doing their current research or projects, when in…

Leaving AI completely aside, it still amazes me that people finds "novel" the idea of removing highly-paid white collar intellectual workers (software developers or otherwise) completely out of the loop. No-code platforms date back to the 80's. Getting rid of engineers in general is even older [*]. Even relational databases and SQL were initially promoted as "ways to get rid of those expensive programmers to access y…

It's novel because previous rounds of automation were about automating specific tasks or well-scoped functions. There was always an implicit understanding that the white-collar worker would be freed to spend their time on more valuable, higher-level problems. But this time is different because of the generality of the technology. Agents promise to automate the process of thinking itself. And in many domains they can learn new tasks as fast as white-collar workers can find them.

Re: I am retiring from fulltime writing (& pseudonymity) to launch Guardian Angel

#74
post #41

A few snippets from his full post here: https://gwern.net/guardian-angel . > "The chatbot personas are deeply misaligned with you, and aligned with their owners; and the economic incentives are to farm you with ads and subscriptions, while racing not to amplify you but to replace you." > "On my visits to the Bay Area, I would ask AI researchers or interns why they are doing their current research or projects, when in…

Leaving AI completely aside, it still amazes me that people finds "novel" the idea of removing highly-paid white collar intellectual workers (software developers or otherwise) completely out of the loop. No-code platforms date back to the 80's. Getting rid of engineers in general is even older [*]. Even relational databases and SQL were initially promoted as "ways to get rid of those expensive programmers to access y…

How many people here started writing code because of no code Drupal?

Re: I am retiring from fulltime writing (& pseudonymity) to launch Guardian Angel

#75

LLM psychosis claims another victim... A reminder for anyone reading this: talk to people. Real humans[1]. They will remind you there's more to life than what ChatGPT can offer you. They might even remind you, for all their stupidity and flaws, what intelligence looks like as compared to a program that predicts tokens. Forums like these always get philosophical in high-minded discussions about intelligence, but there…

Did you even read Gwern's Guardian Angels post? It literally describes the concern pointed out here, that the large consumer models are not aligned with users' interests. If anything, I would argue that Gwern has maximal AI Lucidity, given everything going on.

> It literally describes the concern pointed out here, that the large consumer models are not aligned with users' interests

Did you respond to the wrong post? I said nothing even remotely in that realm, so it's strange to see "did you even read" in response to something you apparently didn't read.

Re: I am retiring from fulltime writing (& pseudonymity) to launch Guardian Angel

#76

(I'm not a part of GA.) I've known gwern for the better part of a decade. Working with him has been great. We've done quite a few projects together, including being the first ones to demonstrate that GPT-2 could play chess (or rather, can be used for actual useful work instead of just being an autocomplete). He's a great person. I've wanted to do a writeup on it for some time, but what surprised me the most is his hu…

I can nod along when I hear and read people talking about the dangers of these technologies and the endgame of their creators; and then suddenly very weird when everyone except me is nodding along that the answer must be similar (but different) technology! It's as if technologists are stuck in a room of mirrors, unable to imagine a world in which "solutions" don't ultimately just continue to feed technology's increas…

To a man with a hammer...

Re: I am retiring from fulltime writing (& pseudonymity) to launch Guardian Angel

#77

(I'm not a part of GA.) I've known gwern for the better part of a decade. Working with him has been great. We've done quite a few projects together, including being the first ones to demonstrate that GPT-2 could play chess (or rather, can be used for actual useful work instead of just being an autocomplete). He's a great person. I've wanted to do a writeup on it for some time, but what surprised me the most is his hu…

I can nod along when I hear and read people talking about the dangers of these technologies and the endgame of their creators; and then suddenly very weird when everyone except me is nodding along that the answer must be similar (but different) technology! It's as if technologists are stuck in a room of mirrors, unable to imagine a world in which "solutions" don't ultimately just continue to feed technology's increas…

[deleted]

Re: I am retiring from fulltime writing (& pseudonymity) to launch Guardian Angel

#78
post #38

It's hard to read Gwern's accompanying article without seeing this for what it is, which is a kind of mania. I'm sure he means well and is genuine in his aspirations, but what's outlined for GA is framing LLM's as quasi-gods, which they absolutely are not. I wish him the best, and look forward to being proven wrong.

It really underscores how rationality is just another religion

Re: I am retiring from fulltime writing (& pseudonymity) to launch Guardian Angel

#79
post #46
post #38

It's hard to read Gwern's accompanying article without seeing this for what it is, which is a kind of mania. I'm sure he means well and is genuine in his aspirations, but what's outlined for GA is framing LLM's as quasi-gods, which they absolutely are not. I wish him the best, and look forward to being proven wrong.

An LLM just solved 10 top tier math problems this week. It seems very likely that in 6 months they will solve 100 top tier math problems, maybe 1 millenium math problem, maybe 10 top tier physics problems, etc. It's only going to get crazier.

Suppose LLM solved all math problems. So what? It’s not like diplomacy and war will end. Are humanity’s problems really constrained on our intellectual ability? If anything most evidence points to cultural failing and all AI will do is enable unprecedented oppression due to said skills at intellectual tasks.

As you read this some poor person is starving. Humanity already possesses the ability to identify said person and send them aid. How is AI going to help here?

The ultimate fallacy is that all technological progress will benefit mankind. That will be true until it is not.

Re: I am retiring from fulltime writing (& pseudonymity) to launch Guardian Angel

#80
post #46

Earlier quoted context omitted.

An LLM just solved 10 top tier math problems this week. It seems very likely that in 6 months they will solve 100 top tier math problems, maybe 1 millenium math problem, maybe 10 top tier physics problems, etc. It's only going to get crazier.

Suppose LLM solved all math problems. So what? It’s not like diplomacy and war will end. Are humanity’s problems really constrained on our intellectual ability? If anything most evidence points to cultural failing and all AI will do is enable unprecedented oppression due to said skills at intellectual tasks. As you read this some poor person is starving. Humanity already possesses the ability to identify said person…

I have no idea if diplomacy and/or war will end, I just hope we humans get to hang around a few more years
Post reply on HN