171–180 of 264 posts
A few snippets from his full post here: https://gwern.net/guardian-angel . > "The chatbot personas are deeply misaligned with you, and aligned with their owners; and the economic incentives are to farm you with ads and subscriptions, while racing not to amplify you but to replace you." > "On my visits to the Bay Area, I would ask AI researchers or interns why they are doing their current research or projects, when in…
Earlier quoted context omitted.
An LLM just solved 10 top tier math problems this week. It seems very likely that in 6 months they will solve 100 top tier math problems, maybe 1 millenium math problem, maybe 10 top tier physics problems, etc. It's only going to get crazier.
>An LLM just solved 10 top tier math problems this week and 30 years ago a computer beat Gary Kasparov, if you'd listened to Hans Moravec you wouldn't be surprised that the first thing that gets automated is intellectual domain expertise. Things are going to get crazy when it can figure out how to walk into a random house a and brew a cup of coffee, not do math
(I'm not a part of GA.) I've known gwern for the better part of a decade. Working with him has been great. We've done quite a few projects together, including being the first ones to demonstrate that GPT-2 could play chess (or rather, can be used for actual useful work instead of just being an autocomplete). He's a great person. I've wanted to do a writeup on it for some time, but what surprised me the most is his hu…
ML Researcher surprised by caring about how ML research impacts people.
There’s never a lack of intending to do good in these buddy-buddy endorsements, but we see the world you have collectively wrought.
> As for GA itself, I think it's an ambitious idea worth pursuing. Imagine an LLM which actually sounded like you, and to an extent, thought like you. How much would you pay to have access to a smarter version of yourself? So the idea is solid, and early results seem promising from the samples I've looked at.
We’re in the deep end of the indoctrination now. Imagine that all the AI Cretin wishes come true—and we might as well since this hypothetical goes hand in hand with that vision—and AI is just superior in every way and you are a knowledge worker... what choice is there? There isn’t one, you just have to do it to keep up. I don’t know what you are enviosioning here, maybe a workday of embodying AI IQ and then going home to being Human IQ because the graciously paidfor by work commercial license is for work only.
Earlier quoted context omitted.
One of the example Gwern brings [1] is a GA as an agent for public discourse and political life, to bring your "set of values" to have an effect in solving society's issues, when you yourself don't have the time or energy to. I don't think it solves or reconciles with self-actualization, but, from a pragmatical point of view, it offers the promise of extending causally your set of views and philosophies to politics.…
> One of the example Gwern brings [1] is a GA as an agent for public discourse and political life, to bring your "set of values" to have an effect in solving society's issues, when you yourself don't have the time or energy to. I'm sorry, that doesn't sound meaningful. If I don't have the energy, I'd rather shut up than have a stupid "avatar" of me yell on the internet in the name of "bringing my values" or "particip…
Earlier quoted context omitted.
Yikes
this comment will be killed, i find it an apt response to the idea that enabling those who believe themselves to be good is more important than reducing wanton suffering
I'm genuinely not sure if you're referring to my comment or the one I responded to haha
Earlier quoted context omitted.
Three years ago, people were saying "LLMs just generate plausible-sounding text, they don't understand the notion of truth so they can't do verifiable work like math proofs."
They still can't. But very smart humans constructed ways to use the monkeys with typewriters (with a statistical advantage) to find correct answers to problems where they already knew how to verify the answer.
Earlier quoted context omitted.
this comment will be killed, i find it an apt response to the idea that enabling those who believe themselves to be good is more important than reducing wanton suffering
> enabling those who believe themselves to be good is more important than reducing wanton suffering I'm genuinely not sure if you're referring to my comment or the one I responded to haha
> ideally, we could find a way to empower people such that the minority who do care can make a big difference
is it a coincidence, that in your ideal world, you would be empowered, because you care, as evidenced by your testimony of things you do that make you think you care? in my ideal world, wanton suffering would be minimized, regardless as to the path it took to get there; requiring 1 specific path involving people who think they are good, demarcates our ideals.
Earlier quoted context omitted.
> One of the example Gwern brings [1] is a GA as an agent for public discourse and political life, to bring your "set of values" to have an effect in solving society's issues, when you yourself don't have the time or energy to. I'm sorry, that doesn't sound meaningful. If I don't have the energy, I'd rather shut up than have a stupid "avatar" of me yell on the internet in the name of "bringing my values" or "particip…
I don't know if this is really about the public sphere as ut exists today. I suspect that the core idea is more along of the lines that in a world where policy is made by artificial super intelligences, you will need your own ASI to advocate on your behalf if your convictions are to have any impact at all.
(I'm not a part of GA.) I've known gwern for the better part of a decade. Working with him has been great. We've done quite a few projects together, including being the first ones to demonstrate that GPT-2 could play chess (or rather, can be used for actual useful work instead of just being an autocomplete). He's a great person. I've wanted to do a writeup on it for some time, but what surprised me the most is his hu…
Call me obsolete, but I'd pay to interact with an intelligence that's as dissimilar to me as possible so I myself can grow from that interaction. The existing chatbots are already enough of sycophantic echo-chambers.
Earlier quoted context omitted.
Math is verifiable. LLMs will continue to make strides in such search spaces where all they need to do is try->verify->repeat. You can't train an LLM on how to end the war in Iran or Ukraine, nor how to solve hunger, nor climate change, etc. Real issues. And LLMs still suck at art and writing.
Yeah but... Both things are true. LLMs are doing things we would have considered absolute AGI god tier magic 5 years ago. They also still can't count to 100 yet.