Hmm, so the guy who said more data and compute will outperform any adhoc heuristics has shared a three step adhoc heuristic?
Rich Sutton on AI creativity and discovery
91–100 of 141 posts
Re: Rich Sutton on AI creativity and discovery
#92Earlier quoted context omitted.
No art is a means of expression - the creator uses an object as a vehicle to capture and distribute an expression. Also lol @ using Wikipedia as some source of absolute truth.
yeah, a bet a random HN-er definition of Art is much more reliable than Wikipedia
[flagged]
Re: Rich Sutton on AI creativity and discovery
#93Earlier quoted context omitted.
Note that all fusion energy is unsustainable as it irreversibly turns water into helium.
We do have a LOT of water though. And surplus helium would be nice.
We also have competitive energy wasting (bitcoin), that will translate into competitive water deleting which will greatly accelerate how quickly we burn through all of it.
Re: Rich Sutton on AI creativity and discovery
#94"So that is my call to arms. If we want the full power of AI scientists, then we should share the goals with them so they can create, evaluate, discover, and in these ways fully participate in achieving the goals. Let’s be bold! Let’s fully automate Creativity and Discovery!" Should we automate exercise and play as well? How about learning? The machine didn't have a soul, so we donated ours. Eureka! My AI found it!
It seems human beings spend a significant portion of their lives trying to figure out how to live as little as possible.
It seems like human societies are run by elites who convince the masses to live as little as possible so that the elites can fully enjoy themselves.
Like how during Covid the beaches were closed while the billionaires partied on yachts.
Re: Rich Sutton on AI creativity and discovery
#95"So that is my call to arms. If we want the full power of AI scientists, then we should share the goals with them so they can create, evaluate, discover, and in these ways fully participate in achieving the goals. Let’s be bold! Let’s fully automate Creativity and Discovery!" Should we automate exercise and play as well? How about learning? The machine didn't have a soul, so we donated ours. Eureka! My AI found it!
[dead]
Re: Rich Sutton on AI creativity and discovery
#96"So that is my call to arms. If we want the full power of AI scientists, then we should share the goals with them so they can create, evaluate, discover, and in these ways fully participate in achieving the goals. Let’s be bold! Let’s fully automate Creativity and Discovery!" Should we automate exercise and play as well? How about learning? The machine didn't have a soul, so we donated ours. Eureka! My AI found it!
I understand the skepticism. I am worried about the implications of AI as well. The deeper issue at stake is that the depth of scientific knowledge has been increasing for a very long time. Now you get to have a PhD in esoteric subproblems and that slows down research especially if the discoveries require depth in multiple subdomains. Socially and economically training people in every combinatorial combination of sub…
[dead]
Re: Rich Sutton on AI creativity and discovery
#97"So that is my call to arms. If we want the full power of AI scientists, then we should share the goals with them so they can create, evaluate, discover, and in these ways fully participate in achieving the goals. Let’s be bold! Let’s fully automate Creativity and Discovery!" Should we automate exercise and play as well? How about learning? The machine didn't have a soul, so we donated ours. Eureka! My AI found it!
I understand the skepticism. I am worried about the implications of AI as well. The deeper issue at stake is that the depth of scientific knowledge has been increasing for a very long time. Now you get to have a PhD in esoteric subproblems and that slows down research especially if the discoveries require depth in multiple subdomains. Socially and economically training people in every combinatorial combination of sub…
[dead]
Re: Rich Sutton on AI creativity and discovery
#98[dead]
Re: Rich Sutton on AI creativity and discovery
#99Earlier quoted context omitted.
He actually says the areas in which AI has had the novel successes are those which can be evaluated (like coding or Go). Not that it can’t happen at all.
That’s my point, he says ai does well where evaluation is neurosymbolically closed. But so do humans? How do humans make discoveries without having formal ways to evaluate? In my pharma drug example, humans could evaluate only because they had access to the physical realm. I can’t think of an example of humans evaluating a discovery in a way that LLMs can’t. can you?
[dead]
Re: Rich Sutton on AI creativity and discovery
#100Earlier quoted context omitted.
He's saying that pre-training an LLM alone can't do it, but if you run an LLM in a loop with tools (like any coding agent) then it can. Also, the technique his group came up with should be used more: > This is the weakness of deep learning that is alleviated with a new algorithm that my group presented in Nature a couple of years ago. Our “continual backpropagation” made one small change: every so often a less-used n…
Sorry this makes no sense — humans also use tools to evaluate their discoveries. Kant said something like this: knowledge can’t be obtained by pure thinking, it needs interaction with the world. This is obvious to me so why is the author making a claim that LLMs can make knowledge without access to environment but purely through thinking in aether
[dead]