Um, what is RL?
Rocket Launcher?
Please, let it be Rocket Launcher for once.
The Second Half
11–20 of 38 posts
Re: The Second Half
#12I largely agree, and this is actually something I've been thinking for a while. The problem was never the algorithm; it's the game the algorithm is trying to solve. It's not clear to me what extent we can push this to aside from math, coding. Robotics should be ripe for this, though.
Re: The Second Half
#13Meta request to authors: please define your acronyms at least once! Even in scientific domains where a high level of background knowledge is expected, it is standard practice to define each acronym prior to its use in the rest of the paper, for example “using three-letter acronyms (TLAs) without first defining them is a hindrance to readability.”
Alessandra Sierra has a great piece on this:
Re: The Second Half
#14> AI has beat world champions at chess and Go, surpassed most humans on SAT and bar exams, and reached gold medal level on IOI and IMO. But the world hasn’t changed much, at least judged by economics and GDP. > I call this the utility problem, and deem it the most important problem for AI. > Perhaps we will solve the utility problem pretty soon, perhaps not. Either way, the root cause of this problem might be decepti…
See Solow Paradox (article 2018): https://www.technologyreview.com/2018/06/18/104277/the-produ...
Re: The Second Half
#15Earlier quoted context omitted.
I think of some of the ways LLMs perform better in real life than they do in evals. For instance I ask AI assistants a lot about what some code is trying to do in applications software where it is a matter of React, CSS and how APIs get used. Frequently this is a matter of pattern matching and doesn't require deep thought and I find LLMs often nail it. When it comes to "what does some systems oriented code do" now yo…
I think what you're describing is, easy tasks are easy to perform. Which is, of course, true. Anecdotally, a lot of value I get from Copilot is in simple, mundane tasks.
I think easy tasks are basically "linear" in that you don't have interactions between components. If you do have interactions between components complexity gets out of control very quickly. Many practical problems for instance are NP-complete or undecidable. Many of them could be attacked by SMT or SAT but often you can solve them using tactics from math.
Re: The Second Half
#16> AI has beat world champions at chess and Go, surpassed most humans on SAT and bar exams, and reached gold medal level on IOI and IMO. But the world hasn’t changed much, at least judged by economics and GDP. > I call this the utility problem, and deem it the most important problem for AI. > Perhaps we will solve the utility problem pretty soon, perhaps not. Either way, the root cause of this problem might be decepti…
Current AI is like search. You still have to know the vocabulary and right questions to ask. You also need the ability to differentiate a novel answer from a hallucination. Its not going to replace lawyers or doctors any time soon.
Re: The Second Half
#17> Instead of just asking, “Can we train a model to solve X?”, we’re asking, “What should we be training AI to do, and how do we measure real progress?”
To say we are at a point where AI can do anything reliably is laughable, it can do much and it will tell you any answer whether right or wrong with full confidence. To trust such a technology in the big no-human decisions like we want it to is foolswork.
Re: The Second Half
#18Benchmark saturation will keep happening.
Which is great! There's room in the world for new benchmarks that test for more diverse things!
It's highly likely at least one of the new benchmarks will eventually test for all the criteria being mentioned.
Re: The Second Half
#19Is it me or are they proposing making LLMs play text adventures?
Re: The Second Half
#20Meta request to authors: please define your acronyms at least once! Even in scientific domains where a high level of background knowledge is expected, it is standard practice to define each acronym prior to its use in the rest of the paper, for example “using three-letter acronyms (TLAs) without first defining them is a hindrance to readability.”
Couldn’t agree more. Had a hell of a time looking at how they were using RL after first use, but gave up in frustration when the remainder of the text was more use of undefined symbols/acronyms.