Earlier quoted context omitted.
It's often simply misleading / bad writing. Here's one I just got about some crashes: "If the crashes stop, the factory overclock is marginal; run a small negative offset." This looks like it's saying: "If the crashes stop then we know the factory overclock is marginal." (This makes no sense.) What it's trying to say is: "If the crashes stop then we can run a small negative offset, because the factory overlock is mar…
I thought it meant "the factory overclock is marginal" in the sense of "borderline unstable"?
Fable 5.1 Solves the Cyphral Distich, a 370-year-old cipher
191–200 of 571 posts
Re: Fable 5.1 Solves the Cyphral Distich, a 370-year-old cipher
#192Quite intuitive. Let's heart those " just a next token predictor" cries now.
And yes, it is just a next token predictor.
Re: Fable 5.1 Solves the Cyphral Distich, a 370-year-old cipher
#193Quite intuitive. Let's heart those " just a next token predictor" cries now.
I never understand when people say that, isn’t it obvious that intelligence is an emergent phenomenon that could arise in different ways
LLMs are a great search tool. It searches connections in the collective human knowledge that humans have written down through all the years....
They are very good at it, and that is about it.
Re: Fable 5.1 Solves the Cyphral Distich, a 370-year-old cipher
#194> Historically, many of these problems were bottlenecked by human attention. Someone had to care enough to spend hours or days reading obscure material, testing unpromising ideas, tracing references, and trying things that might go nowhere I wonder how many of the recent results are due to the fact that very few looked at the problem to start with. Still great results, but the general impression is that it's more abo…
Yes, even many of the proofs seem to be extremely long and complicated. The Navier-Stokes proof is 57 pages of very dense math and a pretty crazy amount of code: https://github.com/openai/NavierStokesAndEuler/tree/main/Nav... Given the close relationship between compression and intelligence, I'm somewhat surprised at how poorly the cutting edge models do with being concise.
For Earth, the proof presented for NS is just our first attempt navigating from our previously known facts to the proof.
I expect we will be able to shorten it dramatically (most likely with human and AI insights), but I don't think we should read too much into the length. If you want a similar point of comparison, see the original proof (by humans) of Fermat's last theorem. It has been shortened significantly. This is normal.
Re: Fable 5.1 Solves the Cyphral Distich, a 370-year-old cipher
#195Earlier quoted context omitted.
If there is energy to be used, the system will use it because people always use power when it exists. AI can't do anything to stop it as it is both controlled by the powerful and has been trained on the tendencies of human beings to get ahead. If AI gives a person new capabilities, they'll use those capabilities selfishly, or even unselfishly but still causing harm because they're in an arms race. We don't need a rev…
Sort of. Today the energy companies trade (obviously) energy; imagine if they traded compute power instead; the use case for never-seen industrial clients is being built as we speak, and companies are actually purchasing directly production companies to meet demand; the reason this happens is because production is somewhat scarce (scaling up a grid used to be a decades project, not a years one - ask China), and the t…
I expect datacenter load has a similar sort of day to day demand curve as everything else. Consider for example global bandwidth use during work hours versus in the evening when people get home and pull up a streaming service.
Of course you can use more flexible tasks to demand shift but the same applies to the electric grid.
Re: Fable 5.1 Solves the Cyphral Distich, a 370-year-old cipher
#196Re: Fable 5.1 Solves the Cyphral Distich, a 370-year-old cipher
#197We found a cipher my dad had written as a child with no obvious key or anything. Chatgpt was able to crack it in 20 minutes and figure out the message, and we knew it was right because it mentioned names of children he went to school with.
[flagged]
Re: Fable 5.1 Solves the Cyphral Distich, a 370-year-old cipher
#198Re: Fable 5.1 Solves the Cyphral Distich, a 370-year-old cipher
#199Earlier quoted context omitted.
[flagged]
Caesar cipher is probably something even an untrained person could decode. Probably something more complex like a vigenere cipher that is still trivial to decode if you are at all familiar crptanalysis, but would look impossible to someone untrained.
And yes, I've taught 8 year olds how to crack Caesar ciphers...
Re: Fable 5.1 Solves the Cyphral Distich, a 370-year-old cipher
#200Earlier quoted context omitted.
That's what Terence Tao said in one of his recent videos about it. That what the LLMs can provide is scale that humans can't. The example he provided is checking many possible solutions in a short amount of time because they can review all the previous literature and, for example, rule out ones with errors. He was realistic and practical about it and said that the tools working this way can be very helpful for a huma…
But breadth first search combined with a good pruning/exploration heuristic has always been one of the field's (AI) main tools, so this certainly is not new.