Viewing profile — skinner_

No, that's not what this is. This is a warning to the LLM that coming back with partial results is not good enough. Take a grad student with a perfectly good understanding of what …

Okay, I'm not sure about the original one, but here is the prompt of a successful reproduction: https://aaronlou.com/jacobian_counterexample_prompt.pdf Obviously it is not random, …

> The prompt for the Jacobian conjecture was obviously not random. the search space is too big to just try all the combinations of 3 variable polynomials. Maybe the prompt containe…

> You can skirt around not reasoning in research math because so much of it is just extremely tedious symbolic manipulation. LOL

> You just know nothing about math and are happy to parrot bullshit AI salesmen are selling you. Not the parent poster here. I do know things about math. I wrote a few papers relat…

My use case is wildly different from CSS, HTML etc. I use numerical algorithms to solve problems in pure mathematics. AI models are now better than me and my colleagues at writing …

Also, if Claude had regurgitated a known solution, it would have come up with it in the first exploration round, not the 31st, as it actually did.

I think the nuanced take on Joel's rant is this: it was good advice for 26 years. It became slightly less good advice a few months ago. This is a good time to warn overenthuastic p…

Then I think you’ll like our project which aims to find the missing link between transformers and swarm simulations: https://github.com/danielvarga/transformer-as-swarm Basically a…

https://www.astralcodexten.com/p/in-search-of-ai-psychosis is very relevant, but the main reason I’m posting it here is that, unlike this paper, it takes the opportunity to build t…

I interpreted it loosely, as "be aware of the possibility, and stop looking at it at the first signs of issues".

100% frontpage-worthy! Frankly I was already bored with all those pelicans, and a bit worried that the labs are overfitting on pelicans specifically. This test clearly demonstrates…

That's very cool, but it's not an apples to apples comparison. The reasoning model learned how to do long multiplication. (Either from the internet, or from generated examples of l…

If being probabilistic prevented learning deterministic functions, transformers couldn’t learn addition either. But they can, so that can't be the reason.

> But which contributes more, they ask? Who gives a shit, really? Funding agencies? Should they prioritize established researchers or newcomers? Should they support many smaller gr…

My uninformed and perhaps overly charitable interpretation: he warned them they were going to be steamrolled, they built their product anyway, and now OpenAI is buying them because…

Amazing! I looked into your ADAM claim, and it checks out. Thanks! Now I'm curious. I you have the time, could you please follow up with the 'etc...'?

You dismiss parent's example test because it's in the training data. I assume you also dismiss the Sally-Ann test, for the same reason. Could you please suggest a brand new test no…

When you build a new model, there is a spectrum of how you use the old model: 1. taking the weights, 2. training on the logits, 3. training on model output, 4. training from scratc…

Normally it would answer with a number and an explanation. This one just asks it to skip the explanation so that string comparison can be used to evaluate it.

In your opinion, why did they choose the open source way instead of doing it in a military bunker? (Metaphorical not literal bunker.)

Greater totality of experiences than having read the whole internet? Obviously they are very different kind of experiences, but a greater totality? I'm not so sure. Here is what we…

Sure, these are standard problems, I’ve said so myself. My point is that my productivity is multiplied by ChatGPT, even if it can only solve standard problems. This is because, alt…

I work on very complex problems. Some of my solutions have small, standard substeps that now I can reliably outsource to ChatGPT. Here are a few just from last week: - write cvxpy …