Viewing profile — hackpert

We found evidence of specific layer-localized "reasoning" circuits in a few models last year too! A very much work-in-progress paper is here: https://openreview.net/forum?id=mTjGBr…

Huh there is so much limonene in Coca Cola?! Limonene works as a very good…pesticide and herbicide! I did a research project on limonene like 10 years ago with my mentor and it out…

These metaphorical database analogies bug me, and from what it seems like, a lot of other people in comments! So far some of the most reasonable explanations I have found that take…

Hi! Did you ever end up running this reproduction? If yes, could you also check if the Putnam/IMO problems are in the training data perhaps by trying to have it complete the proble…

O

If anyone else is curious about which ARC-AGI public eval puzzles o3 got right vs wrong (and its attempts at the ones it did get right), here's a quick visualization: https://arcag…

Sorry never mind! I wasn't thinking at all when I wrote that thought, but that obviously doesn't make sense :)

That's fair but what if you could estimate the direction of incoming light with other sensors? Using inverse diffraction etc. Just a thought

Hi! I've been working on theorem proving systems for some time now. I would love to help out with an AlphaProof reproduction, but I can't reach you on discord for some reason!

Thank you, those insights are invaluable! This is a specific and potentially dumb question and I completely understand if you can't answer it! The practical motivation for MoEs is …

I'm not sure how to quantify how quickly or well humans learn in-context (if you know of any work on this I'd love to read it!) In general, there is too much fluff and confusion fl…

There has been some interesting work when it comes to distributed training. For example DiLoCo ( https://arxiv.org/abs/2311.08105 ). I also know that Bittensor and nousresearch col…

I tried to do this ages ago in 2018 by adapting OpenAI's flow architecture and it sort of seemed to work (was at least promising). With today's models with a significantly more dis…

Wow I had hoped for a more productive discussion than these 1-1 comparisons of Bard vs ChatGPT that I'm seeing everywhere. The model deployed with this version of Bard is clearly a…

I've been using Metaphor for a few weeks now and have almost entirely switched from Google and other search engines. Keyword based search simply doesn't come close when it comes to…

Right, but doesn't that mean that it could potentially be used for designing algorithms that have componentwise numerical stability over some kind of floating point standard, but t…

While your point about numerical stability is correct in general, there are no numerical stability issues here and I think this conception, which I've seen in more than one place n…

UPI's penetration in (urban and semi-urban anyway) India is honestly incredible. I worked with/on the tech when it was very nascent in 2016 and in 2022, on visiting India after a l…

That is actually pretty freaking cool. Not hard to do by any means, just cool.

x2go works quite well actually. Its definitely not like local but it does the job.

A similar thing happened to me and my partner in the US, in a fairly liberal part, so I'm not entirely surprised that it's happening in SEA. People wouldn't rent to us because we t…

Honestly! This is such a good initiative that it bothers me that this is flagged. Housing issues for queer people is one the biggest issues across the world. I mean the first thing…

Ooh good recommendation, lobste.rs is cool. I've been looking for someone with a potential invite for a while too if anyone here is offering :).

About the bit regarding you possibly commuting from Paris to London for work, I'm curious - how would that even work? Would you go through customs every morning/evening? Has anyone…