Viewing profile — tsurba

And so animals wouldn’t be conscious because they don’t use language? If so, I vote that the stupidest hypothesis of the year. Or would one count any communication between animals …

Joplin is open source, syncing setup between devices is one login to Dropbox, works for free, with native apps on Windows/OSX/Linux/iOS/Android. It has a bunch of plugins too. If y…

True, good point, maybe not a straightforward consequence to extend to weights.

Many discriminative models converge to same representation space up to a linear transformation. Makes sense that a linear transformation (like PCA) would be able to undo that trans…

Edit: actually this paper is the canonical reference (?): https://arxiv.org/abs/2007.00810 models converge to same space up to a linear transformation. Makes sense that a linear tr…

You can show for example that siamese encoders for time-series, with MSE loss on similarity, without a decoder , will converge to the the same latent space up to orthogonal transfo…

But are we close to doing that in real-time on any reasonably large model? I don’t think so.

I agree with everything up until the AI part, and for that part too, the general idea is good and worth worrying about. I’m scared af about what happens to kids who do all their ho…

Thankfully in the EU you are not even allowed to sell sunglasses without proper UV protection, and can just pick up sunglasses from any market and trust they are fine, if a little …

And how long have you been doing this? Because that sounds naive. After doing programming for a decade or two, the actual act of programming is not enough to be ”creative problem s…

Gambling is where I end up if I’m tired and try to get an LLM to build my hobby project for me from scratch in one go, not really bothering to read the code properly. It’s stupid a…

Is it a puzzle if there is no algorithm? But testing via coding algos to known puzzles is problematic as the code may be in the training set. Hence you need new puzzles, which is k…

I would argue the other way around. I have ADHD, but the thing that really helped me with work procrastination, which I think would help even without ADHD, was to find a job that i…

1.5-2 years ago I did some training for a ML paper on 4 AMD MI250x (each is essentially 2 gpus so 8 in total really, each with 64GB VRAM) on LUMI. My Jax models and the baseline Py…

Yet somehow chatting with Gemini in the web interface, it forgets everything after 3 messages, while GPT (almost) always feels natural in long back-and-forths. It’s been like this …

I do machine learning research and it is very useful for working out equations and checking for ”does this concept already have an established name” etc. It is also excellent for w…

OSS alternatives with free syncing to your chosen cloud already exist, and have plugin systems. Why not just contribute to those? Because this is either advertising or procrastinat…

Or use Joplin which is open source and also creates markdown files, and setting up sync to a cloud provider that you probably already have is free.

Just use Joplin, it’s open source and syncing to many cloud providers you already probably have is free.

And going to a grocery store instead of 37 individual farmers…?

Nice that someone realized then already it sounds sus https://news.ycombinator.com/item?id=42128532

Probably why they tried to address it in the abstract already

I guess SO was quite useful for providing a lot of training material for technical question answering for LLMs? I don’t think they got compensated for it so that is a bit sad. In t…

The best thing to feed the podcast is a dump of all one-liner macros we’ve added to an IRC bot over 15 years (for fetching weather, stocks, and 99% stupid jokes) without any contex…

Good art is not going out of fashion. Tools may change but part of an artists job is to adapt. For example, when you learn instruments you also train your ear and taste. These are …