Viewing profile — kadushka

Cost is absolutely an issue here - my time is worth approximately $1000/day, so if a slightly worse model wastes one more hour of my time a day than the best model, it costs the co…

Opus 5 and 5.6 Sol are definitely not smart enough to do my job. They require constant supervision. So why would I want to switch to even worse model? Even if it's just slightly wo…

How would this work? Where do the money for their pension fund come from? Would taking money from it result in them receiving smaller pensions?

Most quant papers I've seen usually report non-trivial degradation on standard benchmarks, like 1-10% degradation (compared to FP16/BF16). Especially when using 4 bits or lower. Fo…

models are getting weirdly good at hacking while still sort of sucking at a bunch of economically valuable tasks like most human hackers

taser/pepper spray within 5 years, firearms within 10.

We are surrounded by black boxes we depend on - have been for at least a century.

Probably had a lot of meetings

1. If you have good results on sufficiently large models (check latest papers re: which benchmarks are still relevant), post them on Github, along will detailed instructions how to…

I'm not interested in gaming, but if you had a version for AI, I'd be using it!

Diffusion models are not autoregressive but have the same limitations

Imagine that we made an LLM out of all dolphin songs ever recorded, would such LLM ever reach human level intelligence? It could potentially reach super-dolphin level intelligence

I'm an employee, and my boss loves me because I deliver things he wants quickly and reliably - because I use AI tools. Guess who he will keep in the next round of layoffs?

I'm serious - the productivity boost I'm getting from using AI models is so significant, that it's absolutely worth paying even 2k/month. It saves me a lot of time, and enables me …

I would probably pay $2000 a month if I had to - it's a small fraction of my salary, and the productivity boost is worth it.

Is there any evidence?

Sure, could be just lucky. But if there are several successful small studies, and several unsuccessful large ones (no idea if this is the case here), we should probably look for a …

use a diverse population If that's the case, we should question whether different homogeneous population groups respond differently to the substance under test. After all, we don't…

Can you imagine writing code for 100 years?

the larger the trial size, the smaller the outcome I find this a bit surprising. Could there be something else affecting the accuracy of larger trials? Perhaps they are not as care…

This will break down when >30% of people are unemployed

https://nord-ursus.livejournal.com/171473.html

Maybe so, but this particular blog post was the first and is still the best explanation of how transformers work.

What kind of improvements do you expect when going from 5 straight to 6?

I honestly wanted to understand your position, but after such a reaction, I'm not going to engage in any discussions with you.