Viewing profile — keeeba

This is not an attempt at affected nonchalance, but I’ve simply never come across the idea that Dostoevsky is particularly difficult to read. A somewhat gifted teenager will race t…

Not hired Suleyman? Build his own research lab? Satya made moves early on with OpenAI that should be studied in business classes for all the right reasons. He also made moves later…

The gap between Anthropic and the other guys keeps growing

Big respect Total humiliation for Hegseth, sure there will be a backlash

To somewhat state the obvious - the problem isn’t the amount of data, it’s the algorithms. We need to discover the set of learning algorithms nature has, and determine whether they…

Is everything OpenAI do/release now a response to something Anthropic have recently released? I remember the days when it was worth reading about their latest research/release. Hal…

“ This is one of my fundamental beliefs about the nature of consciousness. We are never able to interact with the physical world directly, we first perceive it and then interpret t…

I don’t have the experiments to prove this, but from my experience it’s highly variable between embedding models. Larger, more capable embedding models are better able to separate …

Doesn’t seem like this will be SOTA in things that really matter, hoping enough people jump to it that Opus has more lenient usage limits for a while

As a fairly extensive user of both Python and R, I net out similarly. If I want to wrangle, explore, or visualise data I’ll always reach for R. If I want to build ML/DL models or w…

Oh boy, if the benchmarks are this good and Opus feels like it usually does then this is insane. I’ve always found Opus significantly better than the benchmarks suggested. LFG

Please don’t actually use these 5,6,7-way Venn diagrams for anything practical, they’re virtually useless and communicate nothing.

I agree it is a profound question. My thesis is fairly boring. For any given clustering task of interest, there is no single value of K. Clustering & unsupervised machine learning …

“Skills are a simple concept with a correspondingly simple format.” From the Anthropic Engineering blog. I think Skills will be useful in helping regular AI users and non-technical…

It came from nowhere to 1T tokens per week, seems… suspect.

What use-cases do you see for the 270M’s embeddings, and should we be sticking to token embeddings or can we meaningfully pool for sentence/document embeddings? Do we need to fine-…

Anthropic say Opus is better, benchmarks & evals say Opus is better, Opus has more parameters and parameters determine how much a NN can learn. Maybe Opus just is better

How have you tested your recall in the long and short term? And what were the results?

Just checking my notes here. This is the same Sam Altman who abandoned OpenAI’s founding mission in favour of profit? No it can’t be

I want to believe that it wasn’t announced at that time, with that name, purely to detract from Google I/O. But it’s hard

https://arxiv.org/abs/2309.08632

Nice story - I’ve seen you on the leaderboard a few times. Good luck through the rest of Foundations III

Nice, also find small classifiers work best for things like this. Out of interest, how many, if any, of the 3million were labelled? Did you end up labelling any/more, or distilling…

Thanks for linking - I know this is pedantic but one might think OpenAI’s models could make their content free of basic errors quite easily? “Conretely, let's define a routine to b…