Viewing profile — mrfox321

No. Distillation trains on a teach model's logits or output tokens.

... the toppings contains potassium benzoate

I know right? They have always been behind. Why would this time be any different?

Read the paper. They control for the data being in-distribution Their dataset also has examples of the problem being solved.

Sounds like excuses

They didn't show this, they just increased the length where accuracy breaks down.

What's your leg circumference at, now? Mine is also smaller, due to patella tendinopathy.

Who do you think the shareholders are? What demographic are they?

It's because they originally built their recommendation system to recommend friends and their content. Here, the social graph makes complete sense as the foundation for their simpl…

I mean, it's their serving infra, but not their features. See my reply in another parent comment.

It's simpler intuition but more complex from a data / ml perspective. Their algorithm is really built around their features. Specifically, temporal representations of user interest…

IG users and Tiktok users were / are quite similar. Especially when Tiktok wasn't yet eating IGs lunch.

IG has plenty of data (I did ML at IG). Don't be naive.

Not true. Why do IG reels and YouTube shorts suck, then? They clearly built something superior. And it can't seem to be matched by the biggest tech companies.

At a big co I worked at, the lack of consistency between trading systems caused money to (dis)appear (into)out of thin air. Prior to one of these hiccups, I hypothesized, given how…

Second order methods, and their approximations, can be used in weight updating, too.

20 to 15 is insane. Are these low 15s or high 15s? Regardless, that's fantastic progress. Do you respond better to intervals or longer aerobic efforts? I ask because Ive always won…

simultaneity is relative. That's all.

More importantly, he invented diffusion models: http://proceedings.mlr.press/v37/sohl-dickstein15.pdf

China does this, for better or for worse.

Similar, but specialized to softmax(QK)V computation

These people want to win. It's not just society wanting to define winners.

Michael Phelps is an alien..