Viewing profile — upbeat_general

This is just not how it works - it is perfectly plausible (in fact the most likely) that pretraining was well finished by the time Fable was released. A bit of extra distillation t…

Same way you do for planes, cars, etc. You have long(ish) life-cycles and some pieces that can be independent (e.g., same turbine engine on several plane models).

If I used a racecar to go 25mph in a residential neighborhood, I’d make a similar conclusion.

I think that figure (haven’t verified it but assuming it’s true) isn’t complete. It hides who and where those people are - for example, I imagine art history skews towards higher r…

If we’re defining on-prem as fitting in a rack - then every frontier model can be hosted on-prem. Now this might not be the most cost effective (and may require a bit extra power),…

This statement is well known to be incorrect for at least a year.

If by "happened to" you mean pour significant resources for well-over a decade on many different AI research groups then yes, that's accurate. Depending on your definition of AI, i…

This isn’t quite accurate. Data weighting is quite important in pretraining.

Sampling exists.

From a user perspective it is nice to know that the person decoding will likely support a given format, both now and in the future. More use cases for a single popular format makes…

I really wish that there was an “almost yolo” mode that was permissive but with light restrictions (eg no rm), or even better, a light supervisor model to prevent very dangerous co…

I can assure you that lacking knowledge in DPO (and especially GRPO it’s just stripped down PPO) is not a dealbreaker.

This seems like the perfect case for legislation that starts out targeting higher volume devices/larger companies and lower over time. I don’t see why the industry couldn’t move to…

Not saying it’s for sure the case but it might be that the model gets confused by OOD text from the other model whereas it expects its own text to be online from itself (particular…

A lot of developers (including myself) don’t want to notarize/sign their binaries that they want to run on their own machine(s).

And it was none of the mentioned schools!

Seconding another commenter. I went to a state-school (maybe in the top 5 US state schools) and got an offer without any elite background.

Related: I've been pretty frustrated with cursor that you can't call any APIs directly, and it all has to go through their backend. Along with this, they have essentially refused t…

Here’s the simple reason why this is not the case: If you provide the 6DoF trajectory (+ gripper joints), a lot of robotics (manipulation in particular) is basically solved. The pr…

Not a war crime, China has plenty of agriculture. See the Cuban missile crisis. It is an act of war but certainly not as escalatory as direct attack.

The challenge here is not IK. Sure, you don’t need IK if your policy directly operates in joint space but this isn’t the motivation for doing RL. IK to my knowledge is well known i…

Has anyone used Typst for academic conferences/journals? To me it’s sorta like CSS where the availability of templates is more important than the core language (at least for people…

It’s less reproducible than docker (assuming the pip usage is correct). Docker specifies a lot of OS properties that UV ignores. That being said, UV is great.

I tried out uv a bit ago and dropped it. But about two weeks ago, I switched to it and migrated two projects with no issues. Things like pypi sources per dep are there finally. I s…

imo gemini-exp-1206 is the best public LLM that exists right now.