Viewing profile — pyentropy

A lot of good repos (CLIs, frameworks) had 'tree' unicode directory structure with like ├──, └──, and │ , as well as emojis for passing/failed tests and README docs maybe a unicode…

Vedran Miletić doesn't sound German to me! :-)

In times when software eng teams push for maximizing token usage, Tao's public view is to encourage verification, limit AI use for tasks that have real-life consequences and preven…

Note that the SAIR lecture is from 6 months ago, this Beamer presentation is from 2 days ago.

I'm considering the possibility that it's good to break the prefix and cache because the LLM itself was rewarded (during post-training) with different prefixes/system prompts, each…

Examples with inference of different reasoning effort levels is in the OpenAI docs as well - https://developers.openai.com/cookbook/articles/openai-harmo... https://docs.vllm.ai/en…

LLM-judge/parallel branching ≠ multi-token prediction ≠ reasoning effort. See https://developers.openai.com/cookbook/articles/openai-harmo... and src/openai/types/shared/reasoning_…

The number of tokens you predict at time (multi or not) has nothing to do with whether the model wants to emit any, some or a lot of reasoning tokens in reasoning tag -- similar to…

Take a look at the harmony repo which specifies the internal OpenAI format - the effort level is specified in the context after the tag - https://github.com/openai/harmony Note tha…

If H800 is a memory-constrained model that NVIDIA built to avoid the Chinese export ban on H100 with equivalent fp8 performance, it makes zero sense to believe Elon Musk, Dario Arm…

You should start a blog... or maybe not - pursue the battle in academia/work and occasionally drop nuggets of wisdom like this somewhere. But do not delete them.

I updated the post with a a link to counter-argument from Sabine Hossenfelder, the arguments from Zvi and three points from my side.

I updated the post with a a link to counter-argument from Sabine Hossenfelder, the arguments from Zvi and three points from my side.

Scott worked at OpenAI Safety and he likes it: https://scottaaronson.blog/?p=8047 But is the "-ed" in worked a problem?

Thank you.