Viewing profile — gemeral

12 month cliff is standard in the industry though even at larger, established companies

For context, I work in one of the hot AI startups, so this is not generally applicable to everyone, but... Traditional startup hiring advice, before I left my cushy big tech job, w…

That's not the right analogy. The "tok" in "Tiktoken" comes from "token", not "TikTok".

Do you mind pointing out where they make the model larger? The paper seems to suggest they are maintaining the same model sizes. > Recent research, such as BitNet, is paving the wa…

> and blowing up parameter count to make up for it based on (an admittedly rapid and indulgent reading of the paper), it seems like they're not increasing the parameter size. Do yo…