Viewing profile — piecerough

Have you tried 2.5 Flash Lite to cut costs further?

"quantize enough" though at what quality?

What's a decent european enterprise?

What US government attacks?

[...] > But there is something fundamentally different about talking with a bot as opposed to a person. A person can be a friend. An AI cannot be a friend, despite how people might…

SFT forces the model to output _that_ reasoning trace you have in data. RL allows whatever reasoning trace and only penalizes it if it does not reach the same answer

I think the reason why it works is also because chain-of-thought (CoT), in the original paper by Denny Zhou et. al, worked from "within". The observation was that if you do CoT, an…

Who's Tavi?

Have you had a common theme for these projects you navigated?

It's very related to LLMs. Though instead of text tokens you are working with audio tokens (e.g. from SoundStream). Then you go to audio corpus, instead of text corpus.

So it turns out that the AI boom introduced a new exit strategy compare to 10 years ago. Inflection, Adept, Character and many others they all went through founder drain. Big Tech …

It's great!

> It would be very interesting if LLMs were no longer static. Little bit of a nightmare too. Instructions keep piling up for you that you no longer openly can access and remove

> I remember a French institution could not buy our product, because they had a contract with a local manufacturer. I doubt this is a EU thing. It's due to exclusive contracts/lice…

This is only going to get worse with Large Language Models. Let's imagine a somewhat knowledgeable individual, could craft both emails, messages and even commits with a bunch of pr…

Isn't this what we're all betting massive Transformer architectures are going to give us? Tools to explore and handle complex concepts. Reasoning may still be left to us, though.

"We are also releasing three new datasets: Screen Annotation to evaluate the layout understanding capability of the model, as well as ScreenQA Short and Complex ScreenQA for a more…

That seems brutal, indeed. Why did you move there in the first place?

I'm a FAANG employee and I believe high growth days are over. Layoffs and cost cutting are taking the fun out of these big tech conglomerates, making it not just hard to grow caree…

So what's next?

As a FAANG employee, working with ML, what do you want to get from other companies, besides more money? It's hard to have more chips, for example. You run less experiments, you hav…

In today's market, if you are available for the intro call, recruiters go hunt for the next hard-to-get candidate. Bigger likelihood it'll be an actual conversion. Happened to me.