Viewing profile — d3m0t3p

When everyone push on friday, and you have 400 CICD pipeline triggers spawning that many nodes. How do you know if this is unexpected ? Their cloud compute might be on demande, som…

They are using Qwen, so this is decoder only.

This is exactly the same with providers from the USA.

It was 15 years ago. Whole management got replaced, they are quite ambitious. Let's see if how this works out now.

I don't think so, faster trains are overtaking slower trains. There is simply not enough space between the station to overtake without having an acceleration that would damage the …

Interesting to see clearml but not its bigger counterpart mlflow

I think this is due to their AI insight, they run locally a model and it start to burn the whole computer.

It is really fun that the navbar has unaligned elements. (Docs is lower)

Yea but the goal it not to bloat the context space. Here you "waste" context by providing non usefull information. What they did instead is put an index of the documentation into t…

Same, Firefox iOS

The model is fined tuned for chat behavior. So the style might be due to - Fine tuning - More Stylised text in the corpus, english evolved a lot in the last century.

Is that really the only thing you managed to remember ?

Because the ML ecosystem is more mature on the NVidia side. Software-wise the cuda platform is more advanced. It will be hard for AMD to catch up. It is good to see competition tho…

In my own studies, software engineering was mostly about structurig code, coding pattern such as visitor, singleton etc. I.E how to create a maintainable codebase

Would you have some literature about that ?

This sounds a lot like what the Muon / Shampoo optimizer do.

Interesting to see that they enforce retroactive opt out for data collection. I wonder how they do that, what if the model is already trained with your data and you opt out.

You can batch only if you have distinct chat in parallel,

Nice to see a master thesis highlighted on the research groupe page

Your first link is (in my opinion) highly biased in the samples they choose, they hired maintainers from open-source repos (people with multi years of experience, on their specific…

It is Gemma 3n, I can't give feedback yet on the battery hit, But I would not expect anything bad as these models have been developed for much smaller devices (Phones)

Hey, really cool project, I’m excited to see the outcome. Is there a blog / paper summarizing how you are doing it ? Also which research group is currently working on it at eth ?

Do they ? LLM embedd the token sequence N^{L} to R^{LxD}, we have some attention and the output is also R^{LxD}, then we apply a projection to the vocabulary and we get R^{LxV} we …

You can check company names too ! It's interesting to see that by default, the graph shows google,apple. But adding meta, and IBM really changes the plot. Meta went from 2K to 10K+…

Apparently this is the case: https://github.com/tulir/whatsmeow/discussions/199