Viewing profile — ipieter

I only see an edit to the readme (13h ago) and removal of the weights, so the repo is now empty. I am willing to give them the benefit of the doubt, but we've seen this before: a m…

There is currently very little evidence that morphological tokenizers help model performance [1]. For languages like German (where words get glued together) there is a bit more evi…

Distributing inference per layer, instead of splitting each layer across gpus, is indeed another approach, called pipeline parallelism. However, per batch there is less compute (on…

This is an interesting blogpost. While the general conclusion ("We need batching") is true, inference of mixture of experts (MoE) models is actually a bit more nuanced. The main re…

The mains frequency is literally how fast the generators in power plants are turning. If the load on the grid increases, those generators slow down slightly and more natural gas/co…

I have both DO and Hetzner VMs and I find them comparable, with Hetzner being a bit cheaper. If I look at the logs and fail2ban, it looks like DO does a bit more abusive traffic fi…

Yeah I just tried it with numbers I knew a bit and it seems totally made up. The generated chart showed a linear downwards trend while in reality there isn't one and the numbers se…

Our university recently recommended the same thing, and I think this is a very bad idea for two reasons. 1. Not every sequence of words deserves to be cited. GPT-3 and ChatGPT are …

no it’s not. Philips Lighting is split of into a new brand: Signify. They pay to use the Philips name (e.g. for Philips Hue).

As a Belgian, I was looking in horror at that recipe. Why would people put sugar on their fries?! So I'm glad you like the Belgian fries. What I've always learned to be key is that…

I can answer that, since I also made a small static site generator from scratch in python. I was using another static site generator (Hexo), but at some point I wanted to change so…