Viewing profile — aljungberg

That's awesome. It's not easy to get seniors to spend that much time in the gym, so well done if you contributed to motivate her! Physical exercise is indeed one of the few Parkins…

We already do tree searches: see beam search and “best of” search. Arguable if it is a “clever” tree search but it’s not entirely unguided either since you prune your tree based on…

To an extent, but memory bandwidth soon becomes a bottleneck there too. The hidden state and the KV cache are large so it becomes a matter of how fast you can move data in and out …

Your triton code is great, nice work. Wouldn’t feel too bad about spending your time that way! As it happens I was also thinking it might be worthwhile to dive into the Triton sour…

For some workloads, it’s almost all about the VRAM. In those cases I’ve been wondering if getting a high memory M1 or M2 Mac could be a good lab machine thanks to unified memory. I…

Within a closed system, consistency (and verifying it) is a fail fast mechanism. For example, it’s better to crash on a constraint failure when attaching a doodad to a non-existent…

Whatever that number is, it will be equal or less than the number already discussed. The network “hires” contractors to provide the services you mentioned and it pays a known figur…

It seems like you’re making a semantic argument to equate the Ethereum network with its validators. That seems confusing. Here are some examples of how “A runs B” does not imply “A…

I wanted to provide a clever insight here saying they should bring some more solar panels, but unless my back of the napkin calculations are totally off that would work poorly. To …

It does say on there they are training it on the Pile training data. And they have this bit comparing inference with GPT2-XL: RWKV-3 1.5B on A40 (tf32) = always 0.015 sec/token, te…

THe RWKV model seems really cool. If you could get transformer-like performance with an RNN, the “hard coded” context length problem might go away. (That said, RNNs famously have i…

I used the Quest 2. It wasn’t just the hardware though, something about the software too. The “main” display was a reasonably sharp and almost retina like. But the other displays w…

I have tried it. Working in VR is much better than I expected it would be, with the right equipment. Still, I quit after a while mainly because of the quality of text rendering. It…

If those loans are no-recourse loans with this FTT token as collateral, then should the token crash the liability just "disappears". The collateral will be sold to cover the loan. …

Hasn’t it been a popular topic on here of how bloated Twitter’s staff seems to be given how little the platform has apparently changed over the years? Not taking a stance on that, …

Yes, I believe it had been done with Google’s Wavenet for example where normally it’s trained to generates speech conditioned on textual input. For fun they trained it on piano mus…

Which goes to my point: the title is explicitly saying the UK is a "poor country" which is what makes it silly. You want to write an article about poor income distribution, that's …

Sure, the sixth largest economy in the world is “poor” because too much wealth is generated by financial services in the capital and not mom and pops in small towns or whatever. Th…

Vyvanse is available in the UK although under the name Elvanse.

Meaning it failed to detect a drop in oxygenation? Unless it fails 100% of the time, it would still be useful since “alerts on some non-zero percentage of life threatening conditio…

Sounds like nbdev which indeed exports code and documentation from a single notebook, plus unit tests for external execution.

I disagree that people were spreading it in bad terms, if by that you mean the general public. Just look at what the officials actually said. Here’s March 2020: > “You can increase…

It’s fine to make mistakes, especially in a fluid, developing situation. And it is precisely therefore we shouldn’t dress up our hypothesises as fact. The actors here presented mas…

The fact that we were strongly told no and then yes with equal conviction is sufficient to demonstrate the point, regardless of whether masks work. Whether intentionally or not, me…