Viewing profile — smonn_

The token limit depends on the way the training data was encoded, usually its using some sort of sin/cos function which has the problem where longer inputs than it was trained on c…

Thanks a lot for the recommendation, it's exactly what I was looking for :)

I haven't read it, thanks a lot! I'm probably going to use it in an essay I'm writing about the topic.

I'm currently working on a variation of a spiking neural network that learns by making and purging connections between neurons, which so far has been pretty interesting, though I a…

I have to agree, when money and interests like with the situation around climate change are involved its hard to do actual science, it just turns into a fucked up manipulation game…

There's plenty of interesting neural network designs out there but they're being overshadowed by transformers due to their recent success. I personally thing that the main reason t…

I'd recommend watching this video if you'd like to know the more nuanced story behind climate change: https://youtu.be/oqu5DjzOBF8 I am not qualified at all to really comment on it…