Viewing profile — dontwearitout

Chapter 1 of "The Ministry of the Future" describes a fictional wet bulb event. It's grisly and horrific and I highly recommend you read this chapter, it changed my view on climate…

This is the "hard problem of consciousness". It's more important than ever as machines begin to act more like humans, but my takeaway is we have no idea. https://en.wikipedia.org/w…

How many tokens/s do you get on a 3090? With the extra tokens for the internal monologue, is it still performant enough for smooth VSCode integration?

Dissociatives would work, like dextromethorphan or ketamine. Psychedelics are a subset of hallucinogens.

I've never found it compelling that blinding isn't possible for drug-naive patients. There are other drugs that could induce a "trip" and an unfamiliar individual could mistake for…

The energy of neutrons isn't really analogous to the energy of atoms in chemical reactions, but absolutely affects the reaction dynamics. The "cross section", or interaction probab…

They certainly can, see https://en.wikipedia.org/wiki/Resonance_escape_probability . The all-important number in nuclear reactions is "k", the average number of child neutrons a si…

Claude notably does not use RLHF, but uses RLAIF, using a LLM to generate the preferences based a "constitution" instead of human preferences. It's remarkable that it can bootstrap…

Are dendritic sub-compartments necessary to explicitly model, or does this work just imply that biological neurons are complicated and are better modeled as a multi-layered artific…

Your "blip" anecdote is super interesting. I know that exact sensation of disorientation (but without the migraines thankfully), and I'm curious if this has been studied in depth a…

I don't know if you're out of the loop but the AI scene has dramatically changed in the past few years. We are solidly out of the AI winter.

I haven't heard the term "shallow basin hypothesis" but I know what it refers to, these two papers spring to mind for me: 1) Loss Surfaces, Mode Connectivity, and Fast Ensembling o…

I don't think a dot product between high dimensional vectors is considered a convolution? I'm familiar with convolution between continuous functions, and with kernels in neural net…

Lots of interesting work out there; time will tell!

The transformer module is currently dominating ML, and is widely used in text, vision, audio, and video models. It was introduced in 2017 and shows no real signs of being displaced…

Does this include tools to evaluate for performance on out-of-distribution and adversarial images?

Their point was the insane efficiency, not the low consumption. Modern LLMs are many orders of magnitude less energy efficient; despite all our progress computational biology makes…

Yep, transformers showed up in 2017, nearly 7 years ago, and they still wear the crown. Maybe some new architecture will come to dominate eventually, but I would love a low cost PC…

Diffusion models could actually be implemented with transformers, hypothetically. Their training and inference is what makes diffusion models unique, not the model architecture.

There's an ocean of difference between optimizing for a single wakeword and the class of models that are taking off today. I'm excited for more on-board processing, because it will…

This only goes back to 1913, but says $1 in 1913 is worth $30.65 today. That's pretty rough. https://www.minneapolisfed.org/about-us/monetary-policy/infl...

Does anyone know of any photo management projects that include integration with recent ML models for classification and captioning? It'd be awesome to have a system that could auto…

I think the point being made is that without grid scale storage, wind and solar are not full solutions and not comparable to nuclear energy. Grid scale storage capacity will come, …

I had to look this up - apparently it's around 0C if you do this! https://mynasadata.larc.nasa.gov/sites/default/files/2018-12...

An aside, but do you find the quality improvements in GPT-4 are necessary for your daily use, or is 3.5 80% as good?