Viewing profile — stoniejohnson

Great post! I appreciate the diagrams.

If you're always looking up but never looking down it becomes hard to appreciate things.

Revisited this, and while it was tongue-in-cheek, it feels a bit ungrateful. A lot of tech roles are intellectually stimulating and have a wage in the upper distribution of salarie…

While those are good reasons to keep the weights static from a business perspective, they are not the only reasons, especially when serving SOTA models at the scale of some of the …

They were high in 2013.

I get where you are coming from, and it is definitely an interesting thought! I do think it is an extremely inefficient way to have a swarm (e.g. across time through training data)…

I was responding to the idea that an LLM would believe (regurgitate) untrue things if you pretrained them on untrue things. I wasn't making a claim about SOTA models with gigantic …

I was responding to the back and forth of: > If you pretrained an LLM with data saying Moscow is the capital of Connecticut it would think that is true. > Well so would a human! Bu…

Humans are not isolated nodes, we are more like a swarm, understanding reality via consensus. The situation you described is possible, but would require something like a subverting…

They have a dark pattern around annual subscriptions, i.e. I had a monthly subscription I wanted to downgrade, and with no confirmation they charged me for the entire year after I …

I'm not really familiar with that technology space, but if you take that as true, is your argument something like: - We don't have limitless CPU cycles - Thus we need to split thin…

I think the bitter lesson implies that if we could study/implement "how a machine with limitless cpu cycles would make our eyes see something we are currently thinking of" then it …

Yeah that tracks, I just feel like the difference required to be an ASI might allow for a stronger claim here.

I didn't mention it but I fully agree, I imagine ASI would have be to embodied. My reasoning is simple, there are a whole class of problems that require embodiment, and I assume AS…

I agree the premise of FOOM is very unlikely. But if you assume that we have created something that is agentic and can reason much faster and more effectively than us, then us dyin…

obligatory IANAL, but seeing LLMs: - regurgitate entire passages word for word, until that behavior is publicized and quickly RLHF'd away - rip github repos almost entirely (some n…

On one hand, my brain kinda shuts off when people start applying structure to spirituality. On the other hand, doing an extensive search amongst possible head spaces you can occupy…

All people do is confabulate too. Sometimes it is coherent (grounded in physical and social dynamics) and sometimes it is not. We need systems that try to be coherent , not systems…

Language is the medium through which raw perspective refined itself. Language birthed social games and the sense of self. Yes, language evolved for communication. But without commu…

Given your initial assumptions, that self-moderating end state makes sense. I feel like we still have a disconnect on our definition of a super intelligence. From my perspective th…