Live data from Hacker News

Controlling Language and Diffusion Models by Transporting Activations

machinelearning.apple.com

11–16 of 16 posts

Re: Controlling Language and Diffusion Models by Transporting Activations

#11
post #4

Multimodal LLM is the true solution but Apple is probably looking for something they can run on-device, at least current generation of devices.

True solution to the problem stated in the article? They're talking about fine-grained control over model outputs, how would multimodality help there?

Re: Controlling Language and Diffusion Models by Transporting Activations

#14
post #5

I could be wrong but ... I feel like this may partially go against a very basic fact about intelligence that was recently stated by Ilya (but is common sense): the more intelligent the model the harder it is to control it. You can remove elephants and force other basic behavioral changes, but the strength of artificial free will (so to speak) of these models is correlated with their intelligence, and this does not re…

The error is thinking there is "thought" at all, forget about "independent". Don't antropomorphize what ain't human

Re: Controlling Language and Diffusion Models by Transporting Activations

#15
post #5

I could be wrong but ... I feel like this may partially go against a very basic fact about intelligence that was recently stated by Ilya (but is common sense): the more intelligent the model the harder it is to control it. You can remove elephants and force other basic behavioral changes, but the strength of artificial free will (so to speak) of these models is correlated with their intelligence, and this does not re…

The error is thinking there is "thought" at all, forget about "independent". Don't antropomorphize what ain't human

Are you saying animals don't think?

Re: Controlling Language and Diffusion Models by Transporting Activations

#16

Earlier quoted context omitted.

The error is thinking there is "thought" at all, forget about "independent". Don't antropomorphize what ain't human

Are you saying animals don't think?

Given an octopus[0] is worse at mimicking human output than an LLM, either you decide that the LLM has surpassed the octopus in thought capability and should enjoy higher protections against abuse and violence, or you decide that thought is irrelevant when exhibiting capability to mimic human output. (As a third option, you could decide that abusing a human-like thinking being is OK, but let’s assume you would not choose this path.)

[0] A protected species for its sentience.

Post reply on HN