Not to be confused with the other story from a month ago about giving LLMs "DRµGS".
But also not that far away from that method, too.
Representation Engineering: Mistral-7B on Acid
41–50 of 69 posts
Re: Representation Engineering: Mistral-7B on Acid
#42Reminds me of the Westworld series in which they use these ipad like devices with sliders to change behavior of AIs. Little bit more humor, little bit more aggressive. Nice to these control options and its quick as well.
Interstellar! "Set humor to 80%"
Re: Representation Engineering: Mistral-7B on Acid
#43Earlier quoted context omitted.
This is not specific to llms. So not really informative of how llms work. It also works for CNNs, LSTM, MLPs, or even any data processing program..
Not really. LSTM for example would require a recursive element where you update the hidden state and then pass it through the same layer again as you complete the output sequence. In fact the pseudocode shows very nicely how much simpler transformers are. And MLP is already a component in the transformer architecture.
No? You could perfectly plug in an RNN or bidirectional RNN for layer. This is the pseudocode for applying multiple layers. It does not really matter what these layers are, transformer, RNN, convolution, dilated convolutions, etc. The recurrence happens within a layer, not between layers.
Re: Representation Engineering: Mistral-7B on Acid
#44Earlier quoted context omitted.
Isn't this the typical representation we used back then when working with LSTMs?
No, because LSTMs are recurrent. You couldn't use the same algorithm outlined here. Instead you'd have to iteratively pass elements of the sequence through the same layer over and over.
You are confused. The recurrence is within a layer, not between layers. The algorithm shown is for applying a stack of layers, but it doesn't really matter what the layers are. You can do the same (and people have been doing the same) with RNNs, convolutional networks, etc.
In reality it would typically be more complex for decoders, because you want to pass along a cache (such as a key-value cache in a transformer), add residual connections, etc.
Re: Representation Engineering: Mistral-7B on Acid
#45Very hopeful to see the future of accessing models with the ability to inject vectors by layer instead of just a straight prompt + existing parameters
LoRAs have been a thing for a while, I wouldn't be surprised to see their integration into openAI/mistral apis more. OpenAI fine tunes are so stupid expensive that they're pointless.
Re: Representation Engineering: Mistral-7B on Acid
#46a big step towards making these systems less opaque
Re: Representation Engineering: Mistral-7B on Acid
#47A very non-technical take from my side, but those control vectors really remind me of hormones in humans. They modify large swathes of model behaviour at once. I give it 10 years before we see AI psychiatrists prescribe a happiness control vector supplementation for your pet assistant.
Yeah feels like some humans could use a temperature slider as well.
Re: Representation Engineering: Mistral-7B on Acid
#48Am I crazy for saying that I think the implications of this are monumental? It's entirely possible I just don't correctly understand how this works. Doesn't this mean that instead of interacting with a single global ChatGPT (or Bard) model, we'll istead find ourselves interacting with a personalised version since OpenAI can just store my individualised 'control vectors' (which alter ChatGPT's output to more closely m…
> And doesn't this same logic flow through to personalisation of generative entertainment AI (e.g. my own personal, never-ending TV show where each episode is better than the last)?
I'm not sure I'm following the leap from convincing sentences to convincing video entertainment yet – but maybe we will end up there at some point, I guess?
Infinite Jest (the 90s book) really was onto something with its McGuffin plot device:
> These narratives are connected via a film, Infinite Jest, also called "the Entertainment" or "the samizdat". The film is so compelling that its viewers lose all interest in anything other than repeatedly viewing it, and thus eventually die.
(Wikipedia)
Some people might find references to this novel tiresome and don't think much of its author (RIP), but I still love it. It was one of the most immersive reads I've ever enjoyed.
I'm glad to have read it when I was young (at the time it was just translated into German and kind of hyped because of DFWs death).
Have never read anything like it since, and some passages grabbed me emotionally in a way that remembering the read feels like remembering an episode of my own life.
Surely today I'd lack the patience and even by then I remember almost skipping one passage of the book that bored the hell out of me (Eschaton ball/war game, differential equations, something something...)
But the rest of the book, the parts about substance addiction as well as consumerism, and the intangible atmosphere of the book, the characters, the vivid description of modern emotional pain and loneliness... it is really something else.
Although said movie is only a plot device in the novel, it also sums up the core topics of the book in a neat idea / thought experiment.
The whole complex of themes in this book seems very prophetic and apt looking at our modern society.
A society that seems to be centered around addiction and greed more than ever before, and where politics begin feeling surreal, absurd, and more connected to media than to actual life.
Re: Representation Engineering: Mistral-7B on Acid
#49A very non-technical take from my side, but those control vectors really remind me of hormones in humans. They modify large swathes of model behaviour at once. I give it 10 years before we see AI psychiatrists prescribe a happiness control vector supplementation for your pet assistant.
Yeah feels like some humans could use a temperature slider as well.
Some humans could use a better life with no wars, constant rise of basic life costs or feeling that they are just a tool. This subsystem regulates relationships in a group, it wasn’t invented for funny yelling at each other.
Re: Representation Engineering: Mistral-7B on Acid
#50Earlier quoted context omitted.
Yeah feels like some humans could use a temperature slider as well.
Some humans could use a better life with no wars, constant rise of basic life costs or feeling that they are just a tool. This subsystem regulates relationships in a group, it wasn’t invented for funny yelling at each other.
Well yes, but those things are external and would be part of the context as it were.
system
You are satisfied with your life. Wars and life costs do not bother you. You are loved and a valued member of society.
If only it were that simple for us.