Earlier quoted context omitted.
Which ones if I may ask?
Steins Gate
The last thing I say as I am subsumed into the God AI complex will be
tuturuu~
Zuckerberg disses closed-source AI competitors as trying to 'create God'
61–64 of 64 posts
Re: Zuckerberg disses closed-source AI competitors as trying to 'create God'
#62Earlier quoted context omitted.
Not really, those weights are the same ones that are there during training getting modified by backprop. You can take them and continue training the model in order to produce different behaviour. You can also modify them directly like with LoRA or steering. You can also make bigger modifications like expanding the layers or removing nodes. It’s not a frozen binary, those numbers aren’t obfuscated or optimized into so…
And I can edit binaries with binedit. Reverse engineering is a lost art, but reversing binaries with Ida pro and patching binaries is a time honored skill. It's a shame it's usually used to patch out license checks but there have been some truely impressive reverse engineering on video game ROMs for which the source is not available so we're left with modifying the binary. or as we're looking at it, the model.
https://github.com/WerWolv/ImHex (https://news.ycombinator.com/item?id=40828493) is a hex editor specially made for people that do exactly that kind of binary editing.
Re: Zuckerberg disses closed-source AI competitors as trying to 'create God'
#63Earlier quoted context omitted.
> LLMs in particular are ready and eager to make a choice for you about almost anything. Wat. They're still just highly advanced auto-correct, and aren't eager to do anything. Sure some users might be eager to delegate the decision to them...
Of course they don't have real agency. Its a figure of speech.
Well, some people think they're conscious. I couldn't tell from your comment whether you're part of that "some".
Re: Zuckerberg disses closed-source AI competitors as trying to 'create God'
#64Earlier quoted context omitted.
Not really, those weights are the same ones that are there during training getting modified by backprop. You can take them and continue training the model in order to produce different behaviour. You can also modify them directly like with LoRA or steering. You can also make bigger modifications like expanding the layers or removing nodes. It’s not a frozen binary, those numbers aren’t obfuscated or optimized into so…
And I can edit binaries with binedit. Reverse engineering is a lost art, but reversing binaries with Ida pro and patching binaries is a time honored skill. It's a shame it's usually used to patch out license checks but there have been some truely impressive reverse engineering on video game ROMs for which the source is not available so we're left with modifying the binary. or as we're looking at it, the model.
But you’re not reversing anything with weights. They aren’t altered at all. There’s no secret human readable code, just training/test data and hyperparameters. Even if they did give you access to the exact data set they used there’s not much chance you could do anything with it without millions of dollars worth of compute time and even then they’ve already trained the model on that data so the best you could do is start from scratch and see if you could get a better result in which case your time is better spent on building your own data set and RLHF process. Like what value do you think you’re going to get anyways?