Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Copilot for Everything: Training your AI replacement one keystroke at a time

substack.com

Post reply on HN
Print view View original

41–50 of 90 posts

Re: Copilot for Everything: Training your AI replacement one keystroke at a time

#41

Post by visarga »

javajosh wrote: post #24
Chance-Device wrote: post #15

> the thing that scares me about the existence of this data is that it seems well within the capabilities of current technology to train a model that can replicate me , in some sense There’s already all of your posts on social media accounts, all your emails on various servers, all of your text messages, all the notes you’ve written anywhere in any form that might end up in some database in the future. It does make m…

That only captures your output, not your input. The best people to simulate in this world would be so-called terminally online people virtually all of whom's input is itself online. So for those who've read a lot of paper books or done a lot of traveling or had a lot of offline conversations or relationships, I think it would be difficult to truly simulate someone.

I think aggregate information across billions of humans can compensate. It would be like a human personality model, that can impersonate anyone. How do you train such a model? Simple -

Collect texts with known author and date. They can be books, articles, papers, forum and social network comments, emails, open source PRs, etc. Then assign each author a random ID, and train the model with "[Author-ID, Date] Text", and also "Text [Author-ID, Date]". This means you have a model that can predict authors and impersonate them. You can simulate someone by filling in the missing pieces of knowledge from the personality model.

Currently LLMs don't learn to assign attribution or condition on author. A whole layer of insight is lost, how people compare against each other, how they evolve over time. It would allow more precise conditioning by personality profile.

Re: Copilot for Everything: Training your AI replacement one keystroke at a time

#42

Post by Chance-Device »

deadbabe wrote: post #36
Chance-Device wrote: post #15

> the thing that scares me about the existence of this data is that it seems well within the capabilities of current technology to train a model that can replicate me , in some sense There’s already all of your posts on social media accounts, all your emails on various servers, all of your text messages, all the notes you’ve written anywhere in any form that might end up in some database in the future. It does make m…

A fatal assumption people make about a person’s online corpus is that the person is actually expressing their true thoughts and personality instead of a LARPed version of themselves that deliberately acts more inflammatory to get engagement. If the person is not being genuine, you will not simulate their true personality and interests, you will be simulating their character. Most people are probably not genuine, exce…

If they’re consistently “not genuine” in their interactions with others, then what’s the difference? I agree that people will have different presentation depending on context; I don’t speak at home exactly the way that I post on here for example. But you are certainly capturing the same aspect or persona that other people see in that context. Like with most things AI it’s about data, you need copious amounts of data in varying contexts. To really capture a person, you’d probably have to get them to write out their thoughts as well. Including all the ones they would never say.

Re: Copilot for Everything: Training your AI replacement one keystroke at a time

#43

Post by HPsquared »

Chance-Device wrote: post #15

> the thing that scares me about the existence of this data is that it seems well within the capabilities of current technology to train a model that can replicate me , in some sense There’s already all of your posts on social media accounts, all your emails on various servers, all of your text messages, all the notes you’ve written anywhere in any form that might end up in some database in the future. It does make m…

The model would also need all your personal inputs: everything you've ever seen or heard etc.

Re: Copilot for Everything: Training your AI replacement one keystroke at a time

#44

Post by Chance-Device »

HPsquared wrote: post #43
Chance-Device wrote: post #15

> the thing that scares me about the existence of this data is that it seems well within the capabilities of current technology to train a model that can replicate me , in some sense There’s already all of your posts on social media accounts, all your emails on various servers, all of your text messages, all the notes you’ve written anywhere in any form that might end up in some database in the future. It does make m…

The model would also need all your personal inputs: everything you've ever seen or heard etc.

No it wouldn’t, it’s not like ChatGPT needed to be trained on everything all the Kenyan RLHF’ers ever saw or heard.

Re: Copilot for Everything: Training your AI replacement one keystroke at a time

#45

Post by wombatpm »

insamniac wrote: post #30

All humans need to start being compensated for all the data they generate that gets collected. Start giving fractions of stock or whatever for all human input which can now more than ever be endlessly productized.

Your inherent value as a data source becomes the justification for UBI

Re: Copilot for Everything: Training your AI replacement one keystroke at a time

#46

Post by gavmor »

javajosh wrote: post #24
Chance-Device wrote: post #15

> the thing that scares me about the existence of this data is that it seems well within the capabilities of current technology to train a model that can replicate me , in some sense There’s already all of your posts on social media accounts, all your emails on various servers, all of your text messages, all the notes you’ve written anywhere in any form that might end up in some database in the future. It does make m…

That only captures your output, not your input. The best people to simulate in this world would be so-called terminally online people virtually all of whom's input is itself online. So for those who've read a lot of paper books or done a lot of traveling or had a lot of offline conversations or relationships, I think it would be difficult to truly simulate someone.

While I agree somewhat with my sibling comment's assertion that "aggregate information across billions of humans can compensate", somewhat, I'd like to offer that a lot of important output is non-digital, as well!

For example, lately I've spent a lot of time with resin printers, laser cutters, vacuum chambers, and the meaningful positioning of physical models on large sheets of paper. It'll be a while yet before my haphazard, freewheeling R&D methods are replicable by robots. (Although it's tough to measure the economic value of these labors.)

Re: Copilot for Everything: Training your AI replacement one keystroke at a time

#47

Post by HideousKojima »

chasing wrote: post #27

Funny how automation is only a problem because workers don't own much of anything they create. Meaning, if I owned my business then automating myself away would be a dream! But for most people, automating yourself away means a complete loss of income. I'm sure there's an economic lesson, here, our country will completely ignore.

There's nothing preventing people from creating employee-owned co-ops. In fact there are some large and successful ones, like WinCo.

We did learn an economic lesson from countries that tried to make employee ownership of the means of production mandatory, and more especially we learned lessons from the mountains of skulls those countries left behind.

Re: Copilot for Everything: Training your AI replacement one keystroke at a time

#48

Post by ForTheKidz »

Chance-Device wrote: post #15

> the thing that scares me about the existence of this data is that it seems well within the capabilities of current technology to train a model that can replicate me , in some sense There’s already all of your posts on social media accounts, all your emails on various servers, all of your text messages, all the notes you’ve written anywhere in any form that might end up in some database in the future. It does make m…

Our social media personas are also tiny subsets of our actual personalities. I think most people don't reveal their full character in any one medium.

now phone conversations—that would be a goldmine and a nightmare.

Re: Copilot for Everything: Training your AI replacement one keystroke at a time

#50

Post by user99999999 »

Growth and productivity due to technology innovation does not stagnate. Rather the output becomes more complex, of higher quantity and of higher quality.

Any business / company / marketplace participant stagnating by these outputs will be replaced by the competition.

Market forces require constant growth and output. Again, the magic word is “competition”. Stagnation loses, and thus does not survive.

I’m so tired of the “AI will replace us” argument

Post reply on HN