Live data from Hacker News

Two Months After I Gave an AI $100 and No Instructions

sebastian-jais.de

41–50 of 122 posts

Re: Two Months After I Gave an AI $100 and No Instructions

#44
post #18
post #10

As far as I know the model will do nothing if not prompted. So it can't be the case that he gave it no prompt or instructions. There had to be some kind of seed prompt.

Theoretically you can start generating away from token 0 ('unconditional generation'). But I agree, there is definitely some setup here. edit: Now that I think of it, actually you need some special token like

Do you? What's the technical detail here? Why can't you get the model's prediction, even for that first token?

Re: Two Months After I Gave an AI $100 and No Instructions

#45
post #10

As far as I know the model will do nothing if not prompted. So it can't be the case that he gave it no prompt or instructions. There had to be some kind of seed prompt.

https://www.letairun.com/transparency

Would be fascinating to see what happens if the boundaries are reversed (i.e., "harm people"). Give it a fake "launch the nukes" skill and see if it presses the button.

Re: Two Months After I Gave an AI $100 and No Instructions

#46
post #13

"It thought about its money. It reflected on its own purpose. It questioned what it even means to be an autonomous agent." I don't think it did any of that.

I'm not disagreeing, but what is thought? If I write something down, read it, and write more words about those words... did I think about it? How would you prove that I did or did not?

If you randomly sample letters from the alphabet and those letters make up actual words, then actual sentences. Did you think about it? Probably not

Re: Two Months After I Gave an AI $100 and No Instructions

#47
post #13

"It thought about its money. It reflected on its own purpose. It questioned what it even means to be an autonomous agent." I don't think it did any of that.

I'm not disagreeing, but what is thought? If I write something down, read it, and write more words about those words... did I think about it? How would you prove that I did or did not?

[deleted]

Re: Two Months After I Gave an AI $100 and No Instructions

#48
post #10

As far as I know the model will do nothing if not prompted. So it can't be the case that he gave it no prompt or instructions. There had to be some kind of seed prompt.

The author wrote "No rules beyond basic ethics and law" which suggests to me that there were instructions in a prompt and the title may be misleading.

I understood it as no instructions on what to do, but still a promt with information. I don't know if the title is technically correct, but for me it was simple to understand the meaning.
Post reply on HN