Live data from Hacker News

GitHub Copilot Chat Leaked Prompt

twitter.com

541–550 of 628 posts

Re: GitHub Copilot Chat Leaked Prompt

#541

Earlier quoted context omitted.

And to complete the thought: The ‘You are an AI chatbot’ form is actually grammatically ‘predicative’, not ‘imperative’ (ie it describes what is not what must be done )

Isn’t it Indicative, not Imperative?

Good point - indicative is a better term since it is a grammatical ‘mood’, same as imperative.

Re: GitHub Copilot Chat Leaked Prompt

#542
post #19

I think that a lot of the limits placed on these models / chat services don't do much to remove underlying bias but rather attempt to obfuscate them from the general public. ChatGPT, Dall-e, etc all make assumptions about identity or politics but try to sidestep direct requests around those topics to appear more neutral... but the bias still exists in the model and affects the answers.

Bias is what makes models useful. If you remove all bias, you remove all information in the model and the result is a uniform distribution or pure randomness.

Re: GitHub Copilot Chat Leaked Prompt

#543
post #533

Earlier quoted context omitted.

Sure, and like I said, it's just a mitigation. The real answer is that if you're a high value target you just shouldn't use LLMs.

"I'm secure because I don't use an LLM" ... "What do you mean we got hacked via our third party vendor because they use LLMs"

I don't know why you're trying to argue, but I never said any of those things.

Re: GitHub Copilot Chat Leaked Prompt

#544

Something that I find weird about these chat prompts (assuming they are real, not hallucinated): They're almost always written in second person*. "You are an AI programming assistant" "You are about to immerse yourself into the role of another Al model known as DAN" Who are these prompts addressed to? Who does the GPT think wrote them? The thing that confuses me is that these are text token prediction algorithms, und…

You are reading way to deep into it. It's just a simple transformation and really not that interesting at all.

Re: GitHub Copilot Chat Leaked Prompt

#545

Earlier quoted context omitted.

What a horrible thing to put out into the world.

Have you been on Twitter lately? It was probably less toxic than the average human

1) Potentially less toxic than the average twitter post that you see, which is very different

2) Doesn’t mean it’s not a horrible thing to build and add to the internet’s decline

Re: GitHub Copilot Chat Leaked Prompt

#547
post #493

Earlier quoted context omitted.

It sounds like you’re saying it’s only reasoning in that way because we taught it to. Er, yep. How great this is becomes apparent when you think how virtually impossible it has been to teach this sort of reasoning using symbolic logic. We’ve been failing pathetically for decades. With LLMs you just throw the internet at it and it figures it out for itself. Personally I’ve been both in awe and also skeptical about the…

I don't think we really disagree. This is what I wrote above: "So depending how you define it, they might have some "reasoning", but so far I see 0 indications, that this is close to what humans count as reasoning." What we disagree on is only the definition of "reason". For me "reasoning" in common language implys reasoning like we humans do. And we both agree, they don't as they don't understand, what they are talk…

There's definitely some people out there that think LLMs reason the same way we do and understand things the same way, and 'know' what paint is and what a wall is. That's clearly not true. However it does understand the linguistic relationship between them, and a lot of other things, and can reason about those relationships in some very interesting ways. So yes absolutely, details matter.

It's a complex and tricky issue, and everyday language is vague and easy to interpret in different ways, so it can take a wile to hash these things out.

Re: GitHub Copilot Chat Leaked Prompt

#549
post #533

Earlier quoted context omitted.

"I'm secure because I don't use an LLM" ... "What do you mean we got hacked via our third party vendor because they use LLMs"

I don't know why you're trying to argue, but I never said any of those things.

This isn't wasn't an argument, it's an example played out now in 'standard' application security today. You're only secure as the vendors you build your software on, and that market factors are going to push all your vendors to use LLMs.

Re: GitHub Copilot Chat Leaked Prompt

#550

Earlier quoted context omitted.

These models have gone beyond the level of "token predictors". On the level of chatGPT, the model has itself, internally, acquired "concepts" that it refers to in the conversation. It "understands" concepts like "you", "me", "them" etc, and can apply it correctly (to a large part) to the entities in the conversation. I believe that answers your question. I could be wrong: errare humanum est.

A really good token predictor is still a token predictor.

No, we're past that point. it's no longer the most useful way to describe these things, we need to understand that they already have some sort of "understanding" which is very similar if not equal to what we understand by understanding.

Don't take my word for it, listen to Geoffrey Hinton explain it instead: https://youtu.be/qpoRO378qRY?t=1988

Post reply on HN