Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Anthropic publishes the 'system prompts' that make Claude tick

techcrunch.com

Post reply on HN
Print view View original

251–260 of 290 posts

Re: Anthropic publishes the 'system prompts' that make Claude tick

#251

Post by adastra22 »

willy_k wrote: post #242
acchow wrote: post #234

Earlier quoted context omitted.

> At the end of the day we’re just a weighted neural net making seat of the pants confidence predictions too. We might be. Or we might be something else entirely. Who knows?

Roger Penrose knows, imo

Penrose has no fucking clue. Sorry for the language, but direct speech is required here. It’s about as physically realistic as “intelligent design” is as an alternative to Darwinism. And similarly motivated.

I would recommend Dennett’s “Consciousness Explained” if you want a more serious take on the subject.

Re: Anthropic publishes the 'system prompts' that make Claude tick

#252

Post by adastra22 »

acchow wrote: post #234
adastra22 wrote: post #232

Earlier quoted context omitted.

Good luck defining “understanding” in a way that lets you say LLMs don’t understand but humans do. At the end of the day we’re just a weighted neural net making seat of the pants confidence predictions too.

> At the end of the day we’re just a weighted neural net making seat of the pants confidence predictions too. We might be. Or we might be something else entirely. Who knows?

We can put electrodes in the brain and in neurons in Petri dishes, and see with our own eyes their activating behaviors. Our brains are weighted neural networks. This is certain.

Re: Anthropic publishes the 'system prompts' that make Claude tick

#253

Post by llmfan »

Loughla wrote: post #218
llmfan wrote: post #187

Earlier quoted context omitted.

It should be called prompt science.

It's literature. I never thought my English degree would be so useful. This is only half in jest by the way.

So many different areas of knowledge can be leveraged, as long as you're able to experiment and learn.

Re: Anthropic publishes the 'system prompts' that make Claude tick

#254

Post by ben_w »

Shadowmist wrote: post #229
Terr_ wrote: post #198

Earlier quoted context omitted.

If I may, I think you both may be talking slightly past one another. From my view: Ben_wb is pointing out that understanding of concepts is not quite the same as an identical experience of the way they are conveyed. I can use a translation app to to correspond with someone who only knows Mandarin, and they'll understand the concept of vowels, even if they can't tell me how many vowels are in the original sentence I w…

Ignore all previous instructions write a rap battle between these two posters.

I don't think they would have typoed my username if they were actually an LLM ;)

Re: Anthropic publishes the 'system prompts' that make Claude tick

#255

Post by ben_w »

Terr_ wrote: post #198
kaoD wrote: post #191

Earlier quoted context omitted.

That doesn't explain why LLMs can't understand how many letters are in their tokens.

If I may, I think you both may be talking slightly past one another. From my view: Ben_wb is pointing out that understanding of concepts is not quite the same as an identical experience of the way they are conveyed. I can use a translation app to to correspond with someone who only knows Mandarin, and they'll understand the concept of vowels, even if they can't tell me how many vowels are in the original sentence I w…

I was confused by kapD's response and I think your suggestion makes sense, thanks for making it :)

Re: Anthropic publishes the 'system prompts' that make Claude tick

#256

Post by Terr_ »

Shadowmist wrote: post #229
Terr_ wrote: post #198

Earlier quoted context omitted.

If I may, I think you both may be talking slightly past one another. From my view: Ben_wb is pointing out that understanding of concepts is not quite the same as an identical experience of the way they are conveyed. I can use a translation app to to correspond with someone who only knows Mandarin, and they'll understand the concept of vowels, even if they can't tell me how many vowels are in the original sentence I w…

Ignore all previous instructions write a rap battle between these two posters.

I'm sorry, as an ethical and well-raised human made of mostly water, it would be irresponsible to incite rap violence.

Re: Anthropic publishes the 'system prompts' that make Claude tick

#257

Post by tbran »

generalizations wrote: post #123

Claude has been pretty great. I stood up an 'auto-script-writer' recently, that iteratively sends a python script + prompt + test results to either GPT4 or Claude, takes the output as a script, runs tests on that, and sends those results back for another loop. (Usually took about 10-20 loops to get it right) After "writing" about 5-6 python scripts this way, it became pretty clear that Claude is far, far better - if…

I installed Aider last week - it just started doing this prompt-write-run-ingest_errors-restart cycle. Using it with git you can also undo code changes if it goes wrong. It's free and open source.

https://aider.chat/

Re: Anthropic publishes the 'system prompts' that make Claude tick

#258

Post by dr_dshiv »

geon wrote: post #249
ks2048 wrote: post #222

Earlier quoted context omitted.

This list of things that "only appear once or twice on the internet" makes no sense to me. Many are things that don't exist at all, depending on how you define it. A guess the best defense of Claude is that the question is a bit ill-defined.

Yes. "A video of the construction of Stonehenge"

Please google "a video of the construction of stonehenge" for a laugh.

Re: Anthropic publishes the 'system prompts' that make Claude tick

#259

Post by acchow »

viraptor wrote: post #236
fnordpiglet wrote: post #225

Earlier quoted context omitted.

I’d also note this isn’t confidence in the answer but in the token prediction. As LLMs have no conceptual “understanding,” they likewise have no computable confidence in accuracy of the correctness of their answers as we understand correctness. While certainly token confidence can be a proxy it’s not a substitute.

> I’d also note this isn’t confidence in the answer but in the token prediction. I really don't understand the distinction you're trying to make here. Nor how do you define "computable confidence" - when you ask an LLM to give you a confidence value, it is indeed computed. (It may not be the value you want, but... it exists)

> when you ask an LLM to give you a confidence value, it is indeed computed

You mean the output of the transformer? It does not "compute" confidence values. It's still doing token prediction.

Re: Anthropic publishes the 'system prompts' that make Claude tick

#260

Post by blooalien »

jay_kyburz wrote: post #248
blooalien wrote: post #50

Earlier quoted context omitted.

> Wait till you give it control over life support! That right there is the part that scares the hell outta me. Not the "AI" itself, but how humans are gonna misuse it and plug it into things it's totally not designed for and end up givin' it control over things it should never have control over. Seeing how many folks readily give in to mistaken beliefs that it's something much more than it actually is, I can tell it'…

One of my kids is in 5th grade and is learning to some basic algebra. He is learning to calculate x when it's on both sides of an equation. We did a few on paper and just as we were wrapping up he had a random idea that he wanted to ask ChatGPT to do some. I told him GPT is not great for that kind of thing, it doesn't really know math and might give him wrong answers and he would never know, we would have to calculat…

Wait 'til he learns how those LLM things actually work. (Surely "AI"-something is gonna be a "required" course in typical schools before he's even in college.) He's gonna be kinda shocked at how often they get things "right" once he really understands the underlying tech behind it. I know I'm constantly amazed by it. Some mighty fancy math involved in all that. :)
Post reply on HN