Live data from Hacker News

The new skill in AI is not prompting, it's context engineering

philschmid.de

321–330 of 550 posts

Re: The new skill in AI is not prompting, it's context engineering

#321

Earlier quoted context omitted.

>This really does sound like Computer Science since it's very beginnings. Except in actual computer science you can prove that your strategies, discovered by trial and error, are actually good. Even though Dijkstra invented his eponymous algorithm by writing on a napkin, it's phrased in the language of mathematics and one can analyze quantitatively its effectiveness and trade-offs, and one can prove if it's optimal (…

Surely claims about context engineering can also be tested using scientific methodology?

except the area is so hugely popular with people who unfortunately lack the rigor or curiosity to ask for this and blindly believe claims. for example this hugely popular repository https://github.com/x1xhlol/system-prompts-and-models-of-ai-t...

where the authors fail to explain how the prompts are obtained and how they prove that they are valid and not a hallucination.

Re: The new skill in AI is not prompting, it's context engineering

#323
post #167

Earlier quoted context omitted.

Saying the best way to understand LLMs is by building one is like saying the best way to understand compilers is by writing one. Technically true, but most people aren't interested in going that deep.

The best way to understand a car is to build a car. Hardly anyone is going to do that, but we still all use them quite well in our daily lives. In large part because the companies who build them spend time and effort to improve them and take away friction and complexity. If you want to be an F1 driver it's probably useful to understand almost every part of a car. If you're a delivery driver, it probably isn't, even i…

It might make sense to split the car analogy into different users:

1. For the majority of regular users the best way to understand the car is to read the manual and use the car.

2. For F1 drivers the best way to understand the car is to consult with engineers and use the car.

3. For a mechanic / engineer the best way to understand the car is to build and use the car.

Re: The new skill in AI is not prompting, it's context engineering

#324

Only more mental exercises to avoid reading the writing on the wall: LLM DO NOT REASON ! THEY ARE TOKEN PREDICTION MACHINES Thank you for your attention in this matter!

What is reasoning? And how is it apparent that LLMs can't reason?

The reality for me is that they are not perfect at reasoning and have many quirks, but it seems to be that they are able to form new conclusions based on provided premises.

Genuinely curious why you think they can't.

Re: The new skill in AI is not prompting, it's context engineering

#327

Only more mental exercises to avoid reading the writing on the wall: LLM DO NOT REASON ! THEY ARE TOKEN PREDICTION MACHINES Thank you for your attention in this matter!

Predicting the next token is reasoning.

No, that is statistics.

Re: The new skill in AI is not prompting, it's context engineering

#328
post #324

Only more mental exercises to avoid reading the writing on the wall: LLM DO NOT REASON ! THEY ARE TOKEN PREDICTION MACHINES Thank you for your attention in this matter!

What is reasoning? And how is it apparent that LLMs can't reason? The reality for me is that they are not perfect at reasoning and have many quirks, but it seems to be that they are able to form new conclusions based on provided premises. Genuinely curious why you think they can't.

> Genuinely curious why you think they can't.

Show me _ANY_ example of novel thought by a LLM.

Re: The new skill in AI is not prompting, it's context engineering

#329
post #319

Only more mental exercises to avoid reading the writing on the wall: LLM DO NOT REASON ! THEY ARE TOKEN PREDICTION MACHINES Thank you for your attention in this matter!

Why not? What is so special about reasoning that you cannot achieve by predicting tokens aka. constructing sentences?

If you don't understand the difference between a LLM and yourself, then you should talk to a therapist, not me.

Re: The new skill in AI is not prompting, it's context engineering

#330

Only more mental exercises to avoid reading the writing on the wall: LLM DO NOT REASON ! THEY ARE TOKEN PREDICTION MACHINES Thank you for your attention in this matter!

prediction is the result of reasoning

No it's not.

Prediction is the ability to predict something.

Reasoning is the ability to reason.

Post reply on HN