Live data from Hacker News

Favorites from our prompt engineering tournament

blog.promptlayer.com

11–20 of 23 posts

Re: Favorites from our prompt engineering tournament

#13
post #10
post #3

Prompt engineering doesn't feel like an activity that creates sustainable AI advancement. A prompt may work well with one model, in most situations, but even the best practices seem too experimental. For their competition to avoid a PR disaster, isn't it better to look in the model? Perhaps observe the weights, when the AI says something that you want to avoid in the future. A safeguard could trigger if the model is…

> Prompt engineering doesn't feel like an activity that creates sustainable AI advancement. Chatgpt was created from gpt via prompt engineering? An inverse chatgpt where user answers questions instead of the other way around also has applications.

Only in that the very initial version was GPT + prompt. ChatGPT is heavily fine-tuned using both handwritten examples and later on rated examples from its own output. The prompt is still relevant but the fine-tuning is the biggest thing that makes it work like a chatbot.

Re: Favorites from our prompt engineering tournament

#14
post #7

Am I the only one annoyed by the term “prompt engineer{ing}”? I thought this was a meme, but I have actually seen some job posts for “prompt engineer”.

Just as much as by the equivalence of software developer and software engineer. Both are a misuse of the term "engineer". Maybe one more than the other, but still.

Re: Favorites from our prompt engineering tournament

#16
Towards the end they state: ‘… just adding “do not hallucinate” has been shown to reduce the odds a model hallucinates.’ I find this surprising and doesn’t fit with my understanding of how a language model works. But I’m very much a novice. Would this be due to update training including feedback that marks bad responses with the term “hallucinate”?

Re: Favorites from our prompt engineering tournament

#17

Interesting analogue to books like "How to win friends and influence people". This genre of self help books include a lot of things that when you squint look like prompt engineering on humans

Although doesn't the Dale Carnegie book focus mostly on being a good listener and using emotional intelligence? Prompt engineering doesn't seem to be very similar to this AFAIK.

Re: Favorites from our prompt engineering tournament

#20

Towards the end they state: ‘… just adding “do not hallucinate” has been shown to reduce the odds a model hallucinates.’ I find this surprising and doesn’t fit with my understanding of how a language model works. But I’m very much a novice. Would this be due to update training including feedback that marks bad responses with the term “hallucinate”?

My mental model is “telling a LLM to not make any mistakes is like telling a depressed person to stop feeling bad”.
Post reply on HN