Live data from Hacker News

Ask HN: Are you using a GPT to prompt-engineer another GPT?

news.ycombinator.com

11–20 of 58 posts

Re: Ask HN: Are you using a GPT to prompt-engineer another GPT?

#11
post #10

Yes. I deploy prompts professionally for work and I almost always iterate with chatGPT. It requires a bit of back forth but you can get great results. It lets you iterate at a higher level instead of word for word. I also find that the prompts work better. Prompt engineering is often about finding magic words and sentences that are dense keywords from the training data and another LLM is going to be good at finding t…

[dead]

Re: Ask HN: Are you using a GPT to prompt-engineer another GPT?

#12
post #8

Yes, I've had great success with this in a few cases. There's the obvious "create a stable diffusion prompt with all the line noise of 'unreal engine 4K high quality award winning photorealistic'" stuff which is pretty obvious. Less obvious is using it to refine system prompts for the "create your own GPTs" thing. I used this approach for my "Chat with Marcus Aurelius, Emperor of Rome and Stoic philosopher"[1] and "N…

ChatGPT also uses the first approach for image generation. It even released before direct access to Dall-E 3 did.

Re: Ask HN: Are you using a GPT to prompt-engineer another GPT?

#16

I'm tempted to build a tool that uses DAGs to orchestrate sequential prompt engineering, but typing that out makes me feel dirty.

You should check out langchain

The self-iterating prompt engineering is a different workflow than normal RAG/tool selection.

Re: Ask HN: Are you using a GPT to prompt-engineer another GPT?

#17
I’ve commented it before, and surely it’s something I’m doing wrong, but I cannot believe system prompts or GPTs or any amount of instructing actually works for people to get ChatGPT to respond in a certain fashion with any consistency.

I have spent hours and hours and hours and hours trying to get ChatGPT to be a little less apologetic, long-winded, to stop reiterating, and to not interpret questions about its responses as challenges (i.e when I say “what does this line do?” ChatGPT responds “you’re right, there’s another way to do it…”).

Nothing and I mean NOTHING will get ChatGPT with GPT-4 to behave consistently. And it gets worse every day. It’s like a twisted version of a genie misinterpreting a wish. I don’t know if I’ve poisoned my ChatGPT or if I’m being A/B tested to death but every time I use ChatGPT I very seriously consider unsubscribing. The only reasons I don’t are 1) I had an insanely impressive experience with GPT-3, and 2) Google is similarly rapidly decreasing in usefulness.

Re: Ask HN: Are you using a GPT to prompt-engineer another GPT?

#19
post #10

Yes. I deploy prompts professionally for work and I almost always iterate with chatGPT. It requires a bit of back forth but you can get great results. It lets you iterate at a higher level instead of word for word. I also find that the prompts work better. Prompt engineering is often about finding magic words and sentences that are dense keywords from the training data and another LLM is going to be good at finding t…

Sounds a lot like what I do when choosing words to Google for things.

Re: Ask HN: Are you using a GPT to prompt-engineer another GPT?

#20

I’ve commented it before, and surely it’s something I’m doing wrong, but I cannot believe system prompts or GPTs or any amount of instructing actually works for people to get ChatGPT to respond in a certain fashion with any consistency. I have spent hours and hours and hours and hours trying to get ChatGPT to be a little less apologetic, long-winded, to stop reiterating, and to not interpret questions about its respo…

I would assume a lot of that has to do with whatever obsequieous nonsense they've got in the RLHF 'safety' training, and you're not getting rid of that without pushing it into a totally different context via DAN-like 'jailbreaks'.
Post reply on HN