GPT-Prompt-Engineer
github.com
GPT-Prompt-Engineer
1–10 of 166 posts
Re: GPT-Prompt-Engineer
#2Is this prompt generation for the purposes of prompt engineering? Is this then a kind of meta engineering? Engineering for the purposes of engineering which then hopefully will generate working code for the computer that generated the prompt and the response to the prompt.
Re: GPT-Prompt-Engineer
#3It's turtles^W GPT all the way down, I guess.
Re: GPT-Prompt-Engineer
#4It would be cool if, given a handful of test cases, you could send those off to the LLM to generate even more test cases.
My first thought when looking over this tool was "Why do I have to do all the work?", the ideal scenario is that I give the high level description and the LLM does the hard work to create the best prompt.
Re: GPT-Prompt-Engineer
#5It would be cool if, given a handful of test cases, you could send those off to the LLM to generate even more test cases. My first thought when looking over this tool was "Why do I have to do all the work?", the ideal scenario is that I give the high level description and the LLM does the hard work to create the best prompt.
I haven't read the article at all, but what you said just reminded me that I've been using ChatGPT to create Dungeons & Dragons campaigns / adventures / worlds (it's crazy good at that) and one trick i've started doing at the end of a fruitful conversation is to ask it to summarize the discussion so far _in a format to be used as a prompt_. it works more or less.
Re: GPT-Prompt-Engineer
#6How are they actually ranked?
Re: GPT-Prompt-Engineer
#7Is this prompt generation for the purposes of prompt engineering? Is this then a kind of meta engineering? Engineering for the purposes of engineering which then hopefully will generate working code for the computer that generated the prompt and the response to the prompt.
A bit like code generation, really. Transpile one code to another and have the execution engine run that.
Re: GPT-Prompt-Engineer
#8It would be cool if, given a handful of test cases, you could send those off to the LLM to generate even more test cases. My first thought when looking over this tool was "Why do I have to do all the work?", the ideal scenario is that I give the high level description and the LLM does the hard work to create the best prompt.
I haven't read the article at all, but what you said just reminded me that I've been using ChatGPT to create Dungeons & Dragons campaigns / adventures / worlds (it's crazy good at that) and one trick i've started doing at the end of a fruitful conversation is to ask it to summarize the discussion so far _in a format to be used as a prompt_. it works more or less.
> to summarize the discussion so far _in a format to be used as a prompt_.
Very nice idea, thanks. i might steal that.
Re: GPT-Prompt-Engineer
#9How are they actually ranked?
It seems like a `ranking_system_prompt` is used to rank the output of other prompts, which is pretty cool!
> Your job is to rank the quality of two outputs generated by different prompts. The prompts are used to generate a response for a given task. You will be provided with the task description, the test prompt, and two generations - one for each system prompt. Rank the generations in order of quality. If Generation A is better, respond with 'A'. If Generation B is better, respond with 'B'. Remember, to be considered 'better', a generation must not just be good, it must be noticeably superior to the other. Also, keep in mind that you are a very harsh critic. Only rank a generation as better if it truly impresses you more than the other. Respond with your ranking, and nothing else. Be fair and unbiased in your judgement.
Source: https://github.com/mshumer/gpt-prompt-engineer/blob/main/gpt...
Re: GPT-Prompt-Engineer
#10Doug Adams would've had so much fun these days.