Prompt Engineering: Steer a large pretrained language model to do what you want
lilianweng.github.io
Prompt Engineering: Steer a large pretrained language model to do what you want
1–10 of 53 posts
Re: Prompt Engineering: Steer a large pretrained language model to do what you want
#2There are also tools for prompt engineering, see https://inventai.xyz.
Re: Prompt Engineering: Steer a large pretrained language model to do what you want
#3There's an interesting stanford webinar covering this topic. It's what they call "Retrieval augmented in-context learning": https://www.youtube.com/watch?v=-lnHHWRCDGk
Re: Prompt Engineering: Steer a large pretrained language model to do what you want
#4There are also tools for prompt engineering, see https://inventai.xyz .
I have been looking for this! Chatgpt should have something similar with different flows for known good prompts. Templating for best practices for prompts seems pretty obvious but is very underexplored. An empty text box is almost the definition of choice overload.
Re: Prompt Engineering: Steer a large pretrained language model to do what you want
#5LLMs will become another building block and we will once again stand on the shoulders of giants.
Re: Prompt Engineering: Steer a large pretrained language model to do what you want
#6This is a great resource
Re: Prompt Engineering: Steer a large pretrained language model to do what you want
#7There are also tools for prompt engineering, see https://inventai.xyz .
I have been looking for this! Chatgpt should have something similar with different flows for known good prompts. Templating for best practices for prompts seems pretty obvious but is very underexplored. An empty text box is almost the definition of choice overload.
Glad to hear that! I'm still developing the ability for users to define their own templates. Subscriptions to allow for content generation is technically done, I just need to finish some admin before I enable it.
Re: Prompt Engineering: Steer a large pretrained language model to do what you want
#8I wonder how long it will take before people start to use LLMs to generate prompts...
Re: Prompt Engineering: Steer a large pretrained language model to do what you want
#9[deleted]
Re: Prompt Engineering: Steer a large pretrained language model to do what you want
#10I find it fascinating that emergent behaviour of these models is being used to wrangle them into doing what we want, but I find it worrying that this is considered the right approach for issues of safety. It seems obvious to me that an out-of-band approach to safety and security is necessary and that this method is never going to work in a generalised way.