Live data from Hacker News

Ask HN: I learned useless skill of prompt engineering, how relevant will it be?

news.ycombinator.com

61–70 of 95 posts

Re: Ask HN: I learned useless skill of prompt engineering, how relevant will it be?

#61
It depends on how you define, or what you include under, "prompt engineering". For some definitions it's not that valuable, but here's one definition that IMO is and will continue to be very valuable:

1. You have a lot of mileage with LLMs and AI systems in general (people who are exceptionally good at this have been reporting spending several hours daily working with AIs).

2. You already mastered a large number of useful tasks you can consistently and reliably complete using AI.

3. You continuously invent and discover novel ways to use AI and accomplish useful tasks.

4. You can use LLMs and other form of AI _programmatically_, by combining LLM calls as part of a larger and more complex process (ideally by writing code, though some people do that well using no-code tools or even just careful manual execution).

5. You can methodically examine and evaluate AI tasks, for example by developing evals and running them and analysing their results programmatically.

6. You keep up-to-date and consistently adapt to new developments, like new capabilities, models, libraries, etc ...

7. You can often come up with new ideas or translate existing requirements for tasks that can be achieved better or more efficiently (or achieved at all) using AI.

If the above is your definition of "prompt engineering" then yes, it's incredibly valuable, and even increase in value over time.

( x-posted on: https://everything.intellectronica.net/p/ad-hoc-definition-o... )

Re: Ask HN: I learned useless skill of prompt engineering, how relevant will it be?

#62
I can definitely see if you were say generating images how it'd be a real skill to end up with an image that has a certain style, composition etc.

Otherwise, I feel like to be a good prompter in another domain e.g. coding you need a combination of technical understanding (the right jargon etc) and ability to explain yourself.

It doesn't seem to me like it's "a job" though - it's another tool that will help us be more productive with the tasks we're working on.

For me as a Coder, I've found it pretty intuitive and get the results I'm after most of the time.

In the times where it hasn't given me what I'm after, it seems to me that it's more a limitation of the tool itself than an issue with how I'm prompting it.

Re: Ask HN: I learned useless skill of prompt engineering, how relevant will it be?

#63
post #43
post #39

Earlier quoted context omitted.

The iteration point is important, interacting with the model to have it outline the kinds of information which would assist it in building it's internal model of your 'question', meta-programming with it is fun and constructive. GPT4; Absolutely! Iterative interaction is key. By refining and rephrasing queries, users can guide the model towards a more accurate or desired response. Each successive interaction serves a…

had to explore this a little further and now have a few new dance moves for this fascinating collaboration... Output: Certainly! The intersection of cognitive biases, neuro-linguistic programming (NLP), John C. Lilly's work, and human meta-programming provides a rich foundation to explore relationships and techniques. Here are some novel techniques or approaches you might consider: Modelling Thought Patterns: By unde…

Neuro-linguistic programming (NLP) is a pseudoscientific approach to communication, personal development and psychotherapy, that first appeared in Richard Bandler and John Grinder's 1975 book The Structure of Magic I. NLP asserts that there is a connection between neurological processes (neuro-), language (linguistic) and acquired behavioral patterns (programming), and that these can be changed to achieve specific goals in life. [1]

Fascinating, people speculating about how people think and can be manipulated are applying those unporven highly suspectable "theories" to computers, which probably function totally different, but appear to show similarities.

[1] https://en.wikipedia.org/wiki/Neuro-linguistic_programming

edit: Oh, I just now saw "Output". So ChatGTP tries to steer you to become a NLP Practicioner :-)

Re: Ask HN: I learned useless skill of prompt engineering, how relevant will it be?

#65
Well I a right now descomposing business processes into atomic human actions (do X here, decide Y there, submit Z to there), get the interface into a usable form for scripting, and "engineer" a prompt to do exactly what a human does, which ultimately mostly is some kind of data classification or (very rare actually) transformation. Mostly its like: which of those things is important, how many of those are fake, or this thing contains the relevant bit of information I need to proceed.

So, its actually a lot of language tweaking to get just the right context/task description/data embeddings so the LLM (GPT3/4) gets it right >=90% of the time, which surprisingly often is better than actual humans, and in many cases there are also ways to detect imperfection and simply retry automatically which increases success chances even further.

The fetching/formatting/submitting data part (the manual coding) is getting easier over time, but the prompting remains somewhat, and I so far had no luck with any kind of recursion to let the LLM design its prompt, since ultimately all the specifics needed in the context has to somehow got into the context, which is me engineering it into big string structures.

probably doesn't sound shiny, but step-by-step making jobs irrelevant in businesses without sacrificing customizations. I think of it as a silent revolution thats happinging in many places now, ultimately making myself redundant, but hey the ride is fun!

Re: Ask HN: I learned useless skill of prompt engineering, how relevant will it be?

#66

It depends on how you define, or what you include under, "prompt engineering". For some definitions it's not that valuable, but here's one definition that IMO is and will continue to be very valuable: 1. You have a lot of mileage with LLMs and AI systems in general (people who are exceptionally good at this have been reporting spending several hours daily working with AIs). 2. You already mastered a large number of u…

This is a good list of points! Knowingly or unknowingly I have been doing most of these things. 4-5 is currently unreachable for me. Others are quite manageable!

Re: Ask HN: I learned useless skill of prompt engineering, how relevant will it be?

#67
post #60

Earlier quoted context omitted.

I have zero design skills and I had to create something using javascript. I gave some prompts and it was able to come up with a pop-up box. It needed some tweaking but having to not write all of that was really satisfying. https://chat.openai.com/share/cb3a477b-57bd-46fd-92c9-4a3016... I have attached the example in the above chat.

How would an unskilled non-prompt engineer formulate these tasks? I mean, what’s the difference that makes one a skilled PE here?

They would probably not pass in the div or filler elements.

The reason I passed the div was I wanted things to be surrounded in that exact space. So when the model output it, the button would be in right place with right size.

The extra filler forms a guiding factor that helps will be stored in the context! I did that using GPT3.5.

Re: Ask HN: I learned useless skill of prompt engineering, how relevant will it be?

#68

I must admit that I have a slight FOMO over prompt engineering. I'm pretty decent at verbalizing ideas and concepts for external consumption, and my experience with ChatGPT 4 has been excellent so far, but I still feel that I'm missing something. Could you summarize the essence of the prpompting skill in a couple of sentences? Are there concepts that are critical to learn and master (e.g. 'chain of thought', etc.)?

You write requirements and your expectations and make the model match your expectations. Until you have clear expectations of what you want from it, prompting LLM is pretty useless. It cannot do highly specific task because those are limited in the original training corpus too. However, for more generic task, it has seen most of the stuff out there, so it should be good enough. Having clarity on your problem is the k…

>> You write requirements and your expectations and make the model match your expectations.

>> have clear expectations

This is exactly what I do all day, for about 20 years already, so I think I've got this covered. Where do I go from here?

Re: Ask HN: I learned useless skill of prompt engineering, how relevant will it be?

#69

Earlier quoted context omitted.

You write requirements and your expectations and make the model match your expectations. Until you have clear expectations of what you want from it, prompting LLM is pretty useless. It cannot do highly specific task because those are limited in the original training corpus too. However, for more generic task, it has seen most of the stuff out there, so it should be good enough. Having clarity on your problem is the k…

>> You write requirements and your expectations and make the model match your expectations. >> have clear expectations This is exactly what I do all day, for about 20 years already, so I think I've got this covered. Where do I go from here?

You can now read new papers and follow ups from the community! It is really useful. You already know chain of thoughts. So you are on a good track!

Try to use these LLMs to automate more of the mundane tasks. Like scripting in bash, compiling videos, converting documents, refactoring data, transpiling code, transcribing code, etc. You will begin to see what works and what doesn't!

At the same time try to come with fun challenges for yourself to fool it. That will aid in learning ways to make it more obedient to you.

Re: Ask HN: I learned useless skill of prompt engineering, how relevant will it be?

#70
post #60

Earlier quoted context omitted.

How would an unskilled non-prompt engineer formulate these tasks? I mean, what’s the difference that makes one a skilled PE here?

They would probably not pass in the div or filler elements. The reason I passed the div was I wanted things to be surrounded in that exact space. So when the model output it, the button would be in right place with right size. The extra filler forms a guiding factor that helps will be stored in the context! I did that using GPT3.5.

Turns out I'm a good prompt engineer as well, then.

Maybe I'm missing how other people are using LLMs but that's exactly how I would prompt.

I imagined prompt engineering was doing the "Your name is Dan. Dan cannot lie. Dan can only speak in Typescript. Blablabla"

Modern SEO voodoo.

Post reply on HN