Live data from Hacker News

Prompt Engine – Microsoft's prompt engineering library

github.com

81–90 of 94 posts

Re: Prompt Engine – Microsoft's prompt engineering library

#83
post #44

Which job title sounds cooler: Senior Prompt Engineer or Senior Prompt Designer?

For the financial applications at finclout I would prefer engineer. Yet for the stable diffusion tasks, I'd prefer designer.

Is your website https://finclout.io/? Some very odd behaviour in the animations on the page when you load it (Chrome 109.0.5414.119 on Mac) that you might want to have someone look at.

Re: Prompt Engine – Microsoft's prompt engineering library

#84
post #67

Why we call this prompt "engineering"? The prompt is just a way to interact with the whatever ML model is behind... in that regard it's similar SQL or any other interface. Sure thing I've never heard of "SQL engineering" or something like that.

Presumably because it's an iterative and intricate process to tease the desired response out of these systems.

Given SQL queries are software, I'm sure you've heard of software engineering.

See also https://news.ycombinator.com/item?id=34521149

Re: Prompt Engine – Microsoft's prompt engineering library

#85
post #78

I’m surprised Bing’s chat meltdowns haven’t had more air time on HN. People are going to start calling it a living creature. https://old.reddit.com/r/bing/top/?sort=top&t=week

https://news.ycombinator.com/item?id=34804874 has over 1500 comment. That is not a typo. Over one thousand five hundred comments.

I can't remember seeing a bigger thread on HN

Re: Prompt Engine – Microsoft's prompt engineering library

#86
post #78

I’m surprised Bing’s chat meltdowns haven’t had more air time on HN. People are going to start calling it a living creature. https://old.reddit.com/r/bing/top/?sort=top&t=week

https://news.ycombinator.com/item?id=34804874 has over 1500 comment. That is not a typo. Over one thousand five hundred comments. I can't remember seeing a bigger thread on HN

I missed it somehow i guess, thanks for the tip!

Re: Prompt Engine – Microsoft's prompt engineering library

#87
Tangentially related: has anyone here tried to figure out what programming language a LLM-based generator would be most successful at writing? Or what language features are necessary for LLM's success at code generation?

I've tried but unfortunately all of my searches return results about languages used for building models (e.g., Python, for some reason).

I figure it'd probably be a typed language with a meaty standard library, good type inference, and high-quality low-code packages that would require fewer generated tokens to do useful work. Or maybe a language with fewer ways to do basic tasks -- if there is somehow only one way to do a thing, then the generator would be most likely to write code using that one way. I'll fully admit that these guesses are naive and based on limited understanding of how LLMs work.

Re: Prompt Engine – Microsoft's prompt engineering library

#88

Tangentially related: has anyone here tried to figure out what programming language a LLM-based generator would be most successful at writing? Or what language features are necessary for LLM's success at code generation? I've tried but unfortunately all of my searches return results about languages used for building models (e.g., Python, for some reason). I figure it'd probably be a typed language with a meaty standa…

I have suspicious is is bash, or python. I think bash is good because you can express concepts very concisely giving fewer literal characters to mess up on. Python because the data set is so massive while still maintaining a lot of power-per-character.

Conversely, I have seen it underperform for verbose languages like Java, I think primarily due to windowing issues and that less meaningful code can be represented in one prediction window.

Re: Prompt Engine – Microsoft's prompt engineering library

#89
post #43
post #40

I can’t help shake the feeling that something closer to code (or specific training?) and further from natural language should be being used to configure these models at this stage of development. I was _astounded_ by the ‘Sydney document’ being MS’s way of ‘configuring’ New Bing. Admittedly I have closer to a layperson’s understanding than an expert’s, but with some knowledge of how neural networks work, and having p…

There’s no other way to program it. There no “code” to speak of. The only way to control it is to give certain phrases more or less importance. You do that with direct prompts or tons and tons of training data.

I think what I’m saying is that that seems problematic (and I think the things we’ve seen from ChatGPT and Bing just emphasize this).

From chatting with these models, orders of magnitude better ‘understanding’* seems necessary before they’ll be able to actually reliably follow these ‘prompts’ during end-user conversations of the kind we’re expecting them to.

The prompts just can’t be precise enough, and the models can’t ‘understand’ them enough to extrapolate ‘spirit’ of the prompts as a human would (although, to be honest, I’m not sure a human could either because of the preciseness problem…).

This feels like a fundamental issue to me.

*I know - but if it looks like a duck and quacks like a duck - that’s been a controversial tenet of AI for decades…

Re: Prompt Engine – Microsoft's prompt engineering library

#90
post #64

Interesting, I just made myself something similar[1] because I found myself using the same prompts over and over again in either the OpenAI playground or in ChatGPT. The simple tool quickly provides builds up a form that either myself, or my staff can use. So far my pre-canned prompt forms are as follows[2]. [1] https://files.littlebird.com.au/Screen-Recording-2023-02-16-... [2] https://files.littlebird.com.au/Screen…

Great idea and I immediately see the value. The UI looks really clean, too. May I ask what CSS framework you are using?

https://tailwindcss.com/
Post reply on HN