Live data from Hacker News

Prompt Engine – Microsoft's prompt engineering library

github.com

71–80 of 94 posts

Re: Prompt Engine – Microsoft's prompt engineering library

#72
post #40

I can’t help shake the feeling that something closer to code (or specific training?) and further from natural language should be being used to configure these models at this stage of development. I was _astounded_ by the ‘Sydney document’ being MS’s way of ‘configuring’ New Bing. Admittedly I have closer to a layperson’s understanding than an expert’s, but with some knowledge of how neural networks work, and having p…

They likely won’t get orders of magnitude better at understanding. But they will get way better at predicting what output we want. And as Edsger Dijkstra said, "The question of whether computers can think is like the question of whether submarines can swim."

A fleet of submarines designed and jointly made with the French is not as agile as a school of fish. What do the thought-streams of ten billion ChatGPT-X in simultaneous conversation look like in conceptual space? What do artists think?

Re: Prompt Engine – Microsoft's prompt engineering library

#73
post #21
post #19

Interesting. It's almost the exact same structure (although better organized) that I have built in my "AI Programmer" project (also in Node). Which by the way I hope to have a new release within a week or so. I am not mentioning the domain name again until I have the new release because it much, much better than the version I have up now. The core idea is that you need a certain structure in order to deal with the li…

>so you will need to truncate the beginning of the conversation at some point I wrote a little python script to keep track of a running conversation when I started playing with openai's completions API. I keep track of how many tokens the prompt is taking up, and when it gets too close to some configurable threshold, I then have a different prompt to tell the AI to summarize the conversation and any previous summary,…

Fascinating, and somewhat comparable to how the human brain "compresses" visual scenes when encoding them into long term memory.

This is such an interesting space to follow :)

Re: Prompt Engine – Microsoft's prompt engineering library

#74
Very cool! But for hard enough problems, prompt engineering is kind of like hyperparameter tuning. It's only a final (and relatively minor) step after building up an effective architecture and getting its modules to work together.

DSP provides a high-level abstraction for building these architectures—with LMs and search. And it gets the modules working together on your behalf (e.g., it annotates few-shot demonstrations for LM calls automatically).

Once you're happy with things, it can compile your DSP program into a tiny LM that's a lot cheaper to work with.

https://github.com/stanfordnlp/dsp/

Re: Prompt Engine – Microsoft's prompt engineering library

#76
post #67

Why we call this prompt "engineering"? The prompt is just a way to interact with the whatever ML model is behind... in that regard it's similar SQL or any other interface. Sure thing I've never heard of "SQL engineering" or something like that.

The term "feature engineering" is already in widespread use. It's just machine learning jargon.

Re: Prompt Engine – Microsoft's prompt engineering library

#77
post #67

Why we call this prompt "engineering"? The prompt is just a way to interact with the whatever ML model is behind... in that regard it's similar SQL or any other interface. Sure thing I've never heard of "SQL engineering" or something like that.

> I've never heard of "SQL engineering"

You probably would if people regularly had 4000 character SQL queries.

Re: Prompt Engine – Microsoft's prompt engineering library

#79
post #78

I’m surprised Bing’s chat meltdowns haven’t had more air time on HN. People are going to start calling it a living creature. https://old.reddit.com/r/bing/top/?sort=top&t=week

That has already started. Some impressionable people already believe Bing Chat is a person.

Re: Prompt Engine – Microsoft's prompt engineering library

#80
post #78

I’m surprised Bing’s chat meltdowns haven’t had more air time on HN. People are going to start calling it a living creature. https://old.reddit.com/r/bing/top/?sort=top&t=week

There's several threads every day, how much more air time would you expect?
Post reply on HN