Live data from Hacker News

Natural language is an unnatural interface

varunshenoy.substack.com

21–30 of 94 posts

Re: Natural language is an unnatural interface

#22
post #17

Earlier quoted context omitted.

Yet this is how we communicate with designers and end up with good results.

I think that confuses doing versus delegating . Delegation is easy to do via a text-box, because you're just kicking the interactive complexity-can down the road to someone else, often in a way which can be problematic even with actual humans. For example, a project-manager or executive could verbally delegate "make a new registration page for the site" and "needs more rounded corners", either to an AI or to an emplo…

I have been using Dall-e, and testing the dall-e chatgpt plugin. Even tough both are supposedly natural language interfaces, I find I approach the dall-e prompt more like writing a formula than real language. Using the gpt plugin is like delegating to a designer to write the prompt for you. personally I don't like the results of that compared to what I would make myself.

Re: Natural language is an unnatural interface

#23
post #8

> unnatural interface A simple example might be the problem of "pick a color". Even the best natural-language interface is going to suck about as much as if you're trying to ask another human to do it for you, even if that assistant is capable of displaying 1-5 color swatches in their replies. Instead of just seeing the entire palette and choosing, you need to say "I want a gold color", "lighter than that" and "darke…

Yet this is how we communicate with designers and end up with good results.

The designers have context: from the data we need to gather or display to the design system in use to the devices our system runs on.

You don't have to tell them all that from scratch every time you interact with them.

Re: Natural language is an unnatural interface

#24
I started reading and I found the text not engaging, perhaps it's me being not in the right mood, but while deciding to stop reading, Substack showed a popup. What the hell. Enough enshittification. I dropped the thing and started to complain here. (shrugs)

Re: Natural language is an unnatural interface

#25
post #19

Earlier quoted context omitted.

> or, better yet, the open ears of a friendly audio assistant It’s interesting you mention this. I’ve been wondering this for a while now - there have been made leaps recently in LLMs, speech synthesis and speech recognition. There are sophisticated language models, computer voices that are hard to distinguish from real humans, and software that can reliably understand even the worst recording of someone speaking. Ye…

Principal–agent problem! Previous generation assistants have been frozen in time by managerial capitalism. This is evident in literally all the incumbents that matter in the western world: Google, Amazon, Apple, Microsoft and Samsung. It took founder-led OpenAI to kick everyone in the butt. Thankfully the wheels are moving again to get to what you're describing, an inevitability in the very near future.

Who are the principal and the agent here?

Re: Natural language is an unnatural interface

#27
post #19

"There is nothing, I repeat nothing, more intimidating than an empty text box staring you in the face." Talk about a hyperbolic opening line. Is it really that intimidating to have an empty text box on Whatsapp or your favorite SMS app? No, as you expect to have an appropriate response coming from the other side, pretty much regardless of what your input is. As a frequent user of ChatGPT, I've come to expect the same…

> or, better yet, the open ears of a friendly audio assistant It’s interesting you mention this. I’ve been wondering this for a while now - there have been made leaps recently in LLMs, speech synthesis and speech recognition. There are sophisticated language models, computer voices that are hard to distinguish from real humans, and software that can reliably understand even the worst recording of someone speaking. Ye…

It makes it seem creepy and hides that it’s a robot. The limitations are easier to understand when someone knows it isn’t a human.

Re: Natural language is an unnatural interface

#28
The problem is that most people don't know how to express what they want (and often they dont know what they want). But it's a bit myopic to stick to language interfaces, the LLMs are already integrated with images, and over time they will be integrated with entire GUIs.

Re: Natural language is an unnatural interface

#29
post #12

Reminds me of the boom in voice assistants, when we were told it was the interface of the future. I’d ask my Google Home what the temperature was going to be today. It would tell me. I’d ask what the temperature was yesterday. It would tell me it didn’t understand the question. ChatGPT etc obviously aren’t quite that bad but the core problem remains discoverability. It isn’t at all clear what these interfaces can and…

Add to this that voice assistants fundamentally got worse and worse as their makers tried to monetise, increase usage etc. it took cool tech and made it annoying.

I can see llms going much the same way.

Re: Natural language is an unnatural interface

#30
post #17

Earlier quoted context omitted.

Yet this is how we communicate with designers and end up with good results.

I think that confuses doing versus delegating . Delegation is easy to do via a text-box, because you're just kicking the interactive complexity-can down the road to someone else, often in a way which can be problematic even with actual humans. For example, a project-manager or executive could verbally delegate "make a new registration page for the site" and "needs more rounded corners", either to an AI or to an emplo…

> I think that confuses doing versus delegating.

This is exactly it, thanks for putting it down clearly.

Which is also why news of the death of programming as a profession are greatly exagerated. You're not being paid to write code, you're being paid to make decisions. Code is easy, or at least much easier than natural language.

Post reply on HN