Live data from Hacker News

What does Alan Kay think about LLMs?

quora.com

131–140 of 155 posts

Re: What does Alan Kay think about LLMs?

#131

Earlier quoted context omitted.

Call me crazy, but I don't think the goal of AI should be to give the rock with electricity in it "a valuable experience".

What are you even talking about?

The right way to build AI. You know, the topic of this thread. I've been wondering what you're talking about, though.

Re: What does Alan Kay think about LLMs?

#132

Earlier quoted context omitted.

>But Alan Kay doesn’t say “use Erlang”, nor does he go into any depths about what the desirable feature set is and what would make it work or would fail to make it work. Oh yeah? Then how do you explain this lecture where he says explicitly that Erlang should be the modern programmer's assembly? https://youtu.be/fhOHn9TClXY In my experience, people who criticize Kay for being too vague or kvetching too pointlessly or…

It's somewhat of a backhanded compliment though -- calling Erlang a "modern assembly" is like the quip that C is a "portable assembler" -- that is, a tool useful for low-level stuff but which you should mostly use to implement higher level languages on top of.

I don't agree with this in the context of the full video. I'd encourage you to watch it; it's quite good. It's clear Armstrong and Kay have a great deal of respect for each other.

Re: What does Alan Kay think about LLMs?

#134

Earlier quoted context omitted.

We really should have figured out anthropomorphization and how to overcome it before we got to the "AI age".

One of the worst-case scenarios I can presently imagine for LLMs is a world so drowned in semi-plausible nonsense that new generations teach themselves to simply ignore the printed word, subconsciously categorizing it as noise, and in so doing essentially un-invent literacy.

Literacy isn't required if a computer can read any text. That is a huge amount of the brain that could be applied to something else.

Re: What does Alan Kay think about LLMs?

#135
post #97
post #71

Earlier quoted context omitted.

> Yes, that’s what I mean by vague suggestions. How do you actually build and maintain a system of any complexity with that? Reminds me of the RESTful guy, Roy Fielding (though I respect and like Alan Kay way more). If you've read any of his online interactions, apparently nobody does REST like he envisioned. It simply doesn't exist in the wild. When asked about some REST API, he'll claim it's not RESTful, it's wrong…

> the RESTful guy, Roy Fielding I think you're confused about who Fielding is and what REST is about. His writing isn't about building "true" RESTful APIs. It isn't really about APIs per se at all, RESTful or not. (Further, Fielding to my knowledge isn't even known for his use of the word "RESTful".) It sounds like you've probably been misled by a bunch of people who aren't Fielding about what's in his dissertation.…

[deleted]

Re: What does Alan Kay think about LLMs?

#136
post #125
post #71

Earlier quoted context omitted.

> Yes, that’s what I mean by vague suggestions. How do you actually build and maintain a system of any complexity with that? Reminds me of the RESTful guy, Roy Fielding (though I respect and like Alan Kay way more). If you've read any of his online interactions, apparently nobody does REST like he envisioned. It simply doesn't exist in the wild. When asked about some REST API, he'll claim it's not RESTful, it's wrong…

It's incredibly easy to build hypermedia as the engine of application state sites. You generate html pages with state in them, and hyperlinks and forms that filter and change the state. Hateoas didn't invent anything. He literally just described how web 1.0 worked.

[deleted]

Re: What does Alan Kay think about LLMs?

#137
post #38

Earlier quoted context omitted.

It's not specific to LLMs, but the point is LLMs will make things more efficient and therefore make 'a bigger straw' to drink the milkshake.

Why will LLMs make things more efficient? As I see it, LLMs have the potential to either reduce the amount of "bullshit jobs/tasks", reduce the amount of time programmers spend on boilerplate, etc. But those inefficiencies are 95% human made, on purpose . Bullshit tasks are made up because middle managers want more underlings. Languages/frameworks with lots of boilerplate exist because companies would rather hire fif…

The people holding the money bags who don't want the inefficiencies removed, will have their money bags removed by people who do.

Not instantly and not perfectly though. Inefficiency can be very resistant to change as you are pointing out.

Re: What does Alan Kay think about LLMs?

#138
post #120

Earlier quoted context omitted.

You are impressively wrong. He just wrapped up an incredible research program that demonstrated many concrete implementations of great computing ideas. > After 16 years of continuous research and important contributions toward its mission - "Improve 'powerful ideas education' for the world's children and to advance the state of systems research and personal computing" - Viewpoints Research Institute concluded its ope…

And what exactly is the output, other than talks and some programming learning tools for children? I haven't seen any significant new insights or advances.

> And what exactly is the output, other than talks and some programming learning tools for children?

The papers and demos are the output. They were a research outfit, not a startup. OP claimed that Kay "never offers anything but the most vague suggestions" when he (et. al.) provided several very concrete working demos. It's hardly his fault if no one took him up on them, is it? (FWIW I suspect some of their work had an effect on MS Word & Excel UI but I don't know for sure.)

> I haven't seen any significant new insights or advances.

Where have you looked? Did you read the papers that VPRI published? OMeta has been mentioned else-thread, I like that Nile programming language, the COLA system seems neat.

Re: What does Alan Kay think about LLMs?

#139
post #38

Earlier quoted context omitted.

It's not specific to LLMs, but the point is LLMs will make things more efficient and therefore make 'a bigger straw' to drink the milkshake.

Why will LLMs make things more efficient? As I see it, LLMs have the potential to either reduce the amount of "bullshit jobs/tasks", reduce the amount of time programmers spend on boilerplate, etc. But those inefficiencies are 95% human made, on purpose . Bullshit tasks are made up because middle managers want more underlings. Languages/frameworks with lots of boilerplate exist because companies would rather hire fif…

You should read Bullshit Jobs by David Graeber. Goes over why capitalism creates all these bullshit jobs despite theory saying otherwise. Have you considered that LLMs may increase the efficiency of bullshitization?

Re: What does Alan Kay think about LLMs?

#140
post #61

Earlier quoted context omitted.

Transparency won't help a lot from a technical standpoint (seems more like a solution to a legal issue than a technical one). I can't trust LLMs because they just...recombine text by probabilities and aren't deterministic. I get incorrect information every time I ask them a thing, and it's incorrect in different ways every time. The only things they seem to get consistently correct are very widespread facts that are…

I still find it funny we managed to get image generation working so much better than text. If you care about veracity then image generation works about as well as text. Frequently you can find details of the image that are just bizarrely wrong, such as hands or food or other basic things. It's the same basic problem: there's no intelligence behind what it's doing, it just regurgitates mostly realistic-seeming pixels…

Try looking at things from my angle: A few errors in an image can be not much of a big deal (with modern tools, the mistakes are within human margin of error on average), but errors in delivery of textual data such as facts, dates or code can be far more severe and subtle. There are ways to work around or reduce the shortcomings of image generation, and the quirks you mention have drop-in solutions for local installs, but you can't quite fix wrong facts in text automatically, or the context going off-rails. It can be much harder to catch than a hand missing a finger, too.

It's also worth mentioning you can run a heavily customized Stable Diffusion setup at home with fairly modest hardware with satisfactory results if you know what you are doing, but anything you can run at home for LLMs in the same hardware is dog slow and actually kind of terrible.

Post reply on HN