Live data from Hacker News

Understanding large language models: A cross-section of the relevant literature

magazine.sebastianraschka.com

31–32 of 32 posts

Re: Understanding large language models: A cross-section of the relevant literature

#31
post #23

Earlier quoted context omitted.

I was wondering why nobody combines LLMs with well-known symbolic AI like CYC[1]. Or, perhaps I'm wrong and plenty of companies are working on it. [1] https://cyc.com/

It depends what you mean by combine. They work in fundamentally different ways. It's a bit like combining an internal combustion engine with a ramjet. You might be able to compose systems that use LLMs for some sub-components and symbolic AI for other functions. So for example if ChatGPT gets asked a question that LLMs are poor at but symbolic systems are good at, it could switch to using a symbolic system, but that'…

What I had in mind was to make the output of a natural language parser into symbolic semantic representations (the folks at CYC have such parsers) an additional part of the training data set of the LLM.

Re: Understanding large language models: A cross-section of the relevant literature

#32
post #10

Earlier quoted context omitted.

So you think the logical patterns found in human language might also be similar enough to the logical patterns found in other systems that these LLMs have a jumpstart in figuring those out? We already have such a poor idea of how these things seem to understand so much… it’ll be a wild day when cancer is cured and we have absolutely no idea why.

You can't "cure cancer" because "cancer" is a label for different things with different causes. If your brain cells all have the wrong DNA there's no way to get different brain cells.

I was using the phrase sort of idiomatically, but fair enough!
Post reply on HN