Earlier quoted context omitted.
I was wondering why nobody combines LLMs with well-known symbolic AI like CYC[1]. Or, perhaps I'm wrong and plenty of companies are working on it. [1] https://cyc.com/
It depends what you mean by combine. They work in fundamentally different ways. It's a bit like combining an internal combustion engine with a ramjet. You might be able to compose systems that use LLMs for some sub-components and symbolic AI for other functions. So for example if ChatGPT gets asked a question that LLMs are poor at but symbolic systems are good at, it could switch to using a symbolic system, but that'…
Re: Understanding large language models: A cross-section of the relevant literature
#31What I had in mind was to make the output of a natural language parser into symbolic semantic representations (the folks at CYC have such parsers) an additional part of the training data set of the LLM.