Those 2 chatbots could be of different models. Would they then teach each other something new?
Scaffolded LLMs as natural language computers
21–26 of 26 posts
Re: Scaffolded LLMs as natural language computers
#22I think the issue is that the sentence "Many tasks cannot be specified easily and precisely in computer code but can be described in a sentence or two of natural language" is not, in fact, true. Natural language is a pretty fantastically bad interface for specifying unambiguous, repeatable, and reliable tasks, which is why most technical advancement has involved the introduction of expressive notations that clarify a…
Re: Scaffolded LLMs as natural language computers
#23I think the issue is that the sentence "Many tasks cannot be specified easily and precisely in computer code but can be described in a sentence or two of natural language" is not, in fact, true. Natural language is a pretty fantastically bad interface for specifying unambiguous, repeatable, and reliable tasks, which is why most technical advancement has involved the introduction of expressive notations that clarify a…
Re: Scaffolded LLMs as natural language computers
#24I am interested to see how the concept longterm memory is developed with LLMs. It seems very slow to use fine tuning for this process. On the topic of summarizing and determinism, I wonder if an intermediate bytecode loke language or structured subset of the English language could improve the outcome across models.
Re: Scaffolded LLMs as natural language computers
#25Can we dive into the idea of "semantic error correcting codes" in this thread please?
Re: Scaffolded LLMs as natural language computers
#26People have already started writing the languages. Here's an example that I think is really neat: https://github.com/jbrukh/gpt-jargon .