Live data from Hacker News

A new way to build with Large Language Models

blog.fixie.ai

11–20 of 46 posts

Re: A new way to build with Large Language Models

#11
post #7
post #4

Neat. I was just thinking that one thing you can do that current large language models don't do is use a calculator to check your work. So, the first thing I'd want to try is hooking up some basic arithmetic to see if its math gets more reliable. And if not, why not? Seems like someone would have tried this already?

It's built-in :-)

Can you say anything more about how well it works?

Re: A new way to build with Large Language Models

#12

Could you use this to provide better support chat bots? That is, support bots obviously need to be scoped so that they only give information the user asking has rights to, e.g. "Show me the stocks in my portfolio". Assuming the user has logged into the interface showing the chat, is there a way to pass that user's unique access token through to one of these Fixie Agents to ensure that the data being accessed is scope…

Short answer: yes! We think this is actually a super compelling use case, and there are a few different ways to accomplish it. We already support auth mechanisms like Oauth, and there is also agent storage built in.

Re: A new way to build with Large Language Models

#13
post #5

Neat, this is like a SaaS version of Langchain[1]. For those who haven't already seen it, Langchain is a framework that gives you the ability to do this as well as integrate out of the box solutions for other common problems like memory. [1] https://langchain.readthedocs.io/en/latest/

Langchain is awesome. Another great library is GPT Index. This field is apparently being called "prompt orchestration" (getting data from external sources, chaining going back and forth with an LLM, etc).

Also lambdaprompt https://github.com/approximatelabs/lambdaprompt

Re: A new way to build with Large Language Models

#16

Looks interesting, can you show us more use cases on the landing page? The stock price example is okay, but I want to see what I can use this for that I can't currently do easily. What problems does this solve?

Yeah, great feedback. We'll have a bunch more examples that vary in complexity coming out in the next couple of weeks.

Re: A new way to build with Large Language Models

#17
I've wanted something like this for years! And just started building it myself last month (mostly for home automation). I like the multi-agent model, and the "thought" steps are pretty interesting. But how do you deal with context length with all the back and forth?

Re: A new way to build with Large Language Models

#18
If you ask an existing LLM for a stock quote, it will hallucinate one, or give you a price it found in the snapshot of the web that it was trained on. But the intent here is to build a system that knows it should call an external service to get the right answer. It seems that there's a risk, though: the platform might use the correct service and get an accurate answer. Or it might make up a plausible answer. Who knows?
Post reply on HN