Live data from Hacker News

ChatGPT Plugins

openai.com

51–60 of 1001 posts

Re: ChatGPT Plugins

#51

Earlier quoted context omitted.

The fact that the model does not have to rely on its internal knowledge anymore but can communicate literally with any external system makes me feel it may significantly reduce the hallucination.

If it was easy to simply verify truth "with any external system" then would we even need a language model? E.g. if you could just ask [THING] for the true answer, or verify an answer trivially with it... just ask it directly! I ran into this issue with some software documentation just this morning - the answer was helpful but completely wrong in some intermediate steps - but short of a plugin that literally controlle…

ChatGPT is already pretty good at "admitting" it's wrong when it's given the actual facts, so it does seem likely that providing it with a way to e.g. look up trusted sources and ask it to take those sources into consideration might improve things.

Re: ChatGPT Plugins

#54
post #46

Everyone's been talking about how ChatGPT will disrupt search, but looking at the launch partners, I think this has the potential to completely subvert the OS / App Store layer. On some level, how much do I need an OpenTable app if I can use voice/text input and a multi-modal response that will ultimately book my reservation? Not saying mobile's going away, but this could be the thing that does to mobile what mobile…

I agree, it's a revolutionary new better UX paradigm.

Re: ChatGPT Plugins

#55
I've got to wonder, how does a second player in the LLM space even get on the board?

Like, this feels a lot like when the iPhone jumped out to grab the lion share of mobile. But the switching costs was much smaller (end users could just go out and buy an Android phone), and network effects much weaker (synergy with iTunes and the famous blue bubbles... and that's about it). Here it feels like a lot of the value is embedded in the business relationships OpenAI's building up, which seem _much_ more difficult to dislodge, even if others catch up from a capabilities perspective.

Re: ChatGPT Plugins

#56

That's a game-changer! It seems like factuality issues with ChatGPT might be fixed. We wrote a blog post on how to get started with a custom plugin: https://qdrant.tech/articles/chatgpt-plugin/

>It seems like factuality issues with ChatGPT might be fixed. Is that really possible to fix that just from a plug-in? All it has to do is admit when it doesn't have the answer, and yet it won't even do that. This leads me to think that ChatGPT doesn't even know when it's lying, so i can't imagine how a plug-in will fix that.

The key piece will be when it queries multiple services by default and compares the answers to its own inferences, and is prompted to trust majority opinion or report that there isn't consensus. The iterative question about moons larger than Mercury in the Wolfram Alpha thread is a simple example of iterative tool use.

Re: ChatGPT Plugins

#57

This is a big deal for openai. Been working with homegrown toolkits and langchain, the open source version of this, for a number of months and the ability to call out to vectorstores, serpapis, etc, and chaining together generations and data-retrieval really unlocks the power of the LLMs. That being said, I'd never build anything dependent on these plugins. OpenAI and their models rule the day today, but who knows wh…

> That being said, I'd never build anything dependent on these plugins.

Very smart and to avoid OpenAI pulling the rug.

> Building on a open source framework (like langchain/gpt-index/roll your own), and having the ability to swap out the brain boxes behind the scenes is the only way forward IMO.

Better to do that rather than to depend on one and swap out other LLMs. A free idea and a protection against abrupt policy, deprecations and price changes. Price increases will certainly vary (especially with ChatGPT) and will eventually increase in the future.

Probably will end up quoting myself on this in the future.

Re: ChatGPT Plugins

#58

This is a big deal for openai. Been working with homegrown toolkits and langchain, the open source version of this, for a number of months and the ability to call out to vectorstores, serpapis, etc, and chaining together generations and data-retrieval really unlocks the power of the LLMs. That being said, I'd never build anything dependent on these plugins. OpenAI and their models rule the day today, but who knows wh…

It's not necessarily an either-or. Your local LLM could offload hard problems to a service by encoding information about your request together with context and relevant information about you into a vector, send that off for analysis, then decode the vector locally to do stuff. It'd be like asking a friend when available.

Re: ChatGPT Plugins

#59
Seems like someone already wrote an HN plugin. More than one enthusiastic comment per minute on this thread and it was just posted half an hour ago. Plus HN is filled with enthusiasm about ChatGPT today. Seems sus.

Re: ChatGPT Plugins

#60
post #42

Any idea how this is done? I.e. is it just priming the underlying GPT model with plugin information additionally to the user input ("you can ask Wolfram Alpha by replying 'hey wolfram: ...' ") and performing API calls when the GPT model returns certain keywords ('hey wolfram: $1')?

Yup, basically.

Edit: see here: https://github.com/openai/chatgpt-retrieval-plugin/blob/main...

I did this a while back with ARKit: https://github.com/trzy/ChatARKit/blob/17fca768ce8abd39fb27d...

Post reply on HN