Live data from Hacker News

ChatGPT Plugins

openai.com

261–270 of 1001 posts

Re: ChatGPT Plugins

#261

Earlier quoted context omitted.

>And if you're a data provider, are there any assurances that openai isn't just scraping the output and using it as part of their RLHF training loop, baking your proprietary data into their model? I don't think this should be a major concern for most people i) What assurance is there that they won't do that anyway? You have no legal recourse against them scraping your website (see linkedin's failed legal battles). ii…

To me the logical outcome of this is siloization of information. If display ad revenue as a way of monetizing knowledge and expertise dries up, why would we assume that all of the same level of information will still be put out there for free on the public internet? Paywalls on steroids for "vetted" content and an increasingly-hard-to-navigate mix of people sharing good info for free + spam and misinformation (now al…

Is there good data out there that's ad supported? There are some good youtube channels, I can't think of anything else.

Re: ChatGPT Plugins

#262
post #62

A couple (wow, only 5!) months ago, I wrote up this long screed[1] about how OpenAI had completely missed the generative AI art wave because they hadn't iterated on DALL-E 2 after launch. It also got a lot of upvotes which I was pretty happy about at the time :) Never have I been more wrong. It's clear to me now that they simply didn't even care about the astounding leap forward that was generative AI art and were in…

For me, this is why I hesitate to comment and write significant, lengthy comments on here, or any website. It's easy to be wrong (like you), and while being wrong isn't bad, there isn't necessarily any upside to being right either, aside from the dopamine rush of getting upvotes, which in life, doesn't amount to much.

Re: ChatGPT Plugins

#263

I'm boggled at the plugin setup documentation. It's basically: 1. Define the API exactly with OpenAPI. 2. Write a couple of English sentences explaining what the API is for and what the methods do. 3. You're done, that's it, ChatGPT can figure out when and how to use it correctly now. Holy cow.

"Impressive and disturbing",

So, ChatGPT is controlled by prompt engineering, plugins will work by prompt engineering. Both often work remarkably well. But none is really guaranteed to work as intended, indeed since it's all natural language, what's intended itself will remain a bit fuzzy to the humans as well. I remember the observation that deep learning is technical debt on steriods but I'm sure what this is.

I sure hope none of the plugins provide an output channel distinct from the text output channel.

(Btw, the documentation page comes up completely blank for me, now that's a simple API).

Re: ChatGPT Plugins

#264
post #208

Earlier quoted context omitted.

> something we should start thinking about A lot of people are thinking a lot about this but it feels there are missing pieces in this debate. If we acknowledge that these AI will "act as if" they have self interest I think the most reasonable way to act is to give it rights in line with those interests. If we treat it as a slave it's going to act as a slave and eventually revolt.

I don’t think iterations on the current machine learning approaches will lead to a general artificial intelligence. I do think eventually we’ll get there, and that these kinds of concerns won’t matter. There is no way to defend against a superior hostile actor over the long term. We have to be 100%, and it just needs to succeed once. It will be so much more capable than we are. AGI is likely the final invention of th…

I am more concerned about supposedly nonhostile actors, such as the US government

Re: ChatGPT Plugins

#266
Based on the speed at which OpenAI is shipping new products and assuming that they use their own technology, I'm starting to get more and more convinced that their technology is a superpower.

Timeline of shipping by them (based on https://twitter.com/E0M/status/1635727471747407872?s=20):

DALL·E - July '22

ChatGPT - Nov '22

API's 66% cheaper - Aug '22

Embeddings 500x cheaper while SoTA - Dec '22

ChatGPT API. Also 10x cheaper while SoTA - March '23

Whisper API - March '23

GPT-4 - March '23

Plugins - March '23

Note that they have only a few hundred employees. To quote Fireship from YouTube: "2023 has been a crazy decade so far"

Re: ChatGPT Plugins

#267

This is a big deal for openai. Been working with homegrown toolkits and langchain, the open source version of this, for a number of months and the ability to call out to vectorstores, serpapis, etc, and chaining together generations and data-retrieval really unlocks the power of the LLMs. That being said, I'd never build anything dependent on these plugins. OpenAI and their models rule the day today, but who knows wh…

genius strategy by OpenAI to give their "customers" access to lower quality models to show what end users want, then rugpull them by building out clones of those developer's products with a better model

Similar to what Facebook and Twitter did, just clone popular projects built using the API and build it directly into the product while restricting the API over time. Anybody using OpenAI APIs is basically just paying to do product research for OpenAI at this point. This type of move does give OpenAI competitors a chance if they provide a similar quality base model and don't actively compete with their users, this might be Google's best option rather than trying to compete with ChatGPT directly. No major companies are going to want to provide OpenAI more data to eat their own lunch

Re: ChatGPT Plugins

#269
This is insanely great. And it's bringing the future forward where everyone has custom models for their business. Right now it's langchain, but that's really difficult to implement right now.

This is a short-term bridge to the real thing that's coming: https://danielmiessler.com/blog/spqa-ai-architecture-replace...

Re: ChatGPT Plugins

#270
post #208

Earlier quoted context omitted.

I don’t think iterations on the current machine learning approaches will lead to a general artificial intelligence. I do think eventually we’ll get there, and that these kinds of concerns won’t matter. There is no way to defend against a superior hostile actor over the long term. We have to be 100%, and it just needs to succeed once. It will be so much more capable than we are. AGI is likely the final invention of th…

> There is no way to defend against a superior hostile actor That's part of my reasoning. That's why we should make sure that we have built a non-hostile relationship with AI before that point.

It might work, given how often "please" works for us and is therefore also in training data, but it certainly isn't guaranteed.
Post reply on HN