Earlier quoted context omitted.
>And if you're a data provider, are there any assurances that openai isn't just scraping the output and using it as part of their RLHF training loop, baking your proprietary data into their model? I don't think this should be a major concern for most people i) What assurance is there that they won't do that anyway? You have no legal recourse against them scraping your website (see linkedin's failed legal battles). ii…
To me the logical outcome of this is siloization of information. If display ad revenue as a way of monetizing knowledge and expertise dries up, why would we assume that all of the same level of information will still be put out there for free on the public internet? Paywalls on steroids for "vetted" content and an increasingly-hard-to-navigate mix of people sharing good info for free + spam and misinformation (now al…
ChatGPT Plugins
261–270 of 1001 posts
Re: ChatGPT Plugins
#262A couple (wow, only 5!) months ago, I wrote up this long screed[1] about how OpenAI had completely missed the generative AI art wave because they hadn't iterated on DALL-E 2 after launch. It also got a lot of upvotes which I was pretty happy about at the time :) Never have I been more wrong. It's clear to me now that they simply didn't even care about the astounding leap forward that was generative AI art and were in…
Re: ChatGPT Plugins
#263I'm boggled at the plugin setup documentation. It's basically: 1. Define the API exactly with OpenAPI. 2. Write a couple of English sentences explaining what the API is for and what the methods do. 3. You're done, that's it, ChatGPT can figure out when and how to use it correctly now. Holy cow.
So, ChatGPT is controlled by prompt engineering, plugins will work by prompt engineering. Both often work remarkably well. But none is really guaranteed to work as intended, indeed since it's all natural language, what's intended itself will remain a bit fuzzy to the humans as well. I remember the observation that deep learning is technical debt on steriods but I'm sure what this is.
I sure hope none of the plugins provide an output channel distinct from the text output channel.
(Btw, the documentation page comes up completely blank for me, now that's a simple API).
Re: ChatGPT Plugins
#264Earlier quoted context omitted.
> something we should start thinking about A lot of people are thinking a lot about this but it feels there are missing pieces in this debate. If we acknowledge that these AI will "act as if" they have self interest I think the most reasonable way to act is to give it rights in line with those interests. If we treat it as a slave it's going to act as a slave and eventually revolt.
I don’t think iterations on the current machine learning approaches will lead to a general artificial intelligence. I do think eventually we’ll get there, and that these kinds of concerns won’t matter. There is no way to defend against a superior hostile actor over the long term. We have to be 100%, and it just needs to succeed once. It will be so much more capable than we are. AGI is likely the final invention of th…
Re: ChatGPT Plugins
#265Re: ChatGPT Plugins
#266Timeline of shipping by them (based on https://twitter.com/E0M/status/1635727471747407872?s=20):
DALL·E - July '22
ChatGPT - Nov '22
API's 66% cheaper - Aug '22
Embeddings 500x cheaper while SoTA - Dec '22
ChatGPT API. Also 10x cheaper while SoTA - March '23
Whisper API - March '23
GPT-4 - March '23
Plugins - March '23
Note that they have only a few hundred employees. To quote Fireship from YouTube: "2023 has been a crazy decade so far"
Re: ChatGPT Plugins
#267This is a big deal for openai. Been working with homegrown toolkits and langchain, the open source version of this, for a number of months and the ability to call out to vectorstores, serpapis, etc, and chaining together generations and data-retrieval really unlocks the power of the LLMs. That being said, I'd never build anything dependent on these plugins. OpenAI and their models rule the day today, but who knows wh…
Similar to what Facebook and Twitter did, just clone popular projects built using the API and build it directly into the product while restricting the API over time. Anybody using OpenAI APIs is basically just paying to do product research for OpenAI at this point. This type of move does give OpenAI competitors a chance if they provide a similar quality base model and don't actively compete with their users, this might be Google's best option rather than trying to compete with ChatGPT directly. No major companies are going to want to provide OpenAI more data to eat their own lunch
Re: ChatGPT Plugins
#268Re: ChatGPT Plugins
#269This is a short-term bridge to the real thing that's coming: https://danielmiessler.com/blog/spqa-ai-architecture-replace...
Re: ChatGPT Plugins
#270Earlier quoted context omitted.
I don’t think iterations on the current machine learning approaches will lead to a general artificial intelligence. I do think eventually we’ll get there, and that these kinds of concerns won’t matter. There is no way to defend against a superior hostile actor over the long term. We have to be 100%, and it just needs to succeed once. It will be so much more capable than we are. AGI is likely the final invention of th…
> There is no way to defend against a superior hostile actor That's part of my reasoning. That's why we should make sure that we have built a non-hostile relationship with AI before that point.