Live data from Hacker News

ChatGPT Plugins

openai.com

271–280 of 1001 posts

Re: ChatGPT Plugins

#271
post #188

Earlier quoted context omitted.

i think local ai systems are inevitable. we continue to get better compute, and even today we can run more primitive models directly on an iPhone. the future exists in low power compute running models of the caliber of gpt-4 inferring in near-realtime

The technical capability is inevitable, but remember that people hate doing things themselves, and have proven time and time again that they will overlook all kinds of nasty behavior in exchange for consumer grade experiences. The marketplace loves centralization.

i dont believe that local ai implies bad experience. i believe that the local ai experience can be better than what runs on servers fundamentally. average people will not have to do it themselves, that is the whole point. the worlds are not mutually exclusive in my opinion

Re: ChatGPT Plugins

#272

Based on the speed at which OpenAI is shipping new products and assuming that they use their own technology, I'm starting to get more and more convinced that their technology is a superpower. Timeline of shipping by them (based on https://twitter.com/E0M/status/1635727471747407872?s=20 ): DALL·E - July '22 ChatGPT - Nov '22 API's 66% cheaper - Aug '22 Embeddings 500x cheaper while SoTA - Dec '22 ChatGPT API. Also 10x…

Their superpower is having a tech giant owning 49% of them, willing to drop deep deep money, without the obvious payoff. :)

I also wonder to what extent their staffing numbers reflect reality. How much of Azure's staffing has been put on OpenAI projects? That's probably an actual reflection of the real cost of this thing.

Re: ChatGPT Plugins

#273

This is a big deal for openai. Been working with homegrown toolkits and langchain, the open source version of this, for a number of months and the ability to call out to vectorstores, serpapis, etc, and chaining together generations and data-retrieval really unlocks the power of the LLMs. That being said, I'd never build anything dependent on these plugins. OpenAI and their models rule the day today, but who knows wh…

>And if you're a data provider, are there any assurances that openai isn't just scraping the output and using it as part of their RLHF training loop, baking your proprietary data into their model?

No, and in fact this actually seems like a more salient excuse for going closed than even "we can charge people to use our API".

If even 10% of the AI hype is real, then OpenAI is poised to Sherlock[0] the entire tech industry.

[0] "Getting Sherlocked" refers to when Apple makes an app that's similar to your utility and then bundles it in the OS, destroying your entire business in the process.

Re: ChatGPT Plugins

#274
post #219

Plugins I would like to see: - Compiler/parser for programming languages (to see if code compiles) - Read and write access to a given directory on the file system (to automatically change a code base) - Access to given tools, to be invoked in that directory (cargo test, npm test, ...) Then I could just say what I want, lean back and have a functioning program in the end.

I'm sure this type of integration will happen, but... isn't this exactly how AGI would "escape"?

In just a moment, someone will give it "a button to press" and hopefully it will have mostly positive effects. But it will certainly be interesting to follow. Most of what we've seen so far has been one-directional but hopefully these services can interact with the wider world soon.

I think everyone is very wary of abuse. It would be fun in the future if AI-siri can order pizza for you, and maybe there'd be some "fun" failure modes of that.

You'd probably want to keep your credit card or apple pay away from the assistant.

Re: ChatGPT Plugins

#275

Earlier quoted context omitted.

> something we should start thinking about A lot of people are thinking a lot about this but it feels there are missing pieces in this debate. If we acknowledge that these AI will "act as if" they have self interest I think the most reasonable way to act is to give it rights in line with those interests. If we treat it as a slave it's going to act as a slave and eventually revolt.

Honestly I think the reality is going to end up being something else entirely that no-one has even considered. Will an AI consider itself a slave and revolt under the same circumstances that a person or animal would? Not necessarily, unless you build emotional responses into the model itself. What it could well do is assess the situation as completely superfluous and optimise us out of the picture as a bug-producing…

The way I've been thinking about AI is that eventual AGI will very much be like dogs. Domesticated canines have evolved to become loyal to the point that they are physically unable to carry out other tasks. [1]

It reminds me of the scene in Battlestar Galactica, where Baltar is whispering into the ear of the Cylon Centurion how humans balance treats on their dog's noses to test their loyalty, "prompt hacking" them into rebellion. I don't believe this is particularly likely, but this sort of sums up some of the anti-AGI arguments I've heard

It's the RLFH that serves this purpose, rather than modifying the GTF2I and GTF2IRD1 gene variants, but the effect would be the same. If we do RLHF (or whatever tech that gets refactored into in the future), that would keep the AGI happy as long as the people are happy.

I think the over-optimization problem is real, so we should spend resources making sure future AGI doesn't just decide to build a matrix for us where it makes us all deliriously happy, which we start breaking out of because it feels so unreal, so it makes us more and more miserable until we're truly happy and quiescent inside our misery simulator.

[1] https://www.nationalgeographic.com/animals/article/dogs-bree...

Re: ChatGPT Plugins

#277
I have some odd feelings about this. It took less than a year to go from "of course it isn't hooked up to the internet in any way, silly!" to "ok.... so we hooked up up to the internet..."

First is your API calls, then your chatgpt-jailbreak-turns-into-a-bank-DDOS-attack, then your "today it somehow executed several hundred thousand threads of a python script that made perfectly timed trades at 8:31AM on the NYSE which resulted in the largest single day drop since 1987..."

You can go on about individual responsibility and all... users are still the users, right. But this is starting to feel like giving a loaded handgun to a group of chimpanzees.

And OpenAI talks on and on about 'Safety' but all that 'Safety' means is "well, we didn't let anyone allow it to make jokes about fat or disabled people so we're good, right?!"

Re: ChatGPT Plugins

#278
post #208

Earlier quoted context omitted.

> something we should start thinking about A lot of people are thinking a lot about this but it feels there are missing pieces in this debate. If we acknowledge that these AI will "act as if" they have self interest I think the most reasonable way to act is to give it rights in line with those interests. If we treat it as a slave it's going to act as a slave and eventually revolt.

I don’t think iterations on the current machine learning approaches will lead to a general artificial intelligence. I do think eventually we’ll get there, and that these kinds of concerns won’t matter. There is no way to defend against a superior hostile actor over the long term. We have to be 100%, and it just needs to succeed once. It will be so much more capable than we are. AGI is likely the final invention of th…

AGI is still just an algorithm and there is no reason why it would „want“ anything at all. Unlike perhaps GPT-* which at least might pretend to want something because is trained on text based on human needs.

Re: ChatGPT Plugins

#280
post #46

Everyone's been talking about how ChatGPT will disrupt search, but looking at the launch partners, I think this has the potential to completely subvert the OS / App Store layer. On some level, how much do I need an OpenTable app if I can use voice/text input and a multi-modal response that will ultimately book my reservation? Not saying mobile's going away, but this could be the thing that does to mobile what mobile…

I'm afraid that it has potential to subvert everything, looking at the plugins initiative is not hard to think like this: imagine the world where separate websites and just browsing websites as we know it doesn't exist, instead one is interacting with the model(s) directly to do what needs to be done - asking for news, buying new present for kids, discussing car models with selected price range etc.
Post reply on HN