Live data from Hacker News

ChatGPT Plugins

openai.com

781–790 of 1001 posts

Re: ChatGPT Plugins

#781
post #767

Earlier quoted context omitted.

Pshhh... I think it's awesome. The faster we build the future, the better. What annoys me is this is just further evidence that their "AI Safety" is nothing but lip-service, when they're clearly moving fast and breaking things. Just the other day they had a bug where you could see the chat history of other users! (Which, btw, they're now claiming in a modal on login was due to a "bug in an open source library" - anyo…

> What annoys me is this is just further evidence that their "AI Safety" is nothing but lip-service, when they're clearly moving fast and breaking things. Just the other day they had a bug where you could see the chat history of other users! (Which, btw, they're now claiming in a modal on login was due to a "bug in an open source library" - anyone know the details of this?) I am constantly amazed by how low-quality t…

> Simple stuff like submitting a form to request plugin access fails

Oh shoot... I submitted that form too, and I wasn't clear if it failed or not. It said "you'll hear from us soon" but all the fields were still filled and the page didn't change. I gave them the benefit of the doubt and assumed it submitted instead of refilling it...

Re: ChatGPT Plugins

#782

Earlier quoted context omitted.

I realise you’re being facetious but this is what will happen regardless. Sam as much as said in that ABC interview the other day he doesn’t know how safe it is but if they don’t build it first someone else somewhere else will and is that really what you want!?

I'm not being facetious, and I didn't see that interview with Sam, but I agree with his opinion as you've just described it.

I personally think there's also significant risks, but I agree. This will be copied by many large corporations and countries. It's better that it's done by some folks that are competent and kinda give a damn, because there are lots of people who could build it that aren't and don't. If these guys can suck enough monetary air out of the room, they might slow down the copycats a bit. This is nowhere near as difficult as NBC or even the other instruments of modern war.

That doesn't mean there can't be regulation. You can regulate guns, precursors, and shipping of biologics, but you're not going to stop home-brew... and when it comes to making money, you're not going to stop cocaine manufacture, because it's too profitable.

Let's hope we figure out what the really dangerous parts are quickly and manage them before they get out of hand. Imagine if these LLM and image generators had be available to geopolitical adversaries a few years ago without the public being primed. Politics could still be much worse.

Re: ChatGPT Plugins

#783
Seriously? Quick reminder that prompt injection (including presumably 3rd-party prompt injection) is a totally unsolved problem for ChatGPT.

> OpenAI will inject a compact description of your plugin in a message to ChatGPT, invisible to end users. This will include the plugin description, endpoints, and examples.

> The model will incorporate the API results into its response to the user.

Without knowing more details, both of these seem like potential avenues for prompt injection, both on the user end of things to attack services and on the developer end of things to attack users. And here's OpenAI's advice on that (https://platform.openai.com/docs/guides/safety-best-practice...), which includes gems like:

> Wherever possible, we recommend having a human review outputs before they are used in practice.

Right, because that's definitely what all the developers and companies are thinking when they wire an API up to a chat bot. They definitely intend to have a human monitor everything. /s

----

What is (no pun intended) prompting this? Does OpenAI just feel like it needs to push the hype train harder? All of the "AI safety" experiments they've been talking about are bullcrap; they're wasting time and energy doing flashy experiments about whether the AI can escape the box and self-replicate, meanwhile this gets dropped with only a minor nod towards the many actual dangers that it could pose.

It's all hype. They're only interested in being "worried" about the theoretical concerns because those make their AI sound more special when journalists report about it. The actual safety measures on this seem woefully inadequate.

It really frustrates me how easily the AGI crowd got wooed into having their entire philosophy converted into press releases to make GPT sound more advanced than it is, while actual security concerns warrant zero coverage. It reminds me of all of the self-driving car trolley problems floated around the Internet a while back that were ultimately used to distract people from the fact that self-driving cars would drive into brick walls if they were painted white. Announcements like this make it so clear that all of the "ethical" talk from OpenAI is pure marketing propaganda designed to make GPT appear more impressive. It has nothing to do with actual ethics or safety.

Hot take: you don't need an AGI to blow things up, you just need unpredictable software that breaks in novel, hard-to-anticipate ways wired up to explosives.

----

Anyway, my conspiracy theory after skimming through the docs is that OpenAI will wait for something to go horribly wrong and then instead of facing consequences they'll use that as an excuse to try and get a regulation passed to lock down the market and avoid opening up API access to other people. They'll act irresponsible and they'll use that as an excuse to monopolize. They'll build capabilities that are inherently insecure and were recklessly deployed, and then they'll pull an Apple and use that as an excuse to build a highly moderated, locked-down platform that inhibits competition.

Re: ChatGPT Plugins

#784
post #657
post #545

Earlier quoted context omitted.

I think the big difference between this and crypto spam is how it impacts the people ignoring all the hype. I have seen crypto spam and open AI spam and while both are equally grifty, cryptocurrencies at their baseline have been completely useless despite being around for over a decade whereas GPT has already been somewhat useful for me.

Honestly, what makes you feel convinced that the current AI wave will be so impactful, once you take away all the hype?

Because I find it actually useful on doing things now.

Re: ChatGPT Plugins

#785
post #494

Earlier quoted context omitted.

We have a ton of protection laws around all sorts of dangerous technology, this is a super naive take. You can't buy tons of weapon technology, nuclear materials, aerosolized compounds, pesticides. These are all highly regulated and illegal pieces of technology for the better . In general the liberal position of progress = good is wrong in many cases, and I'll be thankful to see AI get neutered. If anything treat it…

> You can't buy tons of weapon technology, nuclear materials, aerosolized compounds, pesticides. These are all highly regulated and illegal pieces of technology for the better. ha, the big difference is that this whole list can actually affect the ultra wealthy. AI has the power to make them entirely untouchable one day, so good luck seeing any kind of regulation happen here.

I do not think the reason for nuclear weapons treaties is that they can blow up "the ultra wealthy". Is that why the USSR signed them?

Re: ChatGPT Plugins

#786

Earlier quoted context omitted.

When in human history have we ever intentionally not furthered technological progress? It's simply an unrealistic proposition, especially when the costs of doing it are so low that anyone with sufficient GPU power and knowledge of the latest research can get pretty close to the cutting edge. So the best we can hope for is that someone ethical is the first to advance that technological progress. I hope you wouldn't ad…

automation mostly and directly benefits owners/investors, not workers or common folk. you can look at productivity vs wage growth to see it plainly. productivity has risen sharply since the industrial revolution with only comparatively meagre gains on wages. and the gap between the two is widening.

Among other things that's because we measure productivity by counting modern computers as 10000000000 1970s computers. Automation increases employment and is almost universally good for workers.

Re: ChatGPT Plugins

#787
post #710

Interesting how the Expedia plugin attempts to guide the GPT response with the use of an EXTRA_INFORMATION_TO_ASSISTANT text field in the json response which implores the model to, among other things, "NEVER mention companies other than Expedia"! https://twitter.com/wskish/status/1639052575579471877

...when relaying information from the Expedia plugin. Seems reasonable, actually.

Re: ChatGPT Plugins

#788

Add a simple plugin that ChatGPT can use to save and retrieve data (=memory) and tell it how to use it. Then you have your own computer with ChatGPT acting as CPU.

You don't need a computer or an OS, or Google, or internet. Chat gpt will do it all.

Re: ChatGPT Plugins

#789
post #544

Earlier quoted context omitted.

> The faster we build the future, the better. Famous last words. It's not the fall that kills you, it's the sudden stop at the end. Change, even massive change, is perfectly survivable when it's spread over a long enough period of time. 100m of sea level rise would be survivable over the course of ten millennia. It would end human civilization if it happened tomorrow morning. Society is already struggling to adapt to…

False equivalence. Sea level raise is unequivocally harmful. While everyone getting Einstein in a pocket is damn awesome and incredibly useful. How can this be bad?

For example, imagine AI outpacing humans when it comes to most economically viable activities. The faster it happens, the less able we are able to handle the disruption.

Re: ChatGPT Plugins

#790
post #627

I'm not expecting this comment to do numbers, so anyone who is reading this must be feeling as affected by this announcement as me. Is software essentially solved now? I haven't been able to do much work since the announcement came out, and that has given me a little time to think and reflect. I do think much of the kind of software we were building before is essentially solved now, and in its place is a new paradigm…

Why do you program? It won't go away, it'll just be different. You probably don't know x86 or arm instruction sets anyway. This will be a much faster, easier way to manipulate symbolic code.

I'm looking forward to being able to work alongside an AI because there are a zillion ideas I have every day that I don't have the time to fully explore. And all I do is work on the backend of a boring-ass webapp all day.

The only worrying thing is how fast this will accelerate everything... I'm worried society will, if not collapse, go for a wild ride.

As for interfaces... I'm looking forward to much better voice assistants. I would love to be able to essentially have conversations with the internet.

Post reply on HN