Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

ChatGPT Plugins

openai.com

Post reply on HN
Print view View original

621–630 of 1001 posts

Re: ChatGPT Plugins

#621

Post by thanzex »

wahnfrieden wrote: post #455
seydor wrote: post #439

Earlier quoted context omitted.

I m hoping chatbots will end up small enough they can run locally, everywhere. This is a lot of private data. It may be doable - a chatbot with a lot of plugins does not need to know a lot of facts, just to have a good grasp of language. It can fetch its factual answers from the wikipedia plugin

openai wants to gatekeep access and use of their AI. so why would they ever release a local LLM? i think that would come from their enemies

I mean, GPT3 requires some 800GB of memory to run, do we all have gazillion dollars supercomputers at home? I think, unless there's some real breaktrough in the field or in the hw acceleration, this kind of model is going to stay locked behind a pricy API for quite some time.

Re: ChatGPT Plugins

#622

Post by zx10rse »

chatmasta wrote: post #353
mk_stjames wrote: post #277

I have some odd feelings about this. It took less than a year to go from "of course it isn't hooked up to the internet in any way, silly!" to "ok.... so we hooked up up to the internet..." First is your API calls, then your chatgpt-jailbreak-turns-into-a-bank-DDOS-attack, then your "today it somehow executed several hundred thousand threads of a python script that made perfectly timed trades at 8:31AM on the NYSE whi…

Pshhh... I think it's awesome. The faster we build the future, the better. What annoys me is this is just further evidence that their "AI Safety" is nothing but lip-service, when they're clearly moving fast and breaking things. Just the other day they had a bug where you could see the chat history of other users! (Which, btw, they're now claiming in a modal on login was due to a "bug in an open source library" - anyo…

You are not building anything.

Microsoft or perhaps Vanguard group might have different view of the future than yours.

Re: ChatGPT Plugins

#623

Post by vineyardmike »

sebzim4500 wrote: post #532
vineyardmike wrote: post #107

Earlier quoted context omitted.

People said this about Alexa/Siri et al and it didn’t happen. ChatGPT is way better at understanding you, so that’s a big boost. It could be a great tool/assistant but it probably won’t replace apps. The problem with those other platforms that this doesn’t address include: - discoverability. How do you learn what features a service supports. On a GUI you can just see the buttons, but on a chat interface you have to a…

>The conversational UI is a lot less convenient to include advertisements How so? Surely people are going to ask this thing for product recommendations, just recommend your sponsors.

This moves the advertisement opportunity to the chat owner. If you want to use chat (+api) to book a table at a restaurant, then the reservation-api company loses a change to advertise to you vs. if you used a dedicated reservation-web-app.

Re: ChatGPT Plugins

#624

Post by scarface74 »

endisneigh wrote: post #535
scarface74 wrote: post #408

Earlier quoted context omitted.

It’s not “trivial” because of the cost per query. As far as Google, it doesn’t even have access to the most valuable phone users without paying Apple $18B+ a year.

Something can be both expensive and trivial. If the market is huge they will bear the cost. The tech is well understood even now. The parameter size will likely be an order of magnitude less for gpt4 level results in a few years

If the fixed cost was huge, you would have point. But the variable costs are also huge.

I’m sure the market is also huge for dollars sold for 95 cents.

Re: ChatGPT Plugins

#625

Post by thrown123098 »

mk_stjames wrote: post #277

I have some odd feelings about this. It took less than a year to go from "of course it isn't hooked up to the internet in any way, silly!" to "ok.... so we hooked up up to the internet..." First is your API calls, then your chatgpt-jailbreak-turns-into-a-bank-DDOS-attack, then your "today it somehow executed several hundred thousand threads of a python script that made perfectly timed trades at 8:31AM on the NYSE whi…

> today it somehow executed several hundred thousand threads of a python script that made perfectly timed trades at 8:31AM on the NYSE which resulted in the largest single day drop since 1987.

Sorry do you have a link for this?

Re: ChatGPT Plugins

#626

Post by bagels »

chatmasta wrote: post #353
mk_stjames wrote: post #277

I have some odd feelings about this. It took less than a year to go from "of course it isn't hooked up to the internet in any way, silly!" to "ok.... so we hooked up up to the internet..." First is your API calls, then your chatgpt-jailbreak-turns-into-a-bank-DDOS-attack, then your "today it somehow executed several hundred thousand threads of a python script that made perfectly timed trades at 8:31AM on the NYSE whi…

Pshhh... I think it's awesome. The faster we build the future, the better. What annoys me is this is just further evidence that their "AI Safety" is nothing but lip-service, when they're clearly moving fast and breaking things. Just the other day they had a bug where you could see the chat history of other users! (Which, btw, they're now claiming in a modal on login was due to a "bug in an open source library" - anyo…

The future isn't guaranteed to be better. Might make sense to make sure we're aimed at a better future as opposed to any future.

Re: ChatGPT Plugins

#627

Post by gradys »

I'm not expecting this comment to do numbers, so anyone who is reading this must be feeling as affected by this announcement as me. Is software essentially solved now? I haven't been able to do much work since the announcement came out, and that has given me a little time to think and reflect.

I do think much of the kind of software we were building before is essentially solved now, and in its place is a new paradigm that is here to stay. OpenAI is certainly the first mover in this paradigm, but what is helping me feel less dread and more... excitement? opportunity? is that I don't think they have such an insurmountable monopoly on the whole thing forever. Sounds obvious once you say it. Here's why I think this:

- I expect a lot of competition on raw LLM capabilities. Big tech companies will compete from the top. Stability/Alpaca style approaches will compete from the bottom. Because of this, I don't think OpenAI will be able to capture all value from the paradigm or even raise prices that much in the long run just because they have the best models right now.

- OpenAI made the IMO extraordinary and under-discussed decision to use an open API specification format, where every API provider hosts a text file on their website saying how to use their API. This means even this plugin ecosystem isn't a walled garden that only the first mover controls.

- Chat is not the only possible interface for this technology. There is a large design space, and room for many more than one approach.

Taking all of this together, I think it's possible to develop alternatives to ChatGPT as interfaces in this new era of natural language computing, alternatives that are not just "ChatGPT but with fewer bugs". Doing this well is going to be the design problem of the decade. I have some ideas bouncing around my head in this direction.

Would love to talk to like minded people. I created a Discord server to talk about this ("Post-GPT Computing"): https://discord.gg/QUM64Gey8h

My email is also in my profile if you want to reach out there.

Re: ChatGPT Plugins

#628

Post by Riverheart »

Dma54rhs wrote: post #571
kibwen wrote: post #544

Earlier quoted context omitted.

> The faster we build the future, the better. Famous last words. It's not the fall that kills you, it's the sudden stop at the end. Change, even massive change, is perfectly survivable when it's spread over a long enough period of time. 100m of sea level rise would be survivable over the course of ten millennia. It would end human civilization if it happened tomorrow morning. Society is already struggling to adapt to…

The only people complaining are a section of comfortable office workers can probably see their places being possibly made irrelevant. The vast majority don't care and that loud crowd needs to swallow their pride and adapt like any other sector has done in the history instead of inventing these insane boogeyman predictions.

We’re all going to be made irrelevant and it will be harder to adapt if the things change too quickly. It may not even be us that needs to adapt but society itself. Really curious where you get the idea this is just a vocal minority of office workers concerned about the future. Seems like a lot of the ones not concerned about this are a bunch of super confident software engineer types which isn’t a large sample of the population.

Re: ChatGPT Plugins

#629

Post by int_19h »

Thorentis wrote: post #580
huijzer wrote: post #266

Based on the speed at which OpenAI is shipping new products and assuming that they use their own technology, I'm starting to get more and more convinced that their technology is a superpower. Timeline of shipping by them (based on https://twitter.com/E0M/status/1635727471747407872?s=20 ): DALL·E - July '22 ChatGPT - Nov '22 API's 66% cheaper - Aug '22 Embeddings 500x cheaper while SoTA - Dec '22 ChatGPT API. Also 10x…

The DoD really needs to step in and mark this tech as non-exportable due to the advantage (or potential advantage) it provides in many different fields.

Russia is already blocked from ChatGPT and Bing; I don't know about China.

But it's all security theater. Plenty of people use it with VPNs, and I know several who found it useful / interesting enough to bother paying for it (which involves foreign credit cards etc so it's kind of a hassle). I'm sure so does the Russian govt.

In any case, I don't see how you could realistically block any of that without effectively walling off the rest of the Internet.

Re: ChatGPT Plugins

#630

Post by int_19h »

killthebuddha wrote: post #479
twobitshifter wrote: post #171

Earlier quoted context omitted.

That’s how this plugin system works already.

I don't think this is the case. You provide an API spec but you also have to provide the implementation of that API. ChatGPT is basically a concierge between your API and the user.

I think the API is meant to be the data model in this scenario. The point is that you design the API around the task that it solves, rather than against whatever fixed spec OpenAI publishes. And then you tell ChatGPT, "here's an AI, make use of it for ..." - and it magically does, without you having to write any plumbing.
Post reply on HN