Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPTs: Custom versions of ChatGPT

openai.com

Post reply on HN
Print view View original

91–100 of 341 posts

Re: GPTs: Custom versions of ChatGPT

#91

Post by tacone »

siva7 wrote: post #16

So i guess the next wave of startups has been killed. I'm not even sure what kind of startup still makes sense as a gpt thin wrapper?

It's just commoditization, hard things now becoming a lot easier and value proposition to move up elsewhere.

It happened with hardware, operative systems, web tools such as maps etc.

Re: GPTs: Custom versions of ChatGPT

#92

Post by mg »

BoorishBears wrote: post #90
mg wrote: post #81

So these "GPTs" are the combination of predefined prompts and custom API access? Not customly trained LLMs? If so, I guess you can make such a "GPT" on your own server and independent from a specific LLM service by using a prompt like ...you have available an API "WEATHER_API". If you need the weather for a given city for a given day, please say WEATHER_API('berlin', '2022-11-24') and I will give you a new prompt inc…

If you want to be independent for academic/personal reasons, sure you can. If you want reasoning capabilities that Open Source hasn't matched before today, and I'm guessing just got blown out of the water on again today... there's no reason to bother.

You don't need to use an open source LLM for the approach I described. You can still send the prompts to OpenAI's GPT-4 or any other LLM which is available as a service.

Re: GPTs: Custom versions of ChatGPT

#93

Post by user_7832 »

imdsm wrote: post #70
bilsbie wrote: post #51

Earlier quoted context omitted.

I’m not clear who the market is? Why someone buy one?

Imagine a "GPT" that could generate websites and provide you with a live deployment as you change it using natural language. A website builder GPT that is primed to output and design in a decent way, that has all the prep beforehand to use particular libraries, and integrations with something like Render. People would pay for that. Sh--... I better build it!

All fun and games until someone sues because the "hallucinated" product description didn't match the product...

Re: GPTs: Custom versions of ChatGPT

#96

Post by block_dagger »

imdsm wrote: post #70
bilsbie wrote: post #51

Earlier quoted context omitted.

I’m not clear who the market is? Why someone buy one?

Imagine a "GPT" that could generate websites and provide you with a live deployment as you change it using natural language. A website builder GPT that is primed to output and design in a decent way, that has all the prep beforehand to use particular libraries, and integrations with something like Render. People would pay for that. Sh--... I better build it!

One can come up with all sorts of ideas like this, but building it will be a matter of slow iterations at prompt engineering in a mixture of natural language and data structures and will be at the whim of changing APIs, including the backing ChatGPT model. Sounds messy, hard to manage, hard to test...or am I missing what the actual process will be for creating one of these?

Re: GPTs: Custom versions of ChatGPT

#97

Post by burningion »

mg wrote: post #81

So these "GPTs" are the combination of predefined prompts and custom API access? Not customly trained LLMs? If so, I guess you can make such a "GPT" on your own server and independent from a specific LLM service by using a prompt like ...you have available an API "WEATHER_API". If you need the weather for a given city for a given day, please say WEATHER_API('berlin', '2022-11-24') and I will give you a new prompt inc…

That's the thing, we don't know.

The lack of transparency for how the product works behind the scenes will most likely make it difficult to build something effectively.

Re: GPTs: Custom versions of ChatGPT

#98

Post by Racing0461 »

Barrier to entry for commercial or useful GPTs/Plugins/"Agents" is almost non-existant since its just a str.concat(hiddenprompt, user_prompt), the secret sauce (ie the weights, chat timeout and context length) are already generated/limited by OpenAI and they already have the content moderation/"hr dept" baked in at the weights level. So even if one was to create a "story writer helper" GPT, i don't see how it would be of any value generating new, unique and interesting content other than the prompt recipes we already have on reddit/r/chatgpt (heres 1000 prompts for every use case) that creates netflix like plots (inclusively diverse casting across ethnicities and orientations, socially conscious storylines, modern jargon-filled dialogue, themes of empowerment, progressive characters, and non-traditional relationship dynamics).

This will most likely be like the google play store with a 99% of GPTs being a repackaged public prompt.

Re: GPTs: Custom versions of ChatGPT

#99

Post by minimaxir »

tracerbulletx wrote: post #94

Can anyone explain what "extra knowledge" means specifically? Is that like fine tuning? How much data can I give it to learn? How much can it retain? Can it be updated over time?

The keynote used a .txt file of a lecture that the user uploaded as a data source the model can select from. From a technical perspective, it's anoher data source for retrieval-augmented generation (RAG) doing a vector search in the background: https://platform.openai.com/docs/assistants/tools/knowledge-...

Re: GPTs: Custom versions of ChatGPT

#100

Post by Racing0461 »

tracerbulletx wrote: post #94

Can anyone explain what "extra knowledge" means specifically? Is that like fine tuning? How much data can I give it to learn? How much can it retain? Can it be updated over time?

I doublt it's fine tuning (actually changing the model weights). It's more like "im going to paste a text blob then in the following chats i will ask questions about it) type inner prompt.
Post reply on HN