Live data from Hacker News

CustomGPT

customgpt.ai

11–20 of 33 posts

Re: CustomGPT

#11

Does anyone have any pointers as to how I can train ChatGPT on my personal corpus and create my own personal assistant?

Just shove all your information in the prompt. I assume that's what these guys are doing anyway. ChatGPT doesn't yet have any API, but you can use text-davinci-003, which does have an API and is functionally identical.

The API costs for a large prompt are quite high, and since you have to repeat it with every single query, your costs can go up very quickly.

Re: CustomGPT

#12
I did a similar thing where i had a specific "journal" chat with CGPT and gave it a biography and primed it to act like Socrates with mental health training, and counselor skills. I get it to give prompts and also ask questions that promote elaboration.

Actually journaling for the first time in my life, it is amazing when it remembers things that i have told it and is super motivational, especially since it is always available and never gets bored of me asking for advice or venting about my day.

Re: CustomGPT

#13
post #9
post #4

Page is down, but here is a description of the service by the founder himself: https://www.producthunt.com/posts/customgpt Does anyone knowledgeable in AI know how feasible the claim of training your custom ChatGPT really is? Because this would be the holy grail we’ve all been waiting for, no?

I wonder if it's actually "trained" or is it rather "imagine you've generated all that fancy text content, which follows now: ${content}".

I also though of this (prompt engineering), but I think that would hit the token limit pretty fast.

Re: CustomGPT

#14
Am I too harsh for expecting that in 2023, a company actively signing up customers for a cloud-based service should have enough autoscaling so that getting to the front page of HN doesn't overload the landing page? It just doesn't give me much faith that the actual product will be stable enough to use. Especially just giving a generic 5XX error from nginx is a bad sign.

Edit: did this get manually knocked off the front page without getting flagged?

Re: CustomGPT

#15
post #8

Founders really need to start doing 10 minutes of due diligence to ensure that their sites won't crash and burn under moderate Hacker News or Product Hunt traffic before posting at these places. You get one shot at front page success, and are now losing valuable impressions because people can't even open your website. And you not being able to keep a marketing page up and running doesn't really give me confidence in…

> A few clicks in Cloudflare could have easily prevented this.

In my experience, this is surprisingly harder to achieve in practice than it sounds. I've had to spend quite a lot of time figuring out CloudFlare's arcane composition of page rules that would prevent a simple web site's denial of service by a simple netcat command.

Re: CustomGPT

#16
post #4

Page is down, but here is a description of the service by the founder himself: https://www.producthunt.com/posts/customgpt Does anyone knowledgeable in AI know how feasible the claim of training your custom ChatGPT really is? Because this would be the holy grail we’ve all been waiting for, no?

Training a custom chatbot is easy. Having it reliably retrieve the data you want is hard. For any given question, you can get it to look at a maximum of 4k tokens (16k characters, or 3k or so words). So when you want your chatbot to have access to a LOT of data, you usually end up having to work around that - typically by:

1. chunking up your documents into ~2k word chunks, 2. and then getting the query, doing a search using that query, and getting the top N results back, 3. running the prompt on each result, and then 4. gradually combining the results of each run of the prompt.

Each step is a little lossy, and there are quite a few steps there, so the bigger the corpus gets, the lossier/less useful your bot is.

Now that being said, there are ways to improve that, but for now at least, its unlikely that a single slackbot is going to solve all your knowledge management problems for you.

Re: CustomGPT

#17

Does anyone have any pointers as to how I can train ChatGPT on my personal corpus and create my own personal assistant?

Just shove all your information in the prompt. I assume that's what these guys are doing anyway. ChatGPT doesn't yet have any API, but you can use text-davinci-003, which does have an API and is functionally identical. The API costs for a large prompt are quite high, and since you have to repeat it with every single query, your costs can go up very quickly.

Gotcha! Thanks for the response. So if I have, say, 10 PDF files which I plan to extract text from and use to fine-tune davinci, I would have to supply the entire textual information extracted from the PDF file each time?

Re: CustomGPT

#18

Does anyone have any pointers as to how I can train ChatGPT on my personal corpus and create my own personal assistant?

Check OpeanAI's tutorials [1] and cookbook [2]. Or try LangChain [3], which abstracts a lot of the work.

[1] - https://platform.openai.com/docs/tutorials [2] - https://github.com/openai/openai-cookbook [3] - https://github.com/hwchase17/langchain

Re: CustomGPT

#20
post #8

Founders really need to start doing 10 minutes of due diligence to ensure that their sites won't crash and burn under moderate Hacker News or Product Hunt traffic before posting at these places. You get one shot at front page success, and are now losing valuable impressions because people can't even open your website. And you not being able to keep a marketing page up and running doesn't really give me confidence in…

> A few clicks in Cloudflare could have easily prevented this. In my experience, this is surprisingly harder to achieve in practice than it sounds. I've had to spend quite a lot of time figuring out CloudFlare's arcane composition of page rules that would prevent a simple web site's denial of service by a simple netcat command.

That says more about Cloudflare than you think it's saying about you, tbh. I see this often, many people enlist their site into Cloudflare and consider the job done, and Cloudflare doesn't necessarily discourage that either until their app draws traffic and suddenly sales is your new neighbor.
Post reply on HN