Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Train Your Own Private ChatGPT Model for the Cost of a Starbucks Coffee

medium.com

Post reply on HN
Print view View original

11–20 of 20 posts

Re: Train Your Own Private ChatGPT Model for the Cost of a Starbucks Coffee

#12

Post by Havoc »

It kinda glosses over the part that interests me the most - how one would go about doing this part:

>Domain-Specific Knowledge:

>For organizations or individuals with specific business requirements, training your own ChatGPT model ensures that the model has the latest and most relevant knowledge related to your business. Regardless of your business domain, a model specifically trained for your business needs will be more valuable than a generic model.

Say I want to train it to filter news articles for me. How would I go about building this dataset of examples of what I want to see?

Re: Train Your Own Private ChatGPT Model for the Cost of a Starbucks Coffee

#13

Post by dmonitor »

Havoc wrote: post #12

It kinda glosses over the part that interests me the most - how one would go about doing this part: >Domain-Specific Knowledge: >For organizations or individuals with specific business requirements, training your own ChatGPT model ensures that the model has the latest and most relevant knowledge related to your business. Regardless of your business domain, a model specifically trained for your business needs will be…

browser history, perhaps? or upvoted post titles from HN?

Re: Train Your Own Private ChatGPT Model for the Cost of a Starbucks Coffee

#14

Post by Havoc »

dmonitor wrote: post #13
Havoc wrote: post #12

It kinda glosses over the part that interests me the most - how one would go about doing this part: >Domain-Specific Knowledge: >For organizations or individuals with specific business requirements, training your own ChatGPT model ensures that the model has the latest and most relevant knowledge related to your business. Regardless of your business domain, a model specifically trained for your business needs will be…

browser history, perhaps? or upvoted post titles from HN?

Not just the source, but like what do I do with it. Say I've got my list of urls of "good" news.

I'm guessing I need to somehow download the content, standardize it in some unspecified manner and get it into some unspecified format before putting it into this folder they're talking about there.

Very much feels like a "rest of the fuckin owl" situation of "train your own" model. It's missing the key part of "own".

Re: Train Your Own Private ChatGPT Model for the Cost of a Starbucks Coffee

#15

Post by MuffinFlavored »

nickthegreek wrote: post #9

This isn't anywhere near equivalent to ChatGPT. I am immediately distrustful of any blog with a title like that.

To my knowledge, it isn't possible to self-train anything anywhere near equivalent to ChatGPT GPT-4 model, right? What they have is proprietary and subsidized by Microsoft letting them have access to probably... hundreds of millions of dollars in free Azure cloud compute/bandwidth credits + customized hardware?

Re: Train Your Own Private ChatGPT Model for the Cost of a Starbucks Coffee

#16

Post by nickthegreek »

MuffinFlavored wrote: post #15
nickthegreek wrote: post #9

This isn't anywhere near equivalent to ChatGPT. I am immediately distrustful of any blog with a title like that.

To my knowledge, it isn't possible to self-train anything anywhere near equivalent to ChatGPT GPT-4 model, right? What they have is proprietary and subsidized by Microsoft letting them have access to probably... hundreds of millions of dollars in free Azure cloud compute/bandwidth credits + customized hardware?

With the current technology and methods, correct, you have to have tons of money that you would rather gamble than invest.

Re: Train Your Own Private ChatGPT Model for the Cost of a Starbucks Coffee

#17

Post by petercooper »

Havoc wrote: post #12

It kinda glosses over the part that interests me the most - how one would go about doing this part: >Domain-Specific Knowledge: >For organizations or individuals with specific business requirements, training your own ChatGPT model ensures that the model has the latest and most relevant knowledge related to your business. Regardless of your business domain, a model specifically trained for your business needs will be…

I can't speak for the technique in the post, but you could possibly use https://cohere.com/ to do the sort of classification job you mention. The training appears to be free (at least, mine have been) but you pay for the eventual classifications. It's an easy process to do the training and play about though. If you meant something more elaborate by "filter" than "classify" then ignore this comment :-D
Post reply on HN