11–20 of 23 posts
"Rather than paying $50k up front for 8 x A100's, you can just rent some GPU's for $1.2k to train the whole thing in 4 days"
That feel off to me is that it completely ignores the compute time spent exploring new ideas, failing, tweaking the training data, etc.
Something from previous discussions about the whole "Rather than paying $50k up front for 8 x A100's, you can just rent some GPU's for $1.2k to train the whole thing in 4 days" That feel off to me is that it completely ignores the compute time spent exploring new ideas, failing, tweaking the training data, etc.
It takes a bit of effort to setup and train a proper GPT-2 model, especially if you are not familiar with GPU drivers and python environment. Also don't try to train GPT-2 on your own machine as it takes days, even with a good gaming GPU. If you are interested in trying it out, but don't have the right GPU or OS, you can check out the guide I wrote on how I did it on Azure with T4 GPU instance: https://16x.engineer/2…
How much does the net cost come out to for a run? (Am not a startup.)
Also, any smaller datasets you would recommend that still demonstrate some useful capability?
Thanks.
We need a unique interface with a standardized process to help people make use-case-specific GPTs.
Let's see what the future holds.
It takes a bit of effort to setup and train a proper GPT-2 model, especially if you are not familiar with GPU drivers and python environment. Also don't try to train GPT-2 on your own machine as it takes days, even with a good gaming GPU. If you are interested in trying it out, but don't have the right GPU or OS, you can check out the guide I wrote on how I did it on Azure with T4 GPU instance: https://16x.engineer/2…
Thanks a lot for sharing this. How much does the net cost come out to for a run? (Am not a startup.) Also, any smaller datasets you would recommend that still demonstrate some useful capability? Thanks.
I don't think it can go any smaller and demonstrate its capabilities. Even GPT-2 is mostly generating nonsensical sentences that resembles English.
You might be looking at ngram or markov model for simpler NLP capabilities.
We need a simpler way to make GPT get mass adoption and I don't think GPT Store from OpenAI will do that. We need a unique interface with a standardized process to help people make use-case-specific GPTs. Let's see what the future holds.
Curious what you think about it: https://prompt.16x.engineer/
We need a simpler way to make GPT get mass adoption and I don't think GPT Store from OpenAI will do that. We need a unique interface with a standardized process to help people make use-case-specific GPTs. Let's see what the future holds.
I actually built a purpose-made UI (desktop app) for coding using ChatGPT, because I found that chat interface is not ideal for daily coding tasks. Curious what you think about it: https://prompt.16x.engineer/
Earlier quoted context omitted.
I actually built a purpose-made UI (desktop app) for coding using ChatGPT, because I found that chat interface is not ideal for daily coding tasks. Curious what you think about it: https://prompt.16x.engineer/
So like aider, but with more gui.