Live data from Hacker News

Deploy your own GPT-3 API with Docker and fly

github.com

11–12 of 12 posts

Re: Deploy your own GPT-3 API with Docker and fly

#11
The real work happens here: it looks like this library has figured out the secret model name that allows you to make API calls to the ChatGPT model in the same way you would usually make calls to the other GPT-3 models: https://github.com/waylaidwanderer/node-chatgpt-api/blob/mai...

That project's README (and the commit history to that README) tells the full story: sounds like people have been hanging out on Discord collaborating on reverse engineering ChatGPT: https://github.com/waylaidwanderer/node-chatgpt-api

One thing to note: you still have to provide your own OpenAI API key in order to call the model, so if/when OpenAI decide to shut this hole down it will likely be easy for them to restrict who can call the model and potentially take measures against accounts that have used it in this way.

Re: Deploy your own GPT-3 API with Docker and fly

#12
post #3

Why like this, and not just using the API directly through Python or sth?

Because they are trying to get inference for free by scraping chatGPT. Of course, "free" here also means "mostly unavailable" given the reliability of chatGPT recently.

Even then, it could just be used as a library / piece of code. No need for a separate Docker instance, right?

Unless it's being used to spin off on multiple servers so IP addresses change often?

Post reply on HN