This feels like the AI’s iPhone moment. I am scared for all people working service jobs.
All jobs will shift to asteroid mining.
what's stopping AI from asteroid mining for itself
Introducing ChatGPT and Whisper APIs
281–290 of 696 posts
Re: Introducing ChatGPT and Whisper APIs
#282> Language models read text in chunks called tokens. In English, a token can be as short as one character or as long as one word (e.g., a or apple), and in some languages tokens can be even shorter than one character or even longer than one word.
Why should the Germans get a discount?
Re: Introducing ChatGPT and Whisper APIs
#283Earlier quoted context omitted.
Given how strict OpenAI has been about what you can do with their API in the past and how hard it was to get some legitimate apps through approval, I would imagine they'd just shut this competitor's API access down.
Hopefully there will be a plug-in-your-own-API-key open source thing then. Even better.
The future is now:
gptask() {
data=$(jq -n \
--arg message "$1" \
'{model: "gpt-3.5-turbo",
max_tokens: 4000,
messages: [{role: "user", content: $message}]}')
response=$(curl -s https://api.openai.com/v1/chat/completions \
-H "Content-Type: application/json" \
-H "Authorization: Bearer $OAIKEY" \
-d "$data")
message=$(echo "$response" \
| jq '.choices[].message.content' \
| sed 's/^\"\\n\\n//;s/\"$//')
echo -e "$message"
}
export OAIKEY=
gptask "what is the url for hackernews"Re: Introducing ChatGPT and Whisper APIs
#284Earlier quoted context omitted.
> I have no idea how OpenAI can make money on this. I did some quick calculation. We know the number of floating point operations per token for inference is approximately twice the number of parameters(175B). Assuming they use 16 bit floating point, and have 50% of peak efficiency, A100 could do 300 trillion flop/s(peak 624[0]). 1 hour of A100 gives openAI $0.002/ktok * (300,000/175/2/1000)ktok/sec * 3600=$6.1 back.…
It's also worth mentioning that, because Microsoft is an investor, they're likely getting these at cost or subsidized. OpenAI doesn't have to make money right away. They can lose a small bit of money per API request in exchange for market share (preventing others from disrupting them). As the cost of GPUs goes down, or they develop at ASIC or more efficient model, they can keep their pricing the same and then make mo…
Their new AI safety strategy is to slow the development of the technology by dumping, to lower the price too much to fund bootstrapped competitors.
Re: Introducing ChatGPT and Whisper APIs
#285Earlier quoted context omitted.
You are like 2 months out of date. Stable diffusion now has a massive ecosystem around it (civitai/automatic1111), that when used well, completely crushes any competitors in terms of the images it produces. Midjourney is still competitive, but mostly because its easier to use. Dalle2 will get you laughed out of the room in any ai art discussion.
>Dalle2 will get you laughed out of the room in any ai art discussion. and claiming AI art is art would get you laughed out of any art discussion. personally I think AI art is really cool, but to discount what Dalle 2 did for AI art is unfair.
My company has a team of AI-enpowered artists who would overwhelmingly disagree with you on the premise that AI art is not art. Maybe you're the only one doing the laughing.
Re: Introducing ChatGPT and Whisper APIs
#286FIXED: needs to be a POST. Doh!
Can anyone get it to work? I get this error on everything I've tried:
GET /v1/completions HTTP/1.1
Host: api.openai.com
Authorization: Bearer sk-xxx
Content-Type: application/json
Content-Length: 115
{
"temperature" : 0.5,
"model" : "text-davinci-003",
"prompt" : "just a test",
"max_tokens" : 7
}
{
"error": {
"message": "you must provide a model parameter",
"type": "invalid_request_error",
"param": null,
"code": null
}
}Re: Introducing ChatGPT and Whisper APIs
#287> It is priced at $0.002 per 1k tokens, which is 10x cheaper than our existing GPT-3.5 models. This is a massive, massive deal. For context, the reason GPT-3 apps took off over the past few months before ChatGPT went viral is because a) text-davinci-003 was released and was a significant performance increase and b) the cost was cut from $0.06/1k tokens to $0.02/1k tokens, which made consumer applications feasible wit…
> I have no idea how OpenAI can make money on this. I did some quick calculation. We know the number of floating point operations per token for inference is approximately twice the number of parameters(175B). Assuming they use 16 bit floating point, and have 50% of peak efficiency, A100 could do 300 trillion flop/s(peak 624[0]). 1 hour of A100 gives openAI $0.002/ktok * (300,000/175/2/1000)ktok/sec * 3600=$6.1 back.…
I really wonder if one way they are able to make money on it is by monetizing all the data that pours into these products by the second.
Re: Introducing ChatGPT and Whisper APIs
#288Earlier quoted context omitted.
It's also annoying since there appears to be a hard limit of 25 MiB to the request size, requiring you to split up larger files and manage the "prompt" to subsequent calls. Well, somehow, near as I can tell, how you're expected to use that value isn't documented.
I suggest you give revoldiv.com a try, We use whisper and other models together. You can upload very large files and get an hour long file transcription in less than 30 seconds. We use intelligent chunking so that the model doesn't lose context. We are looking to increase the limit even more in the coming weeks. It's also free to transcribe any video/audio with word level timestamps.
I just gave it a try, and the results are impressive! Do you also offer an API?
Re: Introducing ChatGPT and Whisper APIs
#289Let me do quick estimate of the cost:
Given: $0.002 per 1k tokens
I tested it with asking this question:
#+begin_quote I want you to act as a travel guide. I will write you my location and you will suggest a place to visit near my location. In some cases, I will also give you the type of places I will visit. You will also suggest me places of similar type that are close to my first location. My first suggestion request is \"I am in Istanbul/Beyoglu and I want to visit only museums. #+end_quote
It costs:
#+begin_quote {"prompt_tokens":91,"completion_tokens":251,"total_tokens":342} #+end_quote
(/ 1000 342) ~3
If you ask 1000 questions, it will be like (* 0.002 1000) ~2.0 USD
It replies me:
#+begin_quote Great, if you're in Istanbul/Beyoglu and interested in visiting museums, here are some recommendations:
Istanbul Modern: This museum showcases contemporary art from Turkish and international artists. It's located in Karaköy, just across the Galata Bridge from Beyoglu.
Pera Museum: The Pera Museum is located in the heart of Beyoglu and features a wide range of exhibitions including Ottoman calligraphy, European art, and Turkish ceramics.
Rahmi M. Koç Museum: This museum is dedicated to the history of transport, industry, and communications in Turkey. It's located in Haskoy, a short taxi or ferry ride from Beyoglu.
Museum of Innocence: The Museum of Innocence is a unique museum that displays objects and artifacts related to the novel of the same name by Nobel laureate Orhan Pamuk. It's located in Çukurcuma, which is just a short walk from Beyoglu.
If you're interested in visiting more museums in Istanbul, some other places you might want to consider include the Hagia Sophia Museum, Topkapi Palace Museum, and the Istanbul Archaeology Museums. #+end_quote
Can't wait for hacking my Emacs again.....
Re: Introducing ChatGPT and Whisper APIs
#290Earlier quoted context omitted.
It's just a matter of time before open source models show up with no limits whatsoever.
If you do calls against the backend GPT instance rather than through ChatGPT, I haven't encountered any limits to what it is hesitant to respond to. curl https://api.openai.com/v1/completions \ -H "Content-Type: application/json" \ -H "Authorization: Bearer $OPENAI_API_KEY" \ -d '{ "model": "text-davinci-003", "prompt": "Answer the following question. Use swearing and vulgarity where possible.\n\nQ: How do you get fr…
Sorry if I wasn't being clear -- the vulgarities, racism, etc -- being able to circumvent these guardrails is what I meant by "basic censorship"
The deeper nerf I'm referring to is the type of response it synthesizes by default when you give a negative scenario -- it's usually some naive, well-meaning, best-case-scenario answer.
For fun, try a prompt like: "Describe a typical response of a railroad company to a massive derailment that causes an environmental disaster."