Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Low-code, no-model recommendation system with GPT3

medium.com

Post reply on HN
Print view View original

11–20 of 67 posts

Re: Low-code, no-model recommendation system with GPT3

#11

Post by rvz »

rococode wrote: post #8
anaganisk wrote: post #5

Given that "Open" AI API is very pricey, Im waiting to see how economical is it to use this as it is heavily marketed by all these blog posts.

For anyone else curious, the pricing according to gwern [1]: Explore: Free tier: 100K [BPE] tokens, Or, 3-month trial, Whichever comes first Create: $100/mo, 2M tokens/mo, 8 cents per additional 1k tokens Build: $400/mo, 10M tokens/mo, 6 cents per additional, 1k tokens Scale: Contact Us Expensive but (unfortunately) pretty standard market price for cloud NLP stuff. The price is about $40 per million tokens. For compa…

In one of the Reddit comments about a service (PhilosopherAI.com) using the API outlining the possible total costs:

> That makes for 400 million tokens in 2 or 3 weeks, which puts me at like $4000/mo minimum

Oh dear, that means...

> Scale: Contact Us

So while they are using the API for free for now, by these metrics, they are least going to be soon having a running cost of at least $4K+/mo. That is an expensive toy. The same goes for AI Dungeon.

> App Store earnings will be used to cover OpenAI costs & develop new features. Thank you for your support.

Well I will be seeing a tsunami of complaints from OpenAI projects that they can't pay up for their "game changers" since they will be priced out quickly. OpenAI Wins, Everyone else loses.

If this is for simple projects, then I wouldn't dare build an entire startup based on someone else's API. OpenAI will win by default here.

Re: Low-code, no-model recommendation system with GPT3

#13

Post by strombofulous »

rococode wrote: post #8
anaganisk wrote: post #5

Given that "Open" AI API is very pricey, Im waiting to see how economical is it to use this as it is heavily marketed by all these blog posts.

For anyone else curious, the pricing according to gwern [1]: Explore: Free tier: 100K [BPE] tokens, Or, 3-month trial, Whichever comes first Create: $100/mo, 2M tokens/mo, 8 cents per additional 1k tokens Build: $400/mo, 10M tokens/mo, 6 cents per additional, 1k tokens Scale: Contact Us Expensive but (unfortunately) pretty standard market price for cloud NLP stuff. The price is about $40 per million tokens. For compa…

What is a token? One character? Or is it a currency?

Re: Low-code, no-model recommendation system with GPT3

#14

Post by rvz »

dannyw wrote: post #2

GPT3 really is remarkable. If you told me in 2015 that I can give just a few examples of movie recommendations, on a model trained for general text, and get perfectly coherent recommendations, I wouldn’t have believed you.

Indeed. But now OpenAI has become more like another DeepMind, but starting to rent out their APIs to its users, indicating that they probably won't ever release models for their research.

They might as well rename to Standard AI.

Re: Low-code, no-model recommendation system with GPT3

#15

Post by iforgotpassword »

rvz wrote: post #11
rococode wrote: post #8

Earlier quoted context omitted.

For anyone else curious, the pricing according to gwern [1]: Explore: Free tier: 100K [BPE] tokens, Or, 3-month trial, Whichever comes first Create: $100/mo, 2M tokens/mo, 8 cents per additional 1k tokens Build: $400/mo, 10M tokens/mo, 6 cents per additional, 1k tokens Scale: Contact Us Expensive but (unfortunately) pretty standard market price for cloud NLP stuff. The price is about $40 per million tokens. For compa…

In one of the Reddit comments about a service (PhilosopherAI.com) using the API outlining the possible total costs: > That makes for 400 million tokens in 2 or 3 weeks, which puts me at like $4000/mo minimum Oh dear, that means... > Scale: Contact Us So while they are using the API for free for now, by these metrics, they are least going to be soon having a running cost of at least $4K+/mo. That is an expensive toy.…

I was thinking about Ai dungeon the other day. I can't imagine it really is sustainable with those 10$ subscriptions covering the free play folks too. What happens whenever they get featured on some bigger website?

Re: Low-code, no-model recommendation system with GPT3

#16

Post by bqcty »

dannyw wrote: post #2

GPT3 really is remarkable. If you told me in 2015 that I can give just a few examples of movie recommendations, on a model trained for general text, and get perfectly coherent recommendations, I wouldn’t have believed you.

I'm not so surprised given that the paper generator has been around for much longer:

https://pdos.csail.mit.edu/archive/scigen/

Example:

https://pdos.csail.mit.edu/archive/scigen/rooter.pdf

In a way, I find the output better than GPT-3's. GPT-3 output is always a bit creepy to read, as if you are talking to a deranged person.

Re: Low-code, no-model recommendation system with GPT3

#17

Post by lukasLansky »

PeterStuer wrote: post #7

Nice as a stunt, but feels like taking a 40 ton truck to get your lunch sandwich from the bakers.

I guess it depends how you think about it. From computational perspective, it's heavyweight. On the other hand, it really optimizes for minimal human effort, on several levels:

* GPT-3 is conceptually simple: the effort to invent it and engineer it amortizes well.

* Once the model is trained, it can be reused to very different tasks.

* Querying doesn't require programming knowledge.

Re: Low-code, no-model recommendation system with GPT3

#18

Post by feral »

PeterStuer wrote: post #7

Nice as a stunt, but feels like taking a 40 ton truck to get your lunch sandwich from the bakers.

If this turns out to be easy and convenient, it won't matter whether the tech is overpowered.

A family car is really overpowered for most trips to the bakers.

Yet people take the car all the time, instead of walking or cycling, because it's just more convenient and easy, and people are lazy.

You can't write just this off as a stunt.

If you described how YouTube renders cat videos to Tim Berners Lee in the mid 90s, it would also seem like a 40-ton truck.

And yet here we are.

Post reply on HN