Low-code, no-model recommendation system with GPT3

#1

Post by satorii » Tue, Sep 08, 2020, 5:27 PM UTC

Low-code, no-model recommendation system with GPT3
medium.com

Re: Low-code, no-model recommendation system with GPT3

#2

Post by dannyw » Wed, Sep 09, 2020, 4:53 AM UTC

GPT3 really is remarkable.

If you told me in 2015 that I can give just a few examples of movie recommendations, on a model trained for general text, and get perfectly coherent recommendations, I wouldn’t have believed you.

Re: Low-code, no-model recommendation system with GPT3

#3

Post by lowdose » Wed, Sep 09, 2020, 6:02 AM UTC

dannyw wrote: post #2

GPT3 really is remarkable. If you told me in 2015 that I can give just a few examples of movie recommendations, on a model trained for general text, and get perfectly coherent recommendations, I wouldn’t have believed you.

Yes right, but just hope the signal to noise ratio in the trainings remains stable. Garbage in ...

Re: Low-code, no-model recommendation system with GPT3

#4

Post by matusp » Wed, Sep 09, 2020, 6:14 AM UTC

I am curious how much it actually thinks and how much it simply uses text from recommendation engines that got crawled.

Re: Low-code, no-model recommendation system with GPT3

#5

Post by anaganisk » Wed, Sep 09, 2020, 6:47 AM UTC

Given that "Open" AI API is very pricey, Im waiting to see how economical is it to use this as it is heavily marketed by all these blog posts.

Re: Low-code, no-model recommendation system with GPT3

#6

Post by tgv » Wed, Sep 09, 2020, 6:57 AM UTC

Intersteller (with -er, indeed)? How did it pick that one up as an alternative for Inception? There is something with that title, but no information in IMDb.

Anyway, for the rest it looks similar to Netflix' recommendation: similarity in actors, directors, keywords. A toy.

Re: Low-code, no-model recommendation system with GPT3

#7

Post by PeterStuer » Wed, Sep 09, 2020, 6:59 AM UTC

Nice as a stunt, but feels like taking a 40 ton truck to get your lunch sandwich from the bakers.

Re: Low-code, no-model recommendation system with GPT3

#8

Post by rococode » Wed, Sep 09, 2020, 7:09 AM UTC

anaganisk wrote: post #5

Given that "Open" AI API is very pricey, Im waiting to see how economical is it to use this as it is heavily marketed by all these blog posts.

For anyone else curious, the pricing according to gwern [1]:

    Explore: Free tier: 100K [BPE] tokens, Or, 3-month trial, Whichever comes first
    Create: $100/mo, 2M tokens/mo, 8 cents per additional 1k tokens
    Build: $400/mo, 10M tokens/mo, 6 cents per additional, 1k tokens
    Scale: Contact Us

Expensive but (unfortunately) pretty standard market price for cloud NLP stuff. The price is about $40 per million tokens.

For comparison, cloud translation costs per million characters range from $6 (Azure bulk pricing) to $20 (Google/AWS without bulk discounts). If we assume the average BPE token length is 5 characters, GPT-3 will cost about $8 per million characters.

[1] https://old.reddit.com/r/GPT3/comments/ikorgs/oa_api_prelimi...

Re: Low-code, no-model recommendation system with GPT3

#9

Post by aabhay » Wed, Sep 09, 2020, 7:58 AM UTC

PeterStuer wrote: post #7

Nice as a stunt, but feels like taking a 40 ton truck to get your lunch sandwich from the bakers.

GPT-3 is the Rube Goldberg of AI solutions

Re: Low-code, no-model recommendation system with GPT3

#10

Post by janekm » Wed, Sep 09, 2020, 8:02 AM UTC

tgv wrote: post #6

Intersteller (with -er, indeed)? How did it pick that one up as an alternative for Inception? There is something with that title, but no information in IMDb. Anyway, for the rest it looks similar to Netflix' recommendation: similarity in actors, directors, keywords. A toy.

A2:B10 (including the results for Intersteller{sic}) are the prompts, it's very confusing in the video. The results for "The Irishman" are from GPT-3.