Low-code, no-model recommendation system with GPT3 • Hacker News Board

Re: Low-code, no-model recommendation system with GPT3

#21

Post by feral » Wed, Sep 09, 2020, 9:33 AM UTC

fancyfredbot wrote: post #19

Presumably when a new movie (not included in GPT3 training data) comes out the recommendations are not going to be too good, unless someone spends a lot of money retraining the underlying model?

This will be the case for everything built on GPT-3, but you've got to imagine it's possible for them to keep refreshing it, eventually training or fine tuning it on a daily basis as their web crawl updates.

Re: Low-code, no-model recommendation system with GPT3

#22

Post by AgentME » Wed, Sep 09, 2020, 9:56 AM UTC

iforgotpassword wrote: post #15

rvz wrote: post #11

Earlier quoted context omitted.

In one of the Reddit comments about a service (PhilosopherAI.com) using the API outlining the possible total costs: > That makes for 400 million tokens in 2 or 3 weeks, which puts me at like $4000/mo minimum Oh dear, that means... > Scale: Contact Us So while they are using the API for free for now, by these metrics, they are least going to be soon having a running cost of at least $4K+/mo. That is an expensive toy.…

I was thinking about Ai dungeon the other day. I can't imagine it really is sustainable with those 10$ subscriptions covering the free play folks too. What happens whenever they get featured on some bigger website?

AI Dungeon free players only use GPT2 instead of the GPT3 API.

Re: Low-code, no-model recommendation system with GPT3

#23

Post by superasn » Wed, Sep 09, 2020, 9:57 AM UTC

I wish there was a light version of gpt3 with maybe like 100 api query limit per day so just amateurs like me got to play with this API too on weekends.

I have no agenda of changing the world and I have nothing substantial to fill in the gpt3 invite form but sometimes the best ideas come from tinkering and I just wish they gave some limited access to everyone.

Re: Low-code, no-model recommendation system with GPT3

#24

Post by ersiees » Wed, Sep 09, 2020, 10:01 AM UTC

superasn wrote: post #23

I wish there was a light version of gpt3 with maybe like 100 api query limit per day so just amateurs like me got to play with this API too on weekends. I have no agenda of changing the world and I have nothing substantial to fill in the gpt3 invite form but sometimes the best ideas come from tinkering and I just wish they gave some limited access to everyone.

You might like: https://transformer.huggingface.co The GPT-2 model is very similar to GPT-3 just smaller.

Re: Low-code, no-model recommendation system with GPT3

#25

Post by The_rationalist » Wed, Sep 09, 2020, 10:18 AM UTC

matusp wrote: post #4

I am curious how much it actually thinks and how much it simply uses text from recommendation engines that got crawled.

A neural network can't think, please stop cargo culting neural networks

Re: Low-code, no-model recommendation system with GPT3

#26

Post by superasn » Wed, Sep 09, 2020, 10:22 AM UTC

ersiees wrote: post #24

superasn wrote: post #23

I wish there was a light version of gpt3 with maybe like 100 api query limit per day so just amateurs like me got to play with this API too on weekends. I have no agenda of changing the world and I have nothing substantial to fill in the gpt3 invite form but sometimes the best ideas come from tinkering and I just wish they gave some limited access to everyone.

You might like: https://transformer.huggingface.co The GPT-2 model is very similar to GPT-3 just smaller.

Thanks for the link. So as someone who is completely new to this, if this guy used this model instead of gpt 3 would he get similar results?

Re: Low-code, no-model recommendation system with GPT3

#27

Post by sanxiyn » Wed, Sep 09, 2020, 10:25 AM UTC

Serendipity is another GPT-3 based recommendation engine. Check its about page. http://serendipityrecs.com/

Re: Low-code, no-model recommendation system with GPT3

#28

Post by sanxiyn » Wed, Sep 09, 2020, 10:28 AM UTC

superasn wrote: post #26

ersiees wrote: post #24

Earlier quoted context omitted.

You might like: https://transformer.huggingface.co The GPT-2 model is very similar to GPT-3 just smaller.

Thanks for the link. So as someone who is completely new to this, if this guy used this model instead of gpt 3 would he get similar results?

No, because the model is smaller.

Re: Low-code, no-model recommendation system with GPT3

#29

Post by dharma1 » Wed, Sep 09, 2020, 10:28 AM UTC

superasn wrote: post #23

I wish there was a light version of gpt3 with maybe like 100 api query limit per day so just amateurs like me got to play with this API too on weekends. I have no agenda of changing the world and I have nothing substantial to fill in the gpt3 invite form but sometimes the best ideas come from tinkering and I just wish they gave some limited access to everyone.

I thought they have a free tier from October? https://twitter.com/hardmaru/status/1301362995356774401

Not sure what the 100k tokens translates to in terms of query limit

Re: Low-code, no-model recommendation system with GPT3

#30

Post by dhairya » Wed, Sep 09, 2020, 10:29 AM UTC

superasn wrote: post #26

ersiees wrote: post #24

Earlier quoted context omitted.

You might like: https://transformer.huggingface.co The GPT-2 model is very similar to GPT-3 just smaller.

Thanks for the link. So as someone who is completely new to this, if this guy used this model instead of gpt 3 would he get similar results?

out of the box probably not. gpt-3 is pretrained on a much larger corpus and is a much higher capacity model, which is why its been performing very well in zero-shot learning examples like the one above. That being said you should try it.

Note the huggingface library is a python library, so you'd technically be writing some code, though the library API is super user friendly and the community is very helpful.