Live data from Hacker News

Supabase Clippy – ChatGPT for Supabase Docs

supabase.com

41–50 of 57 posts

Re: Supabase Clippy – ChatGPT for Supabase Docs

#41
post #27

Earlier quoted context omitted.

we haven't but we certainly will in future iterations

I'm curious what is the estimated cost for running this?

it looks like we're getting 1800 requests per hour - about $5/hour, which is pretty cheap considering the traffic seeing this blog post. That said, only desktop users who have access to the keyboard and have read the blog post can use it. If we made it visible to everyone I think we would quickly run into API limits.

Re: Supabase Clippy – ChatGPT for Supabase Docs

#42
post #29

Earlier quoted context omitted.

the neat thing about the vector implementation is that we can immediately return the relevant pages while GPT formulates an answer, which gives this a hybrid "search + ask" function. We'll aim to do that in the next iteration

Hey, if you can, please add a Stop Generating button. Sometimes I see what I'm looking for and just want it to stop.

good idea, thanks

Re: Supabase Clippy – ChatGPT for Supabase Docs

#43
post #25

Earlier quoted context omitted.

Interesting I got the same result. Could it be caching prompts?

They currently have it configured to be fully deterministic when generating. If you tweak the prompt at all it should break out of that I assume.

The temperature is currently set to zero, so that makes sense

Re: Supabase Clippy – ChatGPT for Supabase Docs

#44
post #22

Earlier quoted context omitted.

in our MVP checklist we had "XSS testing" and "Prompt injection", the latter somewhat cursory because there's no feasible way to prevent it right now. We found a lot of ways to "break out" of the prompt (which is also very visible since we're open source). Luckily, prompt break-outs are relatively benign (as long as we have spend-caps on OpenAI). The biggest win for companies like us is that something like this becom…

I’m actually working on an open source project to mitigate against prompt injections, handle cache, etc. and I’m collecting instances of prompt misuse. I’d love to see your findings. Did you document them anywhere that I can review?

we're not saving the prompts in this version. It's really an MVP, we couldn't have stripped it back much more

We'd be happy to share some prompts in the future (as long as we can determine that it respect out users' privacy/safety)

Re: Supabase Clippy – ChatGPT for Supabase Docs

#45

Everyone realizes this works for the same reason that Copilot works, right? And that this was trained on the same GPL code? Is this not an excellent example of an argument that LLMs such as GPT should be able to train on copyright protected works as it constitutes fair use?

I think for code it will be pretty hard, unless the writer gives explicit permission to train the model on the copyrighted data, like the case for Copilot in GitHub.

And I don't think it is fair use at all, imagine a company like OpenAI train the model on its own internal docs and code, then you'll be able to ask the model to replicate ChatGPT and copilot, or even closed software like Photoshop.

Re: Supabase Clippy – ChatGPT for Supabase Docs

#48
post #24

> Want to try it out? It's a hidden feature while in MVP - visit supabase.com/docs and hit cmd + / to pull up the search box (sorry mobile users). My keyboard does not have a cmd key, and I am not a mobile user.

My keyboard does noy have dedicated / . Both modifiers ctrl/cmd + shift + 7(/) does not work either.

Added a button to the navbar!

Re: Supabase Clippy – ChatGPT for Supabase Docs

#49
post #34

Hey HN, yesterday we shared a post[0] about how you can store OpenAI embeddings in Postgres with pgvector. This is a follow up demonstration, adding a "ChatGPT" interface to our own docs. To use it, you can go to https://supabase.com/docs and then type "cmd + /". This will pull up a "Clippy" interface, where you can ask it questions about supabase (sorry in advance to mobile users) In "Show HN" spirit, it's very hack…

Feedback: Please add a button. This seems super useful, but unfortunately I can't test it. I'm on a non US Layout and can't use the shortcut "cmd + /". On my keyboard a "/" is opt + 7 and using "opt + cmd + 7" unsurprisingly does nothing.

Thanks for this. Added a button to the navbar. Sorry about the delay there.

Re: Supabase Clippy – ChatGPT for Supabase Docs

#50

Everyone realizes this works for the same reason that Copilot works, right? And that this was trained on the same GPL code? Is this not an excellent example of an argument that LLMs such as GPT should be able to train on copyright protected works as it constitutes fair use?

I think for code it will be pretty hard, unless the writer gives explicit permission to train the model on the copyrighted data, like the case for Copilot in GitHub. And I don't think it is fair use at all, imagine a company like OpenAI train the model on its own internal docs and code, then you'll be able to ask the model to replicate ChatGPT and copilot, or even closed software like Photoshop.

I'm sorry, what don't you think is fair use, Supabase Clippy?
Post reply on HN