151–156 of 156 posts
Earlier quoted context omitted.
I assumed the ChatGPT3 enhancement is that they added memory of the dialogue to it? That's a huge improvement over one off questions and answers. You can tell it to correct its answers and ask follow up questions.
I wonder myself if the "memory" is just inputting the previous dialogue as input to every subsequent query. I think this would probably get quite slow after awhile however.
https://support.mozilla.org/en-US/kb/permission-request-mess...
This is very creative. Thing to note is that this is not free (or at least it is likely not to be, OpenAI is charging for APIs). We are talking about ~1c per search looking at current GPT pricing (2c per ~750 words in/out). It is also indiscriminate deployed in this way, triggering for every search, even those that chatgpt will show suboptimal responses for, like 'starbucks near me', navigational queries like 'twitte…
Since pricing is roughly proportional to response length (and maybe prompt length?), it seems like ChatGPT could use itself to determine if the search is a good fit or not. Give it a prompt like "I want to know if you are likely to generate more immediately useful and actionable results than my web search. The query I am searching is . Should I run you on this query?"
I tried running that on some sample queries to see its output, and compiled its responses in this table (note the last one is incorrect in my opinion):
| Query | Yes or No |
|------------------------------------|-----------|
| "starbucks near me" | No |
| "twitter" | No |
| "python requests get json" | Yes |
| "peach and mango cocktail recipe" | Yes |
| "hn" | No |
| "image of versaille" | Yes |
Does it make sense to put this on the chrome store? OpenAI is eventually going to end the beta period or Azure will run out of GPUs, whichever is first, then it'll no longer be accessible. In theory we can replicate this with GPT-3 but ChatGPT has better access to its knowledge, when it's not being a nagging busybody, which makes it much friendlier to interact with, when it's not being a nagging busybody.
This is very creative. Thing to note is that this is not free (or at least it is likely not to be, OpenAI is charging for APIs). We are talking about ~1c per search looking at current GPT pricing (2c per ~750 words in/out). It is also indiscriminate deployed in this way, triggering for every search, even those that chatgpt will show suboptimal responses for, like 'starbucks near me', navigational queries like 'twitte…
> it is non-trivial to predict which searches GPT will be good for Since pricing is roughly proportional to response length (and maybe prompt length?), it seems like ChatGPT could use itself to determine if the search is a good fit or not. Give it a prompt like "I want to know if you are likely to generate more immediately useful and actionable results than my web search. The query I am searching is . Should I run yo…
Normally you want your search results in about 500ms. Using ChatGPT to first figure out if the query is good will take 1-3 seconds then using it again another 1-3 seconds. So we are talking about results in about 4 seconds. Plus it is not 1c per query now it is more likely 1.5c per query as you introduced an extra prompt.
It inspired me to fork the background code and create an extension that proposes improvements to tweets while composing them: https://github.com/matthieubulte/chat-gpt-twitter-extension