Using a cloud-hosted AI with a Terms-of-Service as an assistant is a recipe for disaster in the future. I can't wait for the future where everyone is reliant on a corporate spy for everything they do.
Personal Concierge Using OpenAI's ChatGPT via Telegram and Voice Messages
51–60 of 102 posts
Re: Personal Concierge Using OpenAI's ChatGPT via Telegram and Voice Messages
#52Earlier quoted context omitted.
The real problem with 4 is that OpenAI are having trouble keeping up with the demand. So it might not be an option until 4 turbo comes out in 37 hours or whatever their development cycle is these days.
Yea, I find it a fair bit annoying that I pay $20 and have a 25 message cap every 3 hours.
I use TypingMind.com and the GPT4 API. Seems an overall better experience.
Re: Personal Concierge Using OpenAI's ChatGPT via Telegram and Voice Messages
#53Earlier quoted context omitted.
That's just the case for this bot, but is obviously not the case for ChatGPT. I have a long running conversation with ChatGPT that I use to keep track of a verbal to-do list. I tell it my items with categories (e.g. work, personal, etc.) and estimated times, and then it outputs my complete task list, grouped by category. I then just tell it when I add tasks or complete tasks, and it continually keeps track of and out…
Oh dang, that sounds awesome. So a ChatGPT conversation doesn't have a historical limit? I guess I assumed it would start having to forget things at a certain point.
Yes, there’s a limit. Right now it’s 4000 tokens (gpt4 has a 32k model but i don’t think it’s available yet, at least with chatgpt). Once you near the limit, chatgpt will start dropping previous messages to stay under the limit. I don’t know what their algorithm is for deciding what to drop. It could be as simple as dropping the oldest stuff. Or maybe taking a long message and replacing it with a summary. But at a certain point, the conversation becomes “lossy”.
Re: Personal Concierge Using OpenAI's ChatGPT via Telegram and Voice Messages
#54Earlier quoted context omitted.
That's just the case for this bot, but is obviously not the case for ChatGPT. I have a long running conversation with ChatGPT that I use to keep track of a verbal to-do list. I tell it my items with categories (e.g. work, personal, etc.) and estimated times, and then it outputs my complete task list, grouped by category. I then just tell it when I add tasks or complete tasks, and it continually keeps track of and out…
Oh dang, that sounds awesome. So a ChatGPT conversation doesn't have a historical limit? I guess I assumed it would start having to forget things at a certain point.
If it periodically outputs the latest state of the todo list, it won't have the problem of forgetting things from a long time ago.
Re: Personal Concierge Using OpenAI's ChatGPT via Telegram and Voice Messages
#55Earlier quoted context omitted.
> a personal AI assistant to act as a second brain, and help me prioritize and remember things with human intuition Everyone wants this, but this is not the product. The current AI offerings are information in --> information out. It is not meant to keep state long term, and it is not meant to be your friend. It is meant to answer questions with the information available to it. You can even see in the example screens…
That's just the case for this bot, but is obviously not the case for ChatGPT. I have a long running conversation with ChatGPT that I use to keep track of a verbal to-do list. I tell it my items with categories (e.g. work, personal, etc.) and estimated times, and then it outputs my complete task list, grouped by category. I then just tell it when I add tasks or complete tasks, and it continually keeps track of and out…
And what happens when your window runs out? It prunes the oldest convo which you will need to keep track. Likely it could be fine, but if there was a task from a long time ago, that could get wiped out
Re: Personal Concierge Using OpenAI's ChatGPT via Telegram and Voice Messages
#56Great work! Thanks for taking the time to build this and open sourcing it. For me, it scratches on a very real itch. I’ve toyed with the idea of a personal AI assistant to act as a second brain, and help me prioritize and remember things with human intuition (“you can’t afford to delay X, do X today and maybe reach out to Z to set the expectations for delaying Y?”). To me, the greatest strength of LLMs is not their k…
GPT4 is so much better than 3.5 at virtually everything that I don't think it's worth trying to figure out which ones 3.5 is almost adequate enough for. Also, the pricing is per token, so even with 4 it is close to negligible unless you are loading in a lot of context or your conversation gets very long.
The one exception is probably speed. GPT-4 is noticeably slower than GPT-3.5.
https://twitter.com/natfriedman/status/1639029709395886080?s...
Re: Personal Concierge Using OpenAI's ChatGPT via Telegram and Voice Messages
#57Earlier quoted context omitted.
That's just the case for this bot, but is obviously not the case for ChatGPT. I have a long running conversation with ChatGPT that I use to keep track of a verbal to-do list. I tell it my items with categories (e.g. work, personal, etc.) and estimated times, and then it outputs my complete task list, grouped by category. I then just tell it when I add tasks or complete tasks, and it continually keeps track of and out…
And what happens when your window runs out? It prunes the oldest convo which you will need to keep track. Likely it could be fine, but if there was a task from a long time ago, that could get wiped out
I'm assuming at this point you'd need a means of pruning expired information from your list, and then importing that shorter list into a new session.
I guess the question is, can we get ChatGPT to make that new list reliably?
Re: Personal Concierge Using OpenAI's ChatGPT via Telegram and Voice Messages
#58It amazes me to no end that some people would feed private conversations and other sensitive data into an experimental chat bot. Don’t these people not know that ChatGPT it not a mature technology, that does not reliably isolate sessions and may even permanently ingest user data for training purposes? GPT and other LLMs are currently integrated into countless products and hobbyist projects. Expect an avalanche of law…
OpenAI says they aren’t training on chat GPT conversations. Up to you to see if you believe them or not. They also said having a 30 days data retention policy, that is compatible with GDPR.
https://techcrunch.com/2023/03/01/addressing-criticism-opena...
Re: Personal Concierge Using OpenAI's ChatGPT via Telegram and Voice Messages
#59It amazes me to no end that some people would feed private conversations and other sensitive data into an experimental chat bot. Don’t these people not know that ChatGPT it not a mature technology, that does not reliably isolate sessions and may even permanently ingest user data for training purposes? GPT and other LLMs are currently integrated into countless products and hobbyist projects. Expect an avalanche of law…
(I may have misunderstood your comment to some extent, but I'm going to send this reply anyway even if just to clarify for anyone else who might misunderstand.) --- I agree with "be careful what you send to the chat bot", but let's clarify some things in case you or someone else reading your comment is misunderstanding. LLMs aren't immature AI brains that "may even permanently ingest user data for training purposes".…
> Running inference does not change the trained weights.
That's true today.
I don't know how many days (or hours) away we are from GPT-4 running a LoRA-pass to update its weights after each round though?
Re: Personal Concierge Using OpenAI's ChatGPT via Telegram and Voice Messages
#60Great, so instead of sharing all your data with one party, you can share it with 3+ parties
This is being downvoted but it's an important thing to consider. As we move to doing more with these systems we're going to start seeing restrictions on which AI tools we can use at work/school/home.