Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Personal Concierge Using OpenAI's ChatGPT via Telegram and Voice Messages

github.com

Post reply on HN
Print view View original

91–100 of 102 posts

Re: Personal Concierge Using OpenAI's ChatGPT via Telegram and Voice Messages

#91

Post by dror »

jbellis wrote: post #29
sheepscreek wrote: post #22

Great work! Thanks for taking the time to build this and open sourcing it. For me, it scratches on a very real itch. I’ve toyed with the idea of a personal AI assistant to act as a second brain, and help me prioritize and remember things with human intuition (“you can’t afford to delay X, do X today and maybe reach out to Z to set the expectations for delaying Y?”). To me, the greatest strength of LLMs is not their k…

GPT4 is so much better than 3.5 at virtually everything that I don't think it's worth trying to figure out which ones 3.5 is almost adequate enough for. Also, the pricing is per token, so even with 4 it is close to negligible unless you are loading in a lot of context or your conversation gets very long.

GPT4 is definitively the future, but GPT3.5 is the present :-).

In addition to being more expensive, GPT4 is a lot slower. For most casual things I use gpt3 and upgrade to GPT4 as needed. I've actually had a couple of days where I spent > $1 on GPT4. It's hard to do with every day chat, but easy to do when you get it to look/improve large amounts of code.

This is all from the API/CLI not the web interface.

Re: Personal Concierge Using OpenAI's ChatGPT via Telegram and Voice Messages

#92

Post by Hadriel »

marc wrote: post #33
55555 wrote: post #21

I want something like this but I don't want to have to host it myself. Is there any I can simply sign up to?

I made https://t.me/marcbot a few weeks ago. Comes with voice memo support, etc.

it's not working :(

Re: Personal Concierge Using OpenAI's ChatGPT via Telegram and Voice Messages

#93

Post by Hadriel »

Heloseaa wrote: post #80

Recently did the same in a lightweight alternative with python: https://github.com/clemsau/telegram-gpt Looking to make it accessible, cheap and as lean as possible. I'd love to hear potential features ideas.

can you choose to use gpt4?

Re: Personal Concierge Using OpenAI's ChatGPT via Telegram and Voice Messages

#94

Post by majormajor »

aqme28 wrote: post #65
m3kw9 wrote: post #55

Earlier quoted context omitted.

And what happens when your window runs out? It prunes the oldest convo which you will need to keep track. Likely it could be fine, but if there was a task from a long time ago, that could get wiped out

You could store whatever personal data you want in embeddings and use the api to refer to those. Can't do it on vanilla ChatGPT with the website though, I don't think.

Am I missing something or is that the opposite of how embeddings work?

https://platform.openai.com/docs/guides/chat - this API endpoint for completions doesn't take embeddings, just messages.

Their API docs for embeddings also don't talk about using them to get outside of the context size limit; instead, the way I've used it and seen others is "create embeddings from documents to enable fast search for relevant documents to populate in context" which still requires a separate data store.

Re: Personal Concierge Using OpenAI's ChatGPT via Telegram and Voice Messages

#95

Post by majormajor »

hn_throwaway_99 wrote: post #68
m3kw9 wrote: post #55

Earlier quoted context omitted.

And what happens when your window runs out? It prunes the oldest convo which you will need to keep track. Likely it could be fine, but if there was a task from a long time ago, that could get wiped out

Every time I add or complete a task, ChatGPT outputs the latest complete copy of my task list (I only had to ask it to do this the first time, then it just did that automatically). So, in other words, it always updates the latest "live state" in its most recent message. If I hit the limit on context window it would just take me ~30 seconds to open up a new window with my original prompt and the latest iteration of my…

This looks way more like "improved chat interface to a Reminders app compared to Siri" or such than "prioritize and remember things with human intuition".

Re: Personal Concierge Using OpenAI's ChatGPT via Telegram and Voice Messages

#96

Post by fl7305 »

Cyphase wrote: post #85
fl7305 wrote: post #59

Earlier quoted context omitted.

> Running inference does not change the trained weights. That's true today. I don't know how many days (or hours) away we are from GPT-4 running a LoRA-pass to update its weights after each round though?

That would be an explicit decision by OpenAI, not a result of immature tech.

Sure. But my point was that it is not an inherent feature in LLMs that they are frozen in time.

Fine-tuning the entire model is very expensive. But fine-tuning a tiny parallell piece using LoRA is cheap both in CPU cycles and storage.

OpenAI could already have implemented an auto-update feature without telling us.

In the future, I can see them selling a premium feature where you have your own LoRA-addon that gets constantly trained on your interactions with it, so you get your own personalized GPT-4.

Re: Personal Concierge Using OpenAI's ChatGPT via Telegram and Voice Messages

#97

Post by jaggs »

umaar wrote: post #4

Made something similar recently, but for WhatsApp: https://chatbling.net/ What behaviour would users prefer when uploading a voice message, a) the voice message is transcribed, so speech to text? Or b) the voice message is treated as a query, so you receive a text answer to your voice query? I've done a) for now as mobile devices already let you type with your voice.

This is very cool. I tested it with a quick reminder request and it seemed to work. I'm a bit terrified by the privacy issue though. Combining OpenAI with WhatsApp seems like a marriage made in hell.

I guess the only solution will be to move to local bots and models on the phone which will interface out only when needed.

Re: Personal Concierge Using OpenAI's ChatGPT via Telegram and Voice Messages

#98

Post by Heloseaa »

Hadriel wrote: post #93
Heloseaa wrote: post #80

Recently did the same in a lightweight alternative with python: https://github.com/clemsau/telegram-gpt Looking to make it accessible, cheap and as lean as possible. I'd love to hear potential features ideas.

can you choose to use gpt4?

I will look into it when I will be granted access to the GPT4. But yeah, I plan to the make accessible the switch between GPT 3.5 and GPT 4 right into telegram.

Re: Personal Concierge Using OpenAI's ChatGPT via Telegram and Voice Messages

#99

Post by haukurb »

ravenstine wrote: post #44
hn_throwaway_99 wrote: post #32

Earlier quoted context omitted.

That's just the case for this bot, but is obviously not the case for ChatGPT. I have a long running conversation with ChatGPT that I use to keep track of a verbal to-do list. I tell it my items with categories (e.g. work, personal, etc.) and estimated times, and then it outputs my complete task list, grouped by category. I then just tell it when I add tasks or complete tasks, and it continually keeps track of and out…

Oh dang, that sounds awesome. So a ChatGPT conversation doesn't have a historical limit? I guess I assumed it would start having to forget things at a certain point.

They might make it summarize intermittently behind the scenes when the context grows too large. Which would be how it has a gist of the stuff that was mentioned way earlier even thought it doesn't know the specifics.

Re: Personal Concierge Using OpenAI's ChatGPT via Telegram and Voice Messages

#100

Post by tikkun »

mkw5053 wrote: post #2

I’ve been heavily using chatgpt (gpt 4) on my honeymoon/baby moon/vacation in Spain. Everything from itineraries to asking art history questions in museums. I’ve mainly been using the voice input on my iPhone for chatgpt on a mobile browser and I can’t help but think how useful better voice support will be.

I've got an iPhone app in testflight beta that has speech to text and text to speech. Basically a nicer iPhone app for GPT-4, I tried most of the existing ones and none were particularly nice UX.

Pricing model for now is you just pay exactly what we pay (we just pass on the API costs plus Apple's 30%, no markup). We could add a use your own API key thing too to avoid Apple's 30%.

If you'd like access, email in profile

Post reply on HN