Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Personal Concierge Using OpenAI's ChatGPT via Telegram and Voice Messages

github.com

Post reply on HN
Print view View original

11–20 of 102 posts

Re: Personal Concierge Using OpenAI's ChatGPT via Telegram and Voice Messages

#11

Post by umaar »

umaar wrote: post #4

Made something similar recently, but for WhatsApp: https://chatbling.net/ What behaviour would users prefer when uploading a voice message, a) the voice message is transcribed, so speech to text? Or b) the voice message is treated as a query, so you receive a text answer to your voice query? I've done a) for now as mobile devices already let you type with your voice.

I see my server has restarted a few times! I imagine it's folks here since I haven't shared Chat Bling elsewhere yet. Sorry to anyone who started generating images, but haven't received a response. The 'jobs' for images generations are stored entirely within memory, so a server restart will lose all of that.

Going forward, I'll explore storing image jobs in redis or something, which will be more resilient to server crashes.

As for conversation history, I'll continue to keep that in memory for now (messages are evicted after a short time period, or if messages consume too many OpenAI tokens) - even that's lost during a server restart/crash. Feels like quite a big decision to store sensitive chat history in a persistent database, from a privacy standpoint.

Re: Personal Concierge Using OpenAI's ChatGPT via Telegram and Voice Messages

#12

Post by Cyphase »

hankman86 wrote: post #7

It amazes me to no end that some people would feed private conversations and other sensitive data into an experimental chat bot. Don’t these people not know that ChatGPT it not a mature technology, that does not reliably isolate sessions and may even permanently ingest user data for training purposes? GPT and other LLMs are currently integrated into countless products and hobbyist projects. Expect an avalanche of law…

(I may have misunderstood your comment to some extent, but I'm going to send this reply anyway even if just to clarify for anyone else who might misunderstand.)

---

I agree with "be careful what you send to the chat bot", but let's clarify some things in case you or someone else reading your comment is misunderstanding.

LLMs aren't immature AI brains that "may even permanently ingest user data for training purposes". They're just models, which are represented by an architecture described in readable source code, and weights derived from training.

There is a very clear delineation between inference and training. Models are static when being used for inference. You don't need to "untrain" the model after you ask it something; you never trained it in the first place. Running inference does not change the trained weights.

If you're talking about OpenAI specifically saving ChatGPT data for later training purposes, they absolutely are doing that; they aren't hiding it. But that's a purposeful "let's take this data and use it for training", not "oh no, our immature tech accidentally ingested prompt data, how do we untrain it"?

Re: Personal Concierge Using OpenAI's ChatGPT via Telegram and Voice Messages

#14

Post by hhh »

hankman86 wrote: post #7

It amazes me to no end that some people would feed private conversations and other sensitive data into an experimental chat bot. Don’t these people not know that ChatGPT it not a mature technology, that does not reliably isolate sessions and may even permanently ingest user data for training purposes? GPT and other LLMs are currently integrated into countless products and hobbyist projects. Expect an avalanche of law…

People continue to push this, without reading the privacy statements regarding API use.

https://openai.com/policies/api-data-usage-policies https://openai.com/blog/introducing-chatgpt-and-whisper-apis

Re: Personal Concierge Using OpenAI's ChatGPT via Telegram and Voice Messages

#15

Post by semiquaver »

Cyphase wrote: post #12
hankman86 wrote: post #7

It amazes me to no end that some people would feed private conversations and other sensitive data into an experimental chat bot. Don’t these people not know that ChatGPT it not a mature technology, that does not reliably isolate sessions and may even permanently ingest user data for training purposes? GPT and other LLMs are currently integrated into countless products and hobbyist projects. Expect an avalanche of law…

(I may have misunderstood your comment to some extent, but I'm going to send this reply anyway even if just to clarify for anyone else who might misunderstand.) --- I agree with "be careful what you send to the chat bot", but let's clarify some things in case you or someone else reading your comment is misunderstanding. LLMs aren't immature AI brains that "may even permanently ingest user data for training purposes".…

from the “reliably isolate sessions” reference I have to assume they are referring to this: https://news.ycombinator.com/item?id=35291112

Re: Personal Concierge Using OpenAI's ChatGPT via Telegram and Voice Messages

#16

Post by tyingq »

hhh wrote: post #14
hankman86 wrote: post #7

It amazes me to no end that some people would feed private conversations and other sensitive data into an experimental chat bot. Don’t these people not know that ChatGPT it not a mature technology, that does not reliably isolate sessions and may even permanently ingest user data for training purposes? GPT and other LLMs are currently integrated into countless products and hobbyist projects. Expect an avalanche of law…

People continue to push this, without reading the privacy statements regarding API use. https://openai.com/policies/api-data-usage-policies https://openai.com/blog/introducing-chatgpt-and-whisper-apis

"Note that this data policy does not apply to OpenAI's Non-API consumer services like ChatGPT or DALL·E Labs. You can learn more about these policies in our data usage for consumer services FAQ."

This particular project is API based, so the above doesn't apply, but I have seen several projects that scrape via ChatGPT, where your data is used:

"Does OpenAI train on my content to improve model performance?

For non-API consumer products like ChatGPT and DALL-E, we may use content such as prompts, responses, uploaded images, and generated images to improve our services."[1]

[1] https://help.openai.com/en/articles/7039943-data-usage-for-c...

Re: Personal Concierge Using OpenAI's ChatGPT via Telegram and Voice Messages

#17

Post by swores »

umaar wrote: post #4

Made something similar recently, but for WhatsApp: https://chatbling.net/ What behaviour would users prefer when uploading a voice message, a) the voice message is transcribed, so speech to text? Or b) the voice message is treated as a query, so you receive a text answer to your voice query? I've done a) for now as mobile devices already let you type with your voice.

I'd quite like a twilio script I could host that enables voice to voice with ChatGPT over a phone call, but for messaging apps (I'm gonna to try yours, though would prefer Signal) I'd personally prefer to stick with typing and use Apple's transcription (the default microphone on iOS keyboard) for any voice stuff - still wanting text back.

This is (in addition to the fact that Apple's works pretty well for me) mostly because that way I get to see the words appear as I'm speaking, and can fix any problems in real-time rather than waiting until I've finished leaving a voice note to find out it messed up. Bing AI chat, for example, trying to use their microphone button just leads to frustration as it regularly fails to understand me. But maybe Whisper is so good that I'd hardly ever need to care about errors?

I do suspect I'm an outlier in terms of how I use dictation, checking as I go - at least based on family members, they seem to either speak a sentence then look at it, or speak and then send without looking - so for them, off-device transcription would probably be welcome as long as it even slightly improves accuracy rates.

Re: Personal Concierge Using OpenAI's ChatGPT via Telegram and Voice Messages

#19

Post by swores »

umaar wrote: post #11
umaar wrote: post #4

Made something similar recently, but for WhatsApp: https://chatbling.net/ What behaviour would users prefer when uploading a voice message, a) the voice message is transcribed, so speech to text? Or b) the voice message is treated as a query, so you receive a text answer to your voice query? I've done a) for now as mobile devices already let you type with your voice.

I see my server has restarted a few times! I imagine it's folks here since I haven't shared Chat Bling elsewhere yet. Sorry to anyone who started generating images, but haven't received a response. The 'jobs' for images generations are stored entirely within memory, so a server restart will lose all of that. Going forward, I'll explore storing image jobs in redis or something, which will be more resilient to server c…

You could have a default "will be wiped after " policy / notification up front, plus an option to change this (in either direction, one way to "only store this in RAM not the DB, and wipe it as soon as I close this window - or maybe after an hour of inactivity", the other way to "please never delete (we reserve the right to delete anyway but will keep for at least Y days/months/whatever)". And also a "delete now" button to override. And then a cron job checking what's due to be deleted and wiping them from the DB/memory?

Of course, it maybe also adds more pressure to keep the server more secure without private conversations being accessible after a reboot...

Re: Personal Concierge Using OpenAI's ChatGPT via Telegram and Voice Messages

#20

Post by pantulis »

andag wrote: post #13

Can you update the readme with some info privacy wise. Some info on who I'm sharing my data with? Openai - fair enough, already doing that a fair amount .

It seems that you can self host the thing. Apart from that, it seems that you would be sharing info obviously with OpenAI (both GPT and Whisper), Telegram and Google.
Post reply on HN