Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

We are beginning to roll out new voice and image capabilities in ChatGPT

openai.com

Post reply on HN
Print view View original

211–220 of 914 posts

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#211

Post by jdance »

epolanski wrote: post #60

I'm following on trying to understand how close I am to developing my personal coding assistant I can speak with. Doesn't really need to do much besides writing down my tasks/todos and updating them, occasionally maybe provide feedback or write a code snippet. This all seems in the current capabilities of OpenAI's offering. Sadly voice chat is still not available on PC where I do my development.

You still cant really teach it your code base, context window is too small, fine tuning doesnt really fit the use case, and this RAG stuff (retrieve limited context from embeddings) is a bit of a hack imho.

Fingers crossed we are there soon though

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#212

Post by badcppdev »

I think AI systems being able to the real world and control motors is going to be a game changer bigger than ChatGPT. A robot that can slowly sort out the pile of laundry and get it into the right place (even if unfolded) is worth quite a bit to me.

I'm not sure what to think about the fact that I would benefit from a couple of cameras in my fridge connected to an app that would remind me to buy X or Y and tell me that I defrosted something in the fridge three days ago and it's probably best to chuck it in the bin already.

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#213

Post by sebzim4500 »

skepticATX wrote: post #164
clbrmbr wrote: post #33

Earlier quoted context omitted.

And then the wedding speech. What are they thinking over there at OpenAI? This is supposed to be a productivity enhancer, not a way to outsource the most meaningful applications of human language…

> What are they thinking over there at OpenAI? I know this is rhetorical, but luckily we don't have to speculate. OpenAI filters for a very specific philosophy when hiring, and they don't try to hide it. This is not me passing judgement on whether said philosophy is right or wrong, but it does exist and it's not hidden.

>OpenAI filters for a very specific philosophy when hiring, and they don't try to hide it.

Do you have evidence for this? I know two people who work at OpenAI and I don't think they have much in common philosophically.

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#214

Post by jprete »

joshstrange wrote: post #166
Closi wrote: post #150

Earlier quoted context omitted.

They have gone from being a niche research company to being (probably) the fastest growing start-up in history. I suspect they do care about communicating with customers, but it's total chaos and carnage internally.

> I suspect they do care about communicating with customers, but it's total chaos and carnage internally. This is my best guess as well, they are rocketing down the interstate at 200mph and just trying to keep the wheels on the car. When you're absolutely killing it I guess making X% more by being better at messaging just isn't worth it since to do that you'd have to take someone off something potentially more critic…

When dealing with a tech where people have credible reasons to believe it can be enormously harmful on every possible time scale, maybe it would behoove them to not rocket down the interstate at 200mph?

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#215

Post by shanusmagnus »

gwd wrote: post #46
suyash wrote: post #29

This announcement seem to have killed so many startups that were trying to do multi-modal on top of ChatGPT. The way it's progressing with solving use cases with images and voice, not too far when it might be the 'one app to rule them all'. I can already see "Alexa/Siri/Google Home" replacement, "Google Image Search" replacement, ed-tech startups that were solving problems with AI using by taking a photo are also doo…

In retrospect, such startups should have been wary: they should have known that OpenAI had Whisper, and also that GPT-4 was designed with image modality. I wouldn't say that OpenAI "telegraphed" their intentions, but the very first strategic question should have been, "Why isn't OpenAI doing this already, and what do we do if they decide to start?"

It would hard to be more explicit than doing a demo of multi-modality in GPT-4, and having an audio API that is amazing and that you can use right now, for pennies.

It would be interesting to know if this really changed anything for anyone (competitors, VCs) for that reason. It's like the efficient market hypothesis applied to product roadmaps.

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#217

Post by rickspencer3 »

ChatGTP wrote: post #61
NikolaNovak wrote: post #39

Earlier quoted context omitted.

Talking to Google and Siri has been positively frustrating this year. On long solo drives, I just want to have a conversation to learn about random things. I've been itching to "talk" to chatGPT and learn more (french | music theory | history | math | whatever) all summer. This should hit the spot!

I still don't understand how you can talk to something that doesn't provide factual information and just take it at face value? The other day I asked it about the place I live and it made up nonsense, I was trying to get it to help me with an essay and it was just wrong, it was telling me things about this region that weren't real. Do we just drive through a town, ask for a made up history about it and just be satisf…

In my experience, LLVMs are not about being provided facts. They are about synthesizing new content and insights based on the model and inputs.

Rather than asking it about facts, I find it useful to derive new insights.

For example: "Tell me 5 topics about databases that might make it to the front page of hacker news." It can generate an interesting list. That is much more like the example they provided in the article, synthesizing a bed time story is not factual.

Also, "write me some python code to do x" where x is based on libraries that were well documented before 2022 also has similarly creative results in my experience.

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#218

Post by jstummbillig »

joshstrange wrote: post #135

My biggest complaint with OpenAI/ChatGPT is their horrible "marketing" (for lack of a better term). They announce stuff like this (or like plugins), I get excited, I go to use it, it hasn't rolled out to me yet (which is frustrating as a paying customer), and my only recourse is.... check back daily? They never send an email "Plugins are available for you!", "Voice chat is now enabled on your account!" and so often I…

Imagine how fantastic you are doing, when your biggest user complaint stems from frustration with features they can not use just yet.

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#219

Post by DrScientist »

bamboozled wrote: post #178
DrScientist wrote: post #42

Earlier quoted context omitted.

So almost human then :-)

I don't pay $20 a month for humans to talk shit to me though. The fact that they do this is a bug not a feature. I'm not going to pay for bullshit which I mostly try avoid?

> I don't pay $20 a month for humans to talk shit to me though.

No - you probably pay more for your internet access ( home and phone ) ;-)

More seriously I totally get your point about accuracy - these models need to be better at detecting and surfacing when they are likely to be filling in the blanks.

Though I still think there is an element of 'buyer beware' - whether it be AI, or human provided advice on the internet, it's still your job to be able to spot the bullsh!t.

ie it should be treated like any other source of info.

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#220

Post by RobinL »

I'd like to see them put speech recognition through their LLM as a post-processing step. I find it's fairly common for whisper to make small but obvious mistakes (for example a word which is complete nonsense in the context of the sentence) which could be easily corrected for a similar sounding word that fits into the wider context of the sentence.

Is anyone doing this? Is there a reason it doesn't work as well as I'm imagining?

Post reply on HN