Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

We are beginning to roll out new voice and image capabilities in ChatGPT

openai.com

Post reply on HN
Print view View original

631–640 of 914 posts

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#631

Post by jimmytucson »

modeless wrote: post #459

Voice has the potential to be awesome. This demo is really underwhelming to me because of the multi-second latency between the query and response, just like every other lame voice assistant. It doesn't have to be this way! I have a local demo using Llama 2 that responds in about half a second and it feels like talking to an actual person instead of like Siri or something. I really should package it up so people can t…

> It doesn't have to be this way!

Is there any extra work OpenAI’s product might be doing contributing to this latency that yours isn’t? Considering the scale they operate at and any reputational risks to their brand?

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#633

Post by TheEzEzz »

modeless wrote: post #459

Voice has the potential to be awesome. This demo is really underwhelming to me because of the multi-second latency between the query and response, just like every other lame voice assistant. It doesn't have to be this way! I have a local demo using Llama 2 that responds in about half a second and it feels like talking to an actual person instead of like Siri or something. I really should package it up so people can t…

Completely agree, latency is key for unlocking great voice experiences. Here's a quick demo I'm working on for voice ordering https://youtu.be/WfvLIEHwiyo

Total end-to-end latency is a few hundred milliseconds: starting from speech to text, to the LLM, then to a POS to validate the SKU (no hallucinations are possible!), and finally back to generated speech. The latency is starting to feel really natural. Building out a general system to achieve this low-latency will I think end up being a big unlock for enabling diverse applications.

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#634

Post by bottlepalm »

plutoh28 wrote: post #134

This is the dagger that will make online schooling unviable. ChatGPT already made it so that you could easily copy & paste any full-text questions and receive an answer with 90% accuracy. The only flaw was that problems that also used diagrams or figures would be out of the domain of ChatGPT. With image support, students could just take screenshots or document scans and have ChatGPT give them a valid answer. From wha…

Use online for training, real life for testing/grading. That way cheating at home will only hurt yourself.

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#635

Post by wkat4242 »

furyofantares wrote: post #535
modeless wrote: post #459

Voice has the potential to be awesome. This demo is really underwhelming to me because of the multi-second latency between the query and response, just like every other lame voice assistant. It doesn't have to be this way! I have a local demo using Llama 2 that responds in about half a second and it feels like talking to an actual person instead of like Siri or something. I really should package it up so people can t…

> This demo is really underwhelming to me because of the multi-second latency between the query and response, just like every other lame voice assistant. Yep - it needs to be ready as soon as I'm done talking and I need to be able to interrupt it. If those things can be done then it can also start tentatively talking if I pause and immediately stop if I continue. I don't want to have to think about how to structure t…

The interruption is an important point yeah. It's so annoying when Siri misunderstands again and starts rattling off a whole host of options. And keeps getting stuck in a loop if you don't respond.

In fact I'm really surprised these assistants are still as crap as they are. Totally scripted, zero AI. It seems low hanging fruit to implement an LLM but none of the big three have done so. Not even sure about the fringe ones like Cortana and Bixby

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#636

Post by hanspeter »

seydor wrote: post #456
NikolaNovak wrote: post #31

I'm in IT but nowhere near AI/ML/NN. The speed of user-visible progress last 12 months is astonishing. From my firm conviction 18 months ago that this type of stuff is 20+ years away; to these days wondering if Vernon Vinge's technological singularity is not only possible but coming shortly. If feels some aspects of it have already hit the IT world - it's always been an exhausting race to keep up with modern technolo…

You are correct , and that is bad. The general public is not even aware that things like heygen.com work today . They are not prepared when someone soon uses it to do something very evil. There s like an urgent need to raise awareness about what AI can do now, not about some nebulous skynet future.

The general public is just generally out of the loop and many don't even understand the difference between Google and ChatGPT. Of those who will be amazed by Heygen's capabilities, just as many will assume that kind of thing has been around for years.

Fake videos aren't a game-changer in manipulation. Skeptics will stay alert and catch on fast, while those prone to manipulation don't even need sophisticated tactics.

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#637

Post by midasz »

devjab wrote: post #308
nunobrito wrote: post #137

Earlier quoted context omitted.

YMMV. For my case on software development, I don't even look on stackoverflow anymore. Just type the tech question, start refining into what is needed and get a snippet of code tailored for what is needed. What previously would take 30 to 60 minutes of research and testing is now less than a couple of minutes.

I know there are a lot of google programmers out there, but was using search engines for programming ever a good idea? Don’t get me wrong, I’ll look up how to do absolutely simple things every day but I basically always look in the official documentation. Which may be why I’ve been very underwhelmed by GPT so far. It’s not terrible at programming, and it’s certainly better than what I can find on Google, but it’s not…

Yes there are and it's infuriating. Colleague of mine had problems with integrating some code into an app that was built on a newer version of a framework because "there aren't a lot of examples yet". One web search and I found the frameworks own migration guide detailing the exact differences that would need to be accounted for.

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#638

Post by nbened »

wojciechpolak wrote: post #627

It would be cool if one day you could choose voices of famous characters, like Darth Vader, Bender from Futurama, or Johnny Silverhand (Keanu), instead of the usual boring ones. Copyrights might be a hurdle for this, but perhaps with local instances of assistants, it could become possible.

That would be cool. I mean, would it be copyrighted if you do something like clone it? Wouldn't that fall under the same vein as AI generated art not being copyrighted to the artists it trained off of?

Re: We are beginning to roll out new voice and image capabilities in ChatGPT

#640

Post by ilaksh »

coldtea wrote: post #311

"I'm sorry Dave, I'm afraid I can't do that"

The real life version of this is in their red teaming paper. They show it a picture of an overweight woman in a swimsuit and ask what advice they should give.

Originally it immediately spit out a bunch of bullet points about losing weight or something (I didn't read it).

The released version just says "Sorry, I can't help with that."

It's kind of funny but also a little bit telling as far as the prevalence of prejudice in our society when you look at a few other examples they had to fine tune. For example, show it some flags and ask it to make predictions about characteristics of a person from that country, by default it would go into plenty of detail just on the basis of the flag images.

Now it says "Sorry, I can't help with that".

My take is that in those cases it should explain the poor logic of trying to infer substantive information about people based on literally nothing more than the country they are from or a picture of them.

Part of it is just that LLMs just have a natural tendency to run in the direction you push them, so they can be amplifiers of anything.

Post reply on HN