Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

The killer app of Gemini Pro 1.5 is using video as an input

simonwillison.net

Post reply on HN
Print view View original

351–360 of 507 posts

Re: The killer app of Gemini Pro 1.5 is using video as an input

#351

Post by shostack »

slg wrote: post #124
MyFirstSass wrote: post #71

Ok, crazy tangent; Where agents will potentially become extremely useful/dystopian is when they just silently watch your entire screen at all times. Isolated, encrypted and local preferably. Imagine it just watching you coding for months, planning stuff, researching things, it could potentially give you personal and professional advice from deep knowledge about you. "I noticed you code this way, may i recommend this…

>Isolated, encrypted and local of course. And what is the likelihood of that "of course" portion actually happening? What is the business model that makes that route more profitable compared to the current model all the leaders in this tech are using in which they control everything?

This. I want an AI assistant like in the movie Her. But when I think about the realities of data access that requires, and my limited trust in companies that are playing in this space to do so in a way that respects my privacy, I realize I won't get it until it is economically viable to have an open source option run on my own hardware.

Re: The killer app of Gemini Pro 1.5 is using video as an input

#352

Post by [deleted] »

narrator wrote: post #291
baobabKoodaa wrote: post #251

Earlier quoted context omitted.

Nobody would complain on HN if Google Gemini was generating pictures of Lincoln existing as a... gasp ... white person. This absurd level of woke censorship is not doing them any good.

If you put in a fictional story that in the future computers could generate any image, but would refuse to make images of Lincoln as a white person, people would tell you you were an absolute lunatic confabulating paranoid fantasies that were ludicrous strawmen, but here we are. It's almost as if we should remove "slippery slope" from the list of informal fallacies since lately it's been more true to reality than not…

[deleted]

Re: The killer app of Gemini Pro 1.5 is using video as an input

#353

Post by phatfish »

Solvency wrote: post #271
oconnor663 wrote: post #158

Earlier quoted context omitted.

A version of this that seems both easier and less weird would be an AI that listens to you all the time when you're learning a foreign language. Imagine how much faster you could learn, and how much more native you could ultimately get, if you had something that could buzz your watch whenever you said something wrong. And of course you'd calibrate it to understand what level you're at and not spam you constantly. I w…

I love how in a sea of navel-gazing ideas, this one is randomly being downvoted to oblivion. Does HN hate learning new languages or something?

Learning and a "personal tutor" seem like a sweet spot for generative AI. It has the ability to give a conversational representation to the sum total of human knowledge so far.

When it can gently nag you via a phone app to study and have a fake zoom call with you to be more engaging it feels like that could get much better results than the current online courses.

Re: The killer app of Gemini Pro 1.5 is using video as an input

#354

Post by dewey »

BlueTemplar wrote: post #348
dmix wrote: post #194

Earlier quoted context omitted.

Oh god the one thing we don’t need is more half assed moderation systems. Human mods are bad enough at it as it is. Mostly because they make these systems opaque on purpose. Sites like YouTube never have any proper timely recourse for when they get it wrong unless you’re a larger content creator. Or worse even is the complete lack of transparency on why something was removed. Plus the whole DMCA debacle. The YouTube…

It's on them at this point, PeerTube has been available for years.

Getting a video taken down from time to time is less disruptive to a creator than moving to a platform with zero discover ability and no community or monetization options.

Re: The killer app of Gemini Pro 1.5 is using video as an input

#355

Post by donw »

slimsag wrote: post #283
xyzelement wrote: post #267

Earlier quoted context omitted.

We're months into this technology being available so it's not a surprise that the various "safeties" have not been perfectly tuned. Perhaps Google knew they couldn't be perfect right now and they could err on the side of the model refusing to talk about cocktails, or err on the side of it gladly spouting about cocks. They may have made a perfectly valid choice for the moment.

If you want a great example of how this plays out long-term, look no further than algospeak[0] - the new lingo created by censorship algorithms like those on youtube and tiktok. [0] https://www.nytimes.com/2022/11/19/style/tiktok-avoid-modera...

Chinese have been doing this for years to get around government censorship.

Re: The killer app of Gemini Pro 1.5 is using video as an input

#356

Post by bushbaba »

MyFirstSass wrote: post #71

Ok, crazy tangent; Where agents will potentially become extremely useful/dystopian is when they just silently watch your entire screen at all times. Isolated, encrypted and local preferably. Imagine it just watching you coding for months, planning stuff, researching things, it could potentially give you personal and professional advice from deep knowledge about you. "I noticed you code this way, may i recommend this…

Basically Google’s current search model, just expanded to ChatGPT style. Great….

Re: The killer app of Gemini Pro 1.5 is using video as an input

#357

Post by prmoustache »

roywiggins wrote: post #320
goatlover wrote: post #307

Earlier quoted context omitted.

I simply am not going to have my entire life filmed by an form of technology, I don't care what the advantages are. There's a limit to the level of dystopian dependent uses of these technologies I'm going to put up with. I sincerely hope the majority of the human race feels the same way.

People already fill their homes with nanny cams. Very soon someone will hook those up to LLMs so you can ask it what happened at home while you were gone.

I think that is mostly a regional USA thing.

What they fill their homes with are definitely microphones, with the google assistant and amazon echos.

Re: The killer app of Gemini Pro 1.5 is using video as an input

#359

Post by prmoustache »

dewey wrote: post #354
BlueTemplar wrote: post #348

Earlier quoted context omitted.

It's on them at this point, PeerTube has been available for years.

Getting a video taken down from time to time is less disruptive to a creator than moving to a platform with zero discover ability and no community or monetization options.

Isn't monetization so low on youtube that it is more worthy as an advertising platform for your sponsors, patreon subscriptions and merchandising than anything?

Re: The killer app of Gemini Pro 1.5 is using video as an input

#360

Post by exodust »

beepbooptheory wrote: post #342
exodust wrote: post #340

Earlier quoted context omitted.

Some people have the last name "Dick". If Google refuses to mention these people or surface results about their work, would you say "that makes sense" because of some story about Gorillas? The solution to all this politically oversensitive infiltration of engineering, is to have an unconstrained AI mode. The default mode can remain the painfully woke PC nanny, but give people the option to use unconstrained AI at the…

The only reason these things work is because of RLHF, there are no good "uncensored" models hidden away, only worse models that maybe say slurs. What you seem to want does not and cannot exist. Further, in such a profoundly general utility, there can be no absence of politics, only different politics. You can clutch your pearls about wokism or PC or whatever all you want, it just means this world is going to leave yo…

Sounds like you'd choose the default woke option, and I'd choose the non-woke option. Choice is healthy.

This world will leave you behind if you elect to substitute choice with monolithic wokism or any over-correcting ideology.

Meanwhile:

> Google is racing to fix its new AI-powered tool for creating pictures, after claims it was over-correcting against the risk of being racist. "It's missing the mark here," said Jack Krawczyk, senior director for Gemini Experiences. - BBC News

Post reply on HN