Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

The killer app of Gemini Pro 1.5 is using video as an input

simonwillison.net

Post reply on HN
Print view View original

81–90 of 507 posts

Re: The killer app of Gemini Pro 1.5 is using video as an input

#81

Post by jpk »

seniorivn wrote: post #60
worldsayshi wrote: post #59

Earlier quoted context omitted.

Unless you live in the EU and have laws that should protect you from that.

incentives cannot be fixed with just prohibitive laws, war on drags should've taught you something

Laws, and more specifically their penalties, are precisely for fixing incentives. It's just a matter of setting a penalty that outweighs the natural incentive you want to override. e.g., Is it more expensive to respect privacy, or pay the fine for not doing so? PII could, and should, be made radioactive by privacy regulations and their associated penalties.

Re: The killer app of Gemini Pro 1.5 is using video as an input

#82

Post by CamperBob2 »

MyFirstSass wrote: post #71

Ok, crazy tangent; Where agents will potentially become extremely useful/dystopian is when they just silently watch your entire screen at all times. Isolated, encrypted and local preferably. Imagine it just watching you coding for months, planning stuff, researching things, it could potentially give you personal and professional advice from deep knowledge about you. "I noticed you code this way, may i recommend this…

I liked this idea better in THX-1138.

Re: The killer app of Gemini Pro 1.5 is using video as an input

#83

Post by waynesonfire »

> It looks like the safety filter may have taken offense to the word “Cocktail”!

how dare you!!! You are not allowed to think that.

It's crazy we are witnessing modern day equivalent of book burning / freedom of speech restrictions. Kind of a bummer. I'm not smart enough to argue freedom of speech and wish someone smarter than me addressed this. Maybe I can ask chatgpt.

Re: The killer app of Gemini Pro 1.5 is using video as an input

#84

Post by simonw »

7357 wrote: post #70

To me the 'It didn’t get all of them' is what makes me think this AI thing is just a toy. Don't get me wrong, it's marvelous as it is, but it only is useful (I use ollama + mistral 7B) when I know nothing, if I do have some understanding of the topic at hand it just becomes plain wrong. Hopefully I will be corrected.

Have you spent much time with GPT-4?

I like experimenting with Mistral 7B and Mixtral, but the quality of output from those is still sadly in a different league from GPT-4.

Re: The killer app of Gemini Pro 1.5 is using video as an input

#85

Post by elzbardico »

AI_beffr wrote: post #76

he calls this technology "exciting." it makes me shudder. i have been contemplating this for a decade, this specific thing, and now it really is right in front of us. what happens when the useful data within any image or video stream can be extracted into the form of text and descriptions? a model of the world or of a country will emerge that you can hold in your hand. you can know the exact whereabouts of anyone at…

Man. LLMs are basically auto-complete systems. This scenario you're painting seems too far-fetched for this technology at any timeline you could propose.

Re: The killer app of Gemini Pro 1.5 is using video as an input

#86

Post by system2 »

MyFirstSass wrote: post #71

Ok, crazy tangent; Where agents will potentially become extremely useful/dystopian is when they just silently watch your entire screen at all times. Isolated, encrypted and local preferably. Imagine it just watching you coding for months, planning stuff, researching things, it could potentially give you personal and professional advice from deep knowledge about you. "I noticed you code this way, may i recommend this…

If 7 second video consumed 1k token, I'd assume the budget must be insane to process such prompt.

Re: The killer app of Gemini Pro 1.5 is using video as an input

#87

Post by MyFirstSass »

CamperBob2 wrote: post #82
MyFirstSass wrote: post #71

Ok, crazy tangent; Where agents will potentially become extremely useful/dystopian is when they just silently watch your entire screen at all times. Isolated, encrypted and local preferably. Imagine it just watching you coding for months, planning stuff, researching things, it could potentially give you personal and professional advice from deep knowledge about you. "I noticed you code this way, may i recommend this…

I liked this idea better in THX-1138.

One of the movies i've had on my watch list for far too long, thanks for reminding me.

But yeah, dystopia is right down the same road we're all going right now.

Re: The killer app of Gemini Pro 1.5 is using video as an input

#88

Post by mrinterweb »

CobrastanJorji wrote: post #47
ugh123 wrote: post #35

Title should have input added to the end "The killer app of Gemini Pro 1.5 is video input" Seems like a good way to do video moderation (YouTube) at scale, if they can keep costs down...

Probably overkill for content moderation, I'd think. You can identify bad words looking only at audio, and you can probably do nearly as good a job of identifying violence and nudity examining still images. And at YouTube scale, I imagine the main problem with moderation isn't so much as being correct, but of scaling. statista.com (what's up with that site, anyway?) suggests that YouTube adds something like 8 hours o…

I have no idea how YouTube currently moderates its content, but there may be some benefit with Gemini. I'm sure Googlers have been considering this option.

Re: The killer app of Gemini Pro 1.5 is using video as an input

#89

Post by nox101 »

chefandy wrote: post #62

These things seem great for casual use, but not trustworthy enough for archival work, for example. The world needs casual-use tools, too, but there are bigger impact use cases in the pipeline. I'd love for these things to communicate when they're shaky on an interpretation, for example. Maybe pairing it with a different model and using an adversarial approach? Getting a confidence rating on existing messy data where…

honest question: Why is it bad? I see that posted over and over. Right now I watch SF and LA feel like 3rd world countries. Nothing appears to be enforced. Traffic laws, car break-ins, car theft, garage break-ins, house break-ins.

I'd personally choose a little less privacy if it meant less people were getting injured by drivers ignoring the traffic laws and, less people were having to shell out for all the costs associated with theft including replacing or repairing the damaged/stolen item as well as the increased insurance costs, cost that get added to everyone's insurance regardless of income level. Note: car break-in, garage break-in has both costs for the items stolen and costs to repair the car/garage/house.

I don't know where to draw the line. I certainly don't want cameras in my house or looking through my windows. Nor do I want it on my computer or TV looking at what I do/view.

For traffic, I kind of feel like at a minimum, if they can move the detection to the cameras and only save/transmit the violations that would be okay with me. You violated the law in a public space that affected others, your right to not be observed ends for that moment in time. Also, if I could personally send in violations I would have sent 100s by now. I see 3-8 violations every time I go out for a 30-60 minute drive.

https://www.latimes.com/california/story/2024-01-25/traffic-...

There are similar articles for SF.

Re: The killer app of Gemini Pro 1.5 is using video as an input

#90

Post by AI_beffr »

elzbardico wrote: post #85
AI_beffr wrote: post #76

he calls this technology "exciting." it makes me shudder. i have been contemplating this for a decade, this specific thing, and now it really is right in front of us. what happens when the useful data within any image or video stream can be extracted into the form of text and descriptions? a model of the world or of a country will emerge that you can hold in your hand. you can know the exact whereabouts of anyone at…

Man. LLMs are basically auto-complete systems. This scenario you're painting seems too far-fetched for this technology at any timeline you could propose.

just five years ago it would be far fetched to suggest that we would have what we have now. its clear that peoples intuition about what is likely and what is not is not accurate right now. and this scenario is actually the opposite of unlikely, its inevitable. the economic forces will not allow any other outcome. its not really surprising when you consider how inefficient market based economies are, how inefficient and fragile humans are, and the fact that communism has already come close to working in the past. even without AI, centralized economies rival decentralized ones. and the loss of human agency that comes with centralized economies cant be dismissed.
Post reply on HN