Live data from Hacker News

The killer app of Gemini Pro 1.5 is using video as an input

simonwillison.net

141–150 of 507 posts

Re: The killer app of Gemini Pro 1.5 is using video as an input

#141
post #135

Earlier quoted context omitted.

Is it true or more of a myth? Based on my online read, Europe has "think of the children" narrative as common if not more than other parts of the world. They tried hard to ban encryption in apps many times.[1] [1]: https://proton.me/blog/eu-council-encryption-vote-delayed

Democratic governance is complicated. It’s never black and white and it’s perfectly possible for parts of the EU to be working to end encryption while another part works toward enhancing citizen privacy rights. Often they’re not even supported by the same politicians, but since it’s not a winners takes all sort of thing, it can all happen simultaneously and sometimes they can even come up with some “interesting” prop…

I am fine with private company using my data for showing me better ads. They can't affect my life significantly.

I am not fine with government using the data to police me. Already in most countries, governments are putting people in jail because of things like hate speech where are the laws are really vague.

Re: The killer app of Gemini Pro 1.5 is using video as an input

#142

Ok, crazy tangent; Where agents will potentially become extremely useful/dystopian is when they just silently watch your entire screen at all times. Isolated, encrypted and local preferably. Imagine it just watching you coding for months, planning stuff, researching things, it could potentially give you personal and professional advice from deep knowledge about you. "I noticed you code this way, may i recommend this…

Not crazy! I listened to a software engineering daily episode about pieces.app. Right now it’s some dev productivity tool or something, but in the interview the guy laid out a crazy vision that sounds like what you’re talking about. He was talking about eventually having an agent that watches your screen and remembers what you do across all apps, and can store it and share it with you team. So you could say “how does…

Being able to ask about stuff other people do seems like it could be ripe with privacy issues, honestly. Even if the model was limited to only recording work stuff, I don't think I would want that. Imagine "how often does my coworker browse to HN during work" or "list examples of dumb mistakes my coworkers have made" for some not-so-bad examples.

Re: The killer app of Gemini Pro 1.5 is using video as an input

#143

Ok, crazy tangent; Where agents will potentially become extremely useful/dystopian is when they just silently watch your entire screen at all times. Isolated, encrypted and local preferably. Imagine it just watching you coding for months, planning stuff, researching things, it could potentially give you personal and professional advice from deep knowledge about you. "I noticed you code this way, may i recommend this…

I'm working on this! https://www.perfectmemory.ai/

It's encrypted (on top of Bitlocker) and local. There's all this competition who makes the best, most articulate LLM. But the truth is that off-the-shelf 7B models can put sentences together with no problem. It's the context they're missing.

Re: The killer app of Gemini Pro 1.5 is using video as an input

#145
post #131

Earlier quoted context omitted.

> encrypted and local of course Only for people who'd pay for that. Free users would become the product.

Unless its open sourced :)

In modern world open code often doesn't mean much. E.g. Chrome is opensourced. And yet no one really contributes to it or has any say over the direction its going: https://twitter.com/RickByers/status/1715568535731155100

Re: The killer app of Gemini Pro 1.5 is using video as an input

#146

I wonder if the real killer app is Googles hardware scale verses OpenAi' s(or what Microsoft gives them). Seems like nothing Google's done has been particular surprising to OpenAi's team, it's just they have such huge scale maybe they can iterate faster.

The real moat is that Google has access to all the video content from YouTube to train the AI on, unlike anyone else.

I’m not sure I would necessarily call YouTube a moat-creator for Google, since the content on YouTube is for all intents and purposes public data.

Re: The killer app of Gemini Pro 1.5 is using video as an input

#148

Ok, crazy tangent; Where agents will potentially become extremely useful/dystopian is when they just silently watch your entire screen at all times. Isolated, encrypted and local preferably. Imagine it just watching you coding for months, planning stuff, researching things, it could potentially give you personal and professional advice from deep knowledge about you. "I noticed you code this way, may i recommend this…

Heh. Built a macOS app that does something like this a while ago - https://github.com/bharathpbhat/EssentialApp

Back then, I used on device OCR and then sent the text to gpt. I’ve been wanting to re-do this with local LLMs

Re: The killer app of Gemini Pro 1.5 is using video as an input

#149
post #57

I was thinking about this a while back, once AI is able to analyze video, images and text and do so cheap & efficiently. It's game over for privacy, like completely. Right now massive corps have tons of data on us, but they can't really piece it together and understand everything. With powerful AI every aspect of your digital life can be understood. The potential here is insane, it can be used for so many different t…

Unless you live in the EU and have laws that should protect you from that.

Public sector agencies and law enforcement are generally exempt (or have special carve outs) in European privacy regulations.
Post reply on HN