Live data from Hacker News

The killer app of Gemini Pro 1.5 is using video as an input

simonwillison.net

131–140 of 507 posts

Re: The killer app of Gemini Pro 1.5 is using video as an input

#131

Ok, crazy tangent; Where agents will potentially become extremely useful/dystopian is when they just silently watch your entire screen at all times. Isolated, encrypted and local preferably. Imagine it just watching you coding for months, planning stuff, researching things, it could potentially give you personal and professional advice from deep knowledge about you. "I noticed you code this way, may i recommend this…

> encrypted and local of course

Only for people who'd pay for that.

Free users would become the product.

Re: The killer app of Gemini Pro 1.5 is using video as an input

#132
post #77

Earlier quoted context omitted.

Rewind.ai

I have tried Rewind and found it very disappointing. Transcripts were of very poor quality and the screen capture timeline proved useless to me.

If it wasn't for the poor transcript quality would you consider Rewind.ai to be valuable enough to use day-to-day?

Could you elaborate on what was useless about the screen capture timeline?

Re: The killer app of Gemini Pro 1.5 is using video as an input

#133
post #131

Ok, crazy tangent; Where agents will potentially become extremely useful/dystopian is when they just silently watch your entire screen at all times. Isolated, encrypted and local preferably. Imagine it just watching you coding for months, planning stuff, researching things, it could potentially give you personal and professional advice from deep knowledge about you. "I noticed you code this way, may i recommend this…

> encrypted and local of course Only for people who'd pay for that. Free users would become the product.

Unless its open sourced :)

Re: The killer app of Gemini Pro 1.5 is using video as an input

#135

Earlier quoted context omitted.

Unless you live in the EU and have laws that should protect you from that.

Is it true or more of a myth? Based on my online read, Europe has "think of the children" narrative as common if not more than other parts of the world. They tried hard to ban encryption in apps many times.[1] [1]: https://proton.me/blog/eu-council-encryption-vote-delayed

Democratic governance is complicated. It’s never black and white and it’s perfectly possible for parts of the EU to be working to end encryption while another part works toward enhancing citizen privacy rights. Often they’re not even supported by the same politicians, but since it’s not a winners takes all sort of thing, it can all happen simultaneously and sometimes they can even come up with some “interesting” proposals that directly interfere with each other.

That being said there is a difference between the US and the EU in regards to how these things are approached. Where the US is more likely to let private companies destroy privacy while keeping public agencies leashed it’s the opposite in Europe. Truth be told, it’s not like the US initiatives are really working since agencies like the NSA seem to blatantly ignore all laws anyway, which cause some scandals here in Europe as well. In Denmark our Secret Police isn’t allowed to spy on us without warrants, but our changing governments has had different secret agreements with the US to let the US monitor our internet traffic. Which is sort of how it is, and the scandal isn’t so much that, it’s how our Secret Police is allowed to get information about Danish citizens from the NSA without warrants, letting our secret police spy on us by getting the data they aren’t allowed to gather themselves from the NSA who are allowed to gather it.

Anyway, it’s a complicated mess, and you have so many branches of the bureaucracy and so many NGOs pulling in different directions that you can’t say that the EU is pro or anti privacy the way you want to. Because it’s both of those things and many more at the same time.

I think the only thing the EU unanimously agrees on (sort of) is to limit private companies access to citizen privacy data. Especially non-EU organisations. Which is very hard to enforce because most of the used platforms and even software isn’t European.

Re: The killer app of Gemini Pro 1.5 is using video as an input

#137
post #115

Earlier quoted context omitted.

That's why we would want it to run locally! Think about a fully personalized model that can work out some simple tasks / code while you're going out for groceries, or potentially more complex tasks while you're sleeping.

It's local to your employer 's computer.

Have it running on your personal comp, monitoring a screen-share from your work comp. (But that would probably breach your employment contract re saving work on personal machines.)

Re: The killer app of Gemini Pro 1.5 is using video as an input

#138

Ok, crazy tangent; Where agents will potentially become extremely useful/dystopian is when they just silently watch your entire screen at all times. Isolated, encrypted and local preferably. Imagine it just watching you coding for months, planning stuff, researching things, it could potentially give you personal and professional advice from deep knowledge about you. "I noticed you code this way, may i recommend this…

I have a friend building something like that at https://perfectmemory.ai

Re: The killer app of Gemini Pro 1.5 is using video as an input

#139

Earlier quoted context omitted.

War on drags? I thought that was just in Florida

please consider commenting more thoughtfully. I understand this is a joke but we don't want this site to devolve into Reddit.

[flagged]

Re: The killer app of Gemini Pro 1.5 is using video as an input

#140
> It looks like the safety filter may have taken offense to the word “Cocktail”! I opened up the safety settings, dialled them down to “low” for every category and tried again. It appeared to refuse a second time.

Google really is its own worst enemy. Their risk management people have completely taken over the organization to a point where somehow the smartest computers ever created are afraid of using dangerous words like "cocktail" or creating dangerous images of people like "Abraham Lincoln."

Post reply on HN