Live data from Hacker News

The killer app of Gemini Pro 1.5 is using video as an input

simonwillison.net

501–507 of 507 posts

Re: The killer app of Gemini Pro 1.5 is using video as an input

#501

Earlier quoted context omitted.

The "thing being discussed" is the efficacy of privacy laws. They work well, and the fact that you haven't been put on trial for your 'crimes' yet is tacit evidence. In the real world, both corporations and governments are your enemy. You're mistakenly looking at it as a relativist comparison; the people influencing your life through advertising work with the people who put you in jail. They aggregate and sell data t…

But everything is relativist. There is and can't be any absolute privacy. We need to find the biggest gain we can have in privacy with minimal impact to economy. And making laws for online ads is the worst in terms of ROI. It impacts economy and millions of people could work because of ads and it offers very low benefit. > you haven't been put on trial for your 'crimes' yet I know someone who has been put to trial. >…

> And if we are entering illegal, anyways laws won't help with this.

Laws are the only thing that will help with this, notwithstanding a monopoly on violence.

Re: The killer app of Gemini Pro 1.5 is using video as an input

#502
post #89

Earlier quoted context omitted.

honest question: Why is it bad? I see that posted over and over. Right now I watch SF and LA feel like 3rd world countries. Nothing appears to be enforced. Traffic laws, car break-ins, car theft, garage break-ins, house break-ins. I'd personally choose a little less privacy if it meant less people were getting injured by drivers ignoring the traffic laws and, less people were having to shell out for all the costs ass…

Sadly, you should disabuse yourself of the notion that our government will only use these powers in our best interest by looking at COINTELPRO, manufactured evidence for invading Iraq, mass incarceration based on nonviolent crimes, surveilling and prosecuting rape victims who live in the wrong jurisdictions for seeking abortions, police treatment of people who speak out against them (they'll have access, too,) the re…

I didn't downvote you but if I was to guess. It's not clear what your idea is. A bad government will be bad, period. Surveillance or none. The solution is not therefore zero government.

I don't think people from 1984 would be shocked at all. In fact I think the further you go back, the more surveillance. Or at least in thinking about "small towns" where everyone watches everyone else and the police know everyone in the town, people accepted that everyone knew what you were up to.

As another person mentioned, people need be safe from crime. Crime has victims and those victims suffer. If your car is stolen you can't get to work and you have to replace the car. If a traffic violator crashes into you again, you can't get to work, and you have to replace your car, and you have to pay medical bills to recover, and you might be dead. Even the non-victims suffer indirectly from higher prices (to cover the crime) and higher insurance (to cover the crime).

There's a balance and right now, at least in SF and LA, it seems to have shifted to "unsafe". Some amount of surveillance seems like a possible solution. As a first step, I think I'd like people to be able to send in video of infractions and have them prosecuted.

Re: The killer app of Gemini Pro 1.5 is using video as an input

#503

The “cocktail” thing is real. A while back I tried to get DALLE to imagine characters from Moby Dick [1], but it completely refused. You’d think an AI company could come up with a better obscenity filter! [1] https://superb-owl.link/shapes-of-stories/#1513

I told Azure AI to summarize a chat thread and it gave me a paragraph. I said “use bullets” and got myself flagged for review. Good gracious could I please just use an unfiltered model? Or maybe one which isn’t so sensitive?

You sure can! NeuroEngine[1] hosts some nice free demos of what are basically the state of the art in unfiltered models, and if you need API access, OpenRouter[2] has dozens of unfiltered models to choose from.

[1] https://www.neuroengine.ai/

[2] https://openrouter.ai/

Re: The killer app of Gemini Pro 1.5 is using video as an input

#504
post #239

Earlier quoted context omitted.

I set up two years ago a cron to screenshot every minute. Just did the second phase of using ocrmac (vision kit cli on GitHub) that extracts text and dumps it in a SQLite with FTS5. It’s simplistic but does the job for now. I looked at reducing storage requirements by using image magik to only store the difference between images - some 5 min sequence are essentially the same screen - but let that one go.

Thanks for sharing. Curious, what main value adds have you gotten out of this data?

I’m loose with my memory and I’d often recall reading or looking at something and could never find it in safari history etc. with info spread across WhatsApp emails files web history is helped nudge me in the right direction here and there. Saved me once when i made an online purchase, never got an email confirmation as well.

Re: The killer app of Gemini Pro 1.5 is using video as an input

#505
post #393

> It looks like the safety filter may have taken offense to the word “Cocktail”! I'm definitely not a fan of these severely hamstrung by default models. Especially as it seems to be based on an extremely puritan ethical system.

Deeply agree with the sentiment. AIs are so throttled and crippled that it makes me sad every time gemini or chatgpt refuses to answer my questions. Also agree that it’s mostly policed by American companies who follow the American culture of “swearing is bad, nudity is horrible, some words shouldn’t even be said”

The limitations are massively frustrating. I asked Gemini to suggest prayers for my friends based on a search of my inbox (which includes social network notification emails). It refused outright.

Re: The killer app of Gemini Pro 1.5 is using video as an input

#506
post #502

Earlier quoted context omitted.

Sadly, you should disabuse yourself of the notion that our government will only use these powers in our best interest by looking at COINTELPRO, manufactured evidence for invading Iraq, mass incarceration based on nonviolent crimes, surveilling and prosecuting rape victims who live in the wrong jurisdictions for seeking abortions, police treatment of people who speak out against them (they'll have access, too,) the re…

I didn't downvote you but if I was to guess. It's not clear what your idea is. A bad government will be bad, period. Surveillance or none. The solution is not therefore zero government. I don't think people from 1984 would be shocked at all. In fact I think the further you go back, the more surveillance. Or at least in thinking about "small towns" where everyone watches everyone else and the police know everyone in t…

> A bad government will be bad, period.

That's a wildly black-and-white perspective on an insanely complex topic. What government action could you not pretend to justify using that logic? Do you think any government actually sees themselves as a "bad" government? Do you think they and their socially dominant classes don't justify their actions by pointing out the good parts and dismissing the bad parts and making patronizing statements about how even if individual people get screwed, it's justified because the system on a whole "works?" That they don't have perceived enemies that they consider the bad guys which they can juxtapose themselves with to pretend like they're the good guys? Do you think that all of this either 100% does or 100% doesn't apply to governments? That it 100% does not apply to ours?

> Or at least in thinking about "small towns" where everyone watches everyone else and the police know everyone in the town, people accepted that everyone knew what you were up to.

Small community awareness among people who actually know each other is completely different from mass cataloging of the general public's ostensibly legal actions with practically no limits on its use or stewardship. I really don't understand how anybody wouldn't think so. Extrapolating the boundaries you set for your small community of neighbors and family, even if there are police among them, to federal police, intelligence agencies, and military in an astonishingly powerful country of 330 million people is a mindbogglingly strange take.

> Crime has victims and those victims suffer. If your car is stolen you can't get to work and you have to replace the car. If a traffic violator crashes into you again, you can't get to work, and you have to replace your car, and you have to pay medical bills to recover, and you might be dead. Even the non-victims suffer indirectly from higher prices (to cover the crime) and higher insurance (to cover the crime).

Not only is that a straw man, it seems to be shaped like something else entirely.

> There's a balance and right now, at least in SF and LA, it seems to have shifted to "unsafe". Some amount of surveillance seems like a possible solution. As a first step, I think I'd like people to be able to send in video of infractions and have them prosecuted.

Look at historical crime rates. Sure, they might have crawled up since the pandemic, but that's barely broken the consistently downward stride we've had for a good 3 decades. Our crime rates are nowhere close to what we were in the early 90s. The only people that don't seem to realize that are Fox News pundits and Newsmax.

In summary, sure: lots of things are very simple if you ignore context, pertinent details, and opposing evidence.

Post reply on HN