Live data from Hacker News

The killer app of Gemini Pro 1.5 is using video as an input

simonwillison.net

191–200 of 507 posts

Re: The killer app of Gemini Pro 1.5 is using video as an input

#193
The “cocktail” thing is real. A while back I tried to get DALLE to imagine characters from Moby Dick [1], but it completely refused. You’d think an AI company could come up with a better obscenity filter!

[1] https://superb-owl.link/shapes-of-stories/#1513

Re: The killer app of Gemini Pro 1.5 is using video as an input

#194
post #35

Title should have input added to the end "The killer app of Gemini Pro 1.5 is video input" Seems like a good way to do video moderation (YouTube) at scale, if they can keep costs down...

Oh god the one thing we don’t need is more half assed moderation systems. Human mods are bad enough at it as it is. Mostly because they make these systems opaque on purpose. Sites like YouTube never have any proper timely recourse for when they get it wrong unless you’re a larger content creator. Or worse even is the complete lack of transparency on why something was removed. Plus the whole DMCA debacle.

The YouTube channels I follow are constantly starting videos complaining about false positive removals and long processes getting it resolved. Lots of people moving to Patreon because it’s destroying channels/communities and they have no other choice. Commenters get it even worse where it’s basically a giant black hole.

Re: The killer app of Gemini Pro 1.5 is using video as an input

#195
post #135

Earlier quoted context omitted.

Democratic governance is complicated. It’s never black and white and it’s perfectly possible for parts of the EU to be working to end encryption while another part works toward enhancing citizen privacy rights. Often they’re not even supported by the same politicians, but since it’s not a winners takes all sort of thing, it can all happen simultaneously and sometimes they can even come up with some “interesting” prop…

I am fine with private company using my data for showing me better ads. They can't affect my life significantly. I am not fine with government using the data to police me. Already in most countries, governments are putting people in jail because of things like hate speech where are the laws are really vague.

To me this sounds like an opinion that would be common in the US, mostly because of where the trust and fears seem to be (private companies versus government).

I think everybody (private companies, government, individuals) will try to influence and will affect your personal life. What I am worried about is who has the most efficient way to influence a lot the average person - because that entity can control on long term a lot more.

My impression is that in the European Union - due partially to a complex system - is harder for any particular actor to do much on its own (even the example with Denmark secret service asking NSA for data about citizens - I guess it is harder for them to do that rather than just get directly the data).

So what I am afraid is focused and efficient entities having the data, hence I am more afraid of private companies (which are focused and sometimes efficient) rather than governments.

Re: The killer app of Gemini Pro 1.5 is using video as an input

#196

Earlier quoted context omitted.

It's not that bad. With Perfect Memory AI I see ~9GB a month. That's 108 GB/year. HDD/SSDs are getting bigger than that every year. The storage also varies by what you do, your workflow and display resolution. Here's an article I wrote on my finding of storage requirements. https://www.perfectmemory.ai/support/storage-resources/stora... And if you want to use the data for LLM only, then you don't need to store the sc…

> That's 108 GB/year. HDD/SSDs are getting bigger than that every year. Cries in MacBook Pro

PerfectMemory is only available on Windows at the moment.

Re: The killer app of Gemini Pro 1.5 is using video as an input

#198
post #197

The killer app of ai is robots. Like, literally killer but also farmer, cleaner, builder etc

the boston dynamics dog was retrofitted with multimodal LLM a few months ago and its snarky as hell

https://youtu.be/djzOBZUFzTw?si=NL4eFyMTAe1FcNhC

timestamp: 5:05

Re: The killer app of Gemini Pro 1.5 is using video as an input

#199
post #145

Earlier quoted context omitted.

Unless its open sourced :)

In modern world open code often doesn't mean much. E.g. Chrome is opensourced. And yet no one really contributes to it or has any say over the direction its going: https://twitter.com/RickByers/status/1715568535731155100

A browser is an extreme case, one of the most difficult types of software and full of stupid minutia and legacy crap. Nobody want to volunteer for that.

Machine learning is fun and ultimately it doesn't require a lot of code. If people have the compute, open source maintainers will have the interest to exploit it due to the high coolness-to-work-required ratio.

Re: The killer app of Gemini Pro 1.5 is using video as an input

#200

Ok, crazy tangent; Where agents will potentially become extremely useful/dystopian is when they just silently watch your entire screen at all times. Isolated, encrypted and local preferably. Imagine it just watching you coding for months, planning stuff, researching things, it could potentially give you personal and professional advice from deep knowledge about you. "I noticed you code this way, may i recommend this…

Perhaps even more valuable is if AI can learn to take raw information and display it nicely. Maybe would could finally move beyond decades of crusty GUI toolkits and browser engines.
Post reply on HN