"So Google’s new Gemini chatbot is racist as fuck." https://twitter.com/JoshWalkos/status/1760423141942178037
Cartman's dream came true.
https://m.youtube.com/watch?v=Ar4aHfA2UwQ
The killer app of Gemini Pro 1.5 is using video as an input
231–240 of 507 posts
Re: The killer app of Gemini Pro 1.5 is using video as an input
#232Ok, crazy tangent; Where agents will potentially become extremely useful/dystopian is when they just silently watch your entire screen at all times. Isolated, encrypted and local preferably. Imagine it just watching you coding for months, planning stuff, researching things, it could potentially give you personal and professional advice from deep knowledge about you. "I noticed you code this way, may i recommend this…
Amplified Intelligence - I am keenly interested in the future of small-data machine learning as a potential multiplier for the creative mind
Re: The killer app of Gemini Pro 1.5 is using video as an input
#233Ok, crazy tangent; Where agents will potentially become extremely useful/dystopian is when they just silently watch your entire screen at all times. Isolated, encrypted and local preferably. Imagine it just watching you coding for months, planning stuff, researching things, it could potentially give you personal and professional advice from deep knowledge about you. "I noticed you code this way, may i recommend this…
We are building this at https://openadapt.ai, except the user specifies when to record.
Re: The killer app of Gemini Pro 1.5 is using video as an input
#234Earlier quoted context omitted.
It's local to your employer 's computer.
Have it running on your personal comp, monitoring a screen-share from your work comp. (But that would probably breach your employment contract re saving work on personal machines.)
You could point your local computer's webcam at the work computer.
It probably breaks the spirit of the employment contract just as hard, but it's essentially undetectable for the work computer.
Re: The killer app of Gemini Pro 1.5 is using video as an input
#235Earlier quoted context omitted.
>Isolated, encrypted and local of course. And what is the likelihood of that "of course" portion actually happening? What is the business model that makes that route more profitable compared to the current model all the leaders in this tech are using in which they control everything?
Given that http://rewind.ai is doing just that, the odds are pretty good!
No they aren't. Rewind uses ChatGPT so data is sent off your local device[1].
I understand the actual screen recordings don't leave your machine, but that just creates a catch-22 of what does. Either the text based summaries of those recordings are thorough enough to still be worthy of privacy or the actual answers you get won't actually include many details from those recordings.
[1] - https://help.rewind.ai/en/articles/7791703-ask-rewind-s-priv...
Re: The killer app of Gemini Pro 1.5 is using video as an input
#236Earlier quoted context omitted.
IKR, Who wouldn't want another Clippy constantly nagging you, but this time with a higher IQ and more intimate knowledge of you? /s
Clippy, definition: bot created by mega corp. Clippy + high IQ: red flag, right here Clippy + high IQ + intimate knowledge of you: do you seriously want that? Why?
Life's never gotten to you that you've just wanted a bit of help sometime?
Re: The killer app of Gemini Pro 1.5 is using video as an input
#237Re: The killer app of Gemini Pro 1.5 is using video as an input
#238Ok, crazy tangent; Where agents will potentially become extremely useful/dystopian is when they just silently watch your entire screen at all times. Isolated, encrypted and local preferably. Imagine it just watching you coding for months, planning stuff, researching things, it could potentially give you personal and professional advice from deep knowledge about you. "I noticed you code this way, may i recommend this…
> Imagine it just watching you coding for months, planning stuff, researching things, it could potentially give you personal and professional advice from deep knowledge about you. And then announcing "I can do your job now. You're fired."
Jokes on it, already unemployed
Re: The killer app of Gemini Pro 1.5 is using video as an input
#239Earlier quoted context omitted.
I'm working on this! https://www.perfectmemory.ai/ It's encrypted (on top of Bitlocker) and local. There's all this competition who makes the best, most articulate LLM. But the truth is that off-the-shelf 7B models can put sentences together with no problem. It's the context they're missing.
I feel like the storage requirements are really going to be these issue for these apps/services that run on "take screenshots and OCR them" functionality with LLMs. If you're using something like this a huge part of the value proposition is in the long term, but until something has a more efficient way to function, even a 1-year history is impractical for a lot of people. For example, consider the classic situation o…
I set up two years ago a cron to screenshot every minute.
Just did the second phase of using ocrmac (vision kit cli on GitHub) that extracts text and dumps it in a SQLite with FTS5.
It’s simplistic but does the job for now.
I looked at reducing storage requirements by using image magik to only store the difference between images - some 5 min sequence are essentially the same screen - but let that one go.
Re: The killer app of Gemini Pro 1.5 is using video as an input
#240Earlier quoted context omitted.
> Imagine it just watching you coding for months, planning stuff, researching things, it could potentially give you personal and professional advice from deep knowledge about you. And then announcing "I can do your job now. You're fired."
That sounds a lot like Learning To Be Me, by Greg Egan. Just not quite as advanced, or inside your head.
For anyone unfamiliar with this story:
https://philosophy.williams.edu/files/Egan-Learning-to-Be-Me...