Live data from Hacker News

Gemini 2.5 Computer Use model

blog.google

141–150 of 339 posts

Re: Gemini 2.5 Computer Use model

#141

Earlier quoted context omitted.

Ironically now that computer vision is commonplace, the cameras you talk about have become increasingly popular over the years because the magnetic systems do not do a very good job of detecting cyclists and the cameras double as a congestion monitoring tool for city staff.

and soon/now triple as surveillance.

[flagged]

Re: Gemini 2.5 Computer Use model

#142
post #30

It successfully got through the captcha at https://www.google.com/recaptcha/api2/demo

Post edited: I was wrong about this. Gemini tried to solve the Google CAPTCHA but it was actually Browserbase that did the solve, notes here: https://simonwillison.net/2025/Oct/7/gemini-25-computer-use-...

I was concerned there might be sensitive info leaked in the browserbase video at 0:58 as it shows a string of characters in the browser history:

    nricy.jd t.fxrape oruy,ap. majro
3 groups of 8 characters, space separated followed by 5 for a total of 32 characters. Seemed like text from a password generator or maybe an API key? Maybe accidentally pasted into the URL bar at one point and preserved in browser history?

I asked ChatGPT about it and it revealed

    Not a password or key — it’s a garbled search query typed with the wrong keyboard layout.
    
    If you map the text from Dvorak → QWERTY,
    nricy.jd t.fxrape oruy,ap. majro → “logitech keyboard software macos”.

Re: Gemini 2.5 Computer Use model

#144
post #71

Many years ago I was sitting at a red light on a secondary road, where the primary cross road was idle. It seemed like you could solve this using a computer vision camera system that watched the primary road and when it was idle, would expedite the secondary road's green light. This was long before computer vision was mature enough to do anything like that and I found out that instead, there are magnetic systems that…

Ironically now that computer vision is commonplace, the cameras you talk about have become increasingly popular over the years because the magnetic systems do not do a very good job of detecting cyclists and the cameras double as a congestion monitoring tool for city staff.

> the cameras you talk about have become increasingly popular over the years

cameras are being used to detect traffic and change lights? i don't think thats happening in USA.

which country are you referring to here?

Re: Gemini 2.5 Computer Use model

#146
post #126
post #98

Earlier quoted context omitted.

I cycle a lot. Outdoors I listen to podcasts and the fact that I can say "Hey Google, go back 30sec" to relisten to something (or forward to skip ads) is very valuable to me. Indoors I tend to cast some show or youtube video. Often enough I want to change the Youtube video or show using voice commands - I can do this for Youtube, but results are horrible unless I know exactly which video I want to watch. For other se…

Do you have a lot of dedicated cycle ways? I'm not sure I'd want to have headphones impeding my hearing anywhere I'd have to interact with cars or pedestrians while on my bike.

yes i bike on chicago lakefront up and down is like 40 miles for me.

also biking on roads you should never count on sounds to guide you. you should always use vision. for example, making a left you have to visually establish that driver coming straight has made eye contact with you or atleast looked at you.

can you share a example of how you are using sound to help you ride bikes with other vehicles on the road? are you maybe talking about honking? that. you will hear over podcasts.

Re: Gemini 2.5 Computer Use model

#147

Earlier quoted context omitted.

and soon/now triple as surveillance.

[flagged]

go watch any movie about a panopticon for the (overdiscussed) side-effects of a surveillance state.

Fiction works, but if you want to spend the evening depressed then go for any East/West Germany (true) stories.

For it or against surveillance and I can understand, but just not understanding the issue? No excuses -- personal surveillance for the sake of the state is one of the most discussed social concepts in the world.

Re: Gemini 2.5 Computer Use model

#148
I would love to use this for E2E testing. It would be great to make all my assertions with high level descriptions so tests are resilient to UI changes.

Seems similar to the Amazon Nova Act API which is still in research preview.

Re: Gemini 2.5 Computer Use model

#149

> It is not yet optimized for desktop OS-level control Alas, AGI is not yet here. But I feel like if this OS-level of control was good enough, and the cost of the LLM in the loop wasn't bad, maybe that would be enough to kick start something akin to AGI.

Funny thing is, most humans cannot properly control a computer. Intelligence seems to be impossible to define.

Is this a joke, or do you actually believe most people are incapable of using a computer?
Post reply on HN