Live data from Hacker News

Gemini 2.5 Computer Use model

blog.google

211–220 of 339 posts

Re: Gemini 2.5 Computer Use model

#211
post #66

Hey - I'm on the team that launched this. Please let me know if you have any questions!

How are you going to deal with reCAPTCHA and ad impressions? Sounds like a conflict of interest.

No easy answers on this one unfortunately, lots of conversations ongoing on these - but our default stance has been to hand back control to the user in cases of captcha and have them solve these when they arise.

Re: Gemini 2.5 Computer Use model

#213

Not great at Google Sheets. Repeatedly overwrites all previous columns while trying to populate new columns. > I am back in the Google Sheet. I previously typed "Zip Code" in F1, but it looks like I selected cell A1 and typed "A". I need to correct that first. I'll re-type "Zip Code" in F1 and clear A1. It seems I clicked A1 (y=219, x=72) then F1 (y=219, x=469) and typed "Zip Code", but then maybe clicked A1 again.

Could you share your prompt? We'll look into this one

Re: Gemini 2.5 Computer Use model

#214

Earlier quoted context omitted.

[flagged]

I have nothing to hide Great! Then you don't mind telling us your email password!

Presumably not. Whether he has any acts to keep secret is not relevant to whether he'd like to have any money left in his bank account tomorrow.

Re: Gemini 2.5 Computer Use model

#215
I believe it will need very capable but small VLMs that understand common User Interfaces very well -- small enough to run locally -- paired with any other higher level models on the cloud, to achieve human-speed interactions and beyond with reliability.

Re: Gemini 2.5 Computer Use model

#216
post #126

Earlier quoted context omitted.

Do you have a lot of dedicated cycle ways? I'm not sure I'd want to have headphones impeding my hearing anywhere I'd have to interact with cars or pedestrians while on my bike.

yes i bike on chicago lakefront up and down is like 40 miles for me. also biking on roads you should never count on sounds to guide you. you should always use vision. for example, making a left you have to visually establish that driver coming straight has made eye contact with you or atleast looked at you. can you share a example of how you are using sound to help you ride bikes with other vehicles on the road? are…

Hearing is useful for safety.

Re: Gemini 2.5 Computer Use model

#217
post #71

Many years ago I was sitting at a red light on a secondary road, where the primary cross road was idle. It seemed like you could solve this using a computer vision camera system that watched the primary road and when it was idle, would expedite the secondary road's green light. This was long before computer vision was mature enough to do anything like that and I found out that instead, there are magnetic systems that…

It’s funny that you used traffic signals as an example of overcomplicating a problem with AI because there turns out to be a YC funded startup making AI powered traffic lights: https://www.ycombinator.com/companies/roundabout-technologie...

Re: Gemini 2.5 Computer Use model

#218

Earlier quoted context omitted.

Computer use is the most important AI benchmark to watch if you're trying to forecast labor-market impact. You're right, there are much more effective ways for ML/AI systems to accomplish tasks on the computer. But they all have to be hand-crafted for each task. Solving the general case is more scalable.

Not the current benchmarks, no. The demos in this post are so slow. Between writing the prompt, waiting a long time and checking the work I’d just rather do it myself.

It's not about being faster than you.

It's about working independently while you do other things.

Re: Gemini 2.5 Computer Use model

#219

Earlier quoted context omitted.

and soon/now triple as surveillance.

Those cameras aren’t usually easily or cheaply adapted to surveillance. Most are really simple and don’t have things like reliable time sync. Also, road jurisdictions are really complex and surveillance requires too much coordination. State, county, town, city all have different bureaucratic processes and funding models. Surveillance is all about Flock. The feds are handing out grants to everyone, and the police drop…

With all due respect, you are kidding yourself if you think those cameras aren’t used for surveillance/ logging

They don’t have to be “adapted” to surveillance - they are made with that in mind

Obviously older generations of equipment aren’t included here - so technically you may be correct for old/outdated equipment installed areas that aren’t of interest

Re: Gemini 2.5 Computer Use model

#220

Earlier quoted context omitted.

Ironically now that computer vision is commonplace, the cameras you talk about have become increasingly popular over the years because the magnetic systems do not do a very good job of detecting cyclists and the cameras double as a congestion monitoring tool for city staff.

> the cameras you talk about have become increasingly popular over the years cameras are being used to detect traffic and change lights? i don't think thats happening in USA. which country are you referring to here?

It's been happening in the USA for quite a long time.

Anecdotally, the small city I grew up in, in Ohio (USA), started using cameras and some kind of computer vision to operate traffic signals 15 or 20 years ago, replacing inductive loops.

I used to hang out sometimes with one of the old-timers who dealt with it as part of his long-time street department job. I asked him about that system once (over a decade ago now) over some drinks.

"It doesn't fuckin' work," I remember him flatly telling me before he quite visibly wanted to talk about anything other than his day job.

The situation eventually improved -- presumably, as bandwidth and/or local processing capabilities have also improved. It does pretty well these days when I drive through there, and the once-common inductive loops (with their tell-tale saw kerfs in the asphalt) seem to have disappeared completely.

(And as a point of disambiguation: They are just for controlling traffic lights. There have never been any speed or red light cameras in that city. And they're distinctly separate from traffic preemption devices, like the Opticom system that this city has used for an even longer time.)

---

As a non-anecdotal point of reference, I'd like to present an article from ~20 years ago about a system in a different city in the US that was serving a similar function at that time:

https://www.toacorn.com/articles/traffic-cameras-are-not-spy...

Post reply on HN