Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Gemini 2.5 Computer Use model

blog.google

Post reply on HN
Print view View original

161–170 of 339 posts

Re: Gemini 2.5 Computer Use model

#161

Post by omneity »

atonse wrote: post #134
omneity wrote: post #111

Earlier quoted context omitted.

This is basically our approach with Herd[0]. We operate agents that develop, test and heal trails[1, 2], which are packaged browser automations that do not require browser use LLMs to run and therefore are much cheaper and reliable. Trail automations are then abstracted as a REST API and MCP[3] which can be used either as simple functions called from your code, or by your own agent, or any combination of such. You ca…

Whoa that’s cool. I’ll check it out, thanks!

Thanks! Let me know if you give it a shot and I’ll be happy to help you with anything.

Re: Gemini 2.5 Computer Use model

#162

Post by dekhn »

ncallaway wrote: post #130
dekhn wrote: post #89

I just have to say that I consider this an absolutely hilarious outcome. For many years, I focused on tech solutions that eliminated the need for a human to be in front of a computer doing tedious manual operations. For a wide range of activities, I proposed we focus on "turning everything in the world into database objects" so that computers could operate on them with minimal human effort. I spent significant effort…

> we could have computer systems that can open chrome, start a video chat with somebody, go back and forth for a while to achieve a task, then hang up... with the person on the other end ever knowing they were dealing with a computer instead of a human. Doesn't that...seem bad? I mean, it would certainly be a monumental and impressive technical accomplishment. But it still seems...quite bad to me.

Good or bad? I don't know. It just seems inevitable.

Re: Gemini 2.5 Computer Use model

#163

Post by astrange »

peddling-brink wrote: post #16
dude250711 wrote: post #12

Have average Google developers been told/hinted that their bonuses/promotions will be tied to their proactivity in using Gemini for project work?

> bonuses/promotions more like continued employment.

FAANG much prefers to not pay you and let you leave on your own.

Re: Gemini 2.5 Computer Use model

#165

Post by fn-mote »

Macha wrote: post #151
apwell23 wrote: post #146

Earlier quoted context omitted.

yes i bike on chicago lakefront up and down is like 40 miles for me. also biking on roads you should never count on sounds to guide you. you should always use vision. for example, making a left you have to visually establish that driver coming straight has made eye contact with you or atleast looked at you. can you share a example of how you are using sound to help you ride bikes with other vehicles on the road? are…

The sound of a revving engine is often the first warning you have that someone is about to pass you and especially how they handle it is a good sign of how likely they are to attempt a close pass rather than overtake in the legal manner with the minimum distance.

Mirrors let you see the overtaking traffic with far more time to plan.

Audio cues are less and less useful as electric vehicles become more popular. (I am a city biker and there are plenty already.)

Re: Gemini 2.5 Computer Use model

#166

Post by NothingAboutAny »

dekhn wrote: post #89

I just have to say that I consider this an absolutely hilarious outcome. For many years, I focused on tech solutions that eliminated the need for a human to be in front of a computer doing tedious manual operations. For a wide range of activities, I proposed we focus on "turning everything in the world into database objects" so that computers could operate on them with minimal human effort. I spent significant effort…

I saw similar discussions around robotics, people saying "why are they making the robots humanoid? couldn't they be a more efficient shape" and it comes back to the same thing where if you want the tool to be adopted then it has to fit in a human-centric world no matter how inefficient that is. high performance applications are still always custom designed and streamlined, but mass adoption requires it to fit us not us to fit it.

Re: Gemini 2.5 Computer Use model

#167

Post by rs186 »

typpilol wrote: post #158
odie5533 wrote: post #31

Earlier quoted context omitted.

Not OP, but in my experience, Jest and Playwright are so much faster that it's not worth doing much with the MCP. It's a neat toy, but it's just too slow for an LLM to try to control a browser using MCP calls.

You can use it for debugging with the llm though.

In theory or in practice?

Re: Gemini 2.5 Computer Use model

#168

Post by Havoc »

mohsen1 wrote: post #124

> Solve today's Wordle Stucks with: > ...the task is just to "solve today's Wordle", and as a web browsing robot, I cannot actually see the colors of the letters after a guess to make subsequent guesses. I can enter a word, but I cannot interpret the feedback (green, yellow, gray letters) to solve the puzzle.

So I guess it’s browsing in grey scale?
Post reply on HN