Live data from Hacker News

Gemini 2.5 Computer Use model

blog.google

101–110 of 339 posts

Re: Gemini 2.5 Computer Use model

#101
post #85

Earlier quoted context omitted.

FWIW those type of traffic cameras are in common use. https://www.milesight.com/company/blog/types-of-traffic-came...

If I read the web page, they don't actually use that as a solution to shortening a red - IMHO that has a very high safety bar compared to the more common uses. But I'd be happy to hear this is something that Just Works in the Real World with a reasonable false positive and false negative rate.

Yes they do, it's listed under Traffic Sensor Cameras.

Re: Gemini 2.5 Computer Use model

#102

doesn't seem like it makes sense to train AI around human user interfaces which aren't really efficient. It is like building a mechanical horse.

This is just like the comments suggesting we need sensors and signs specifically for self-driving cars for them to work. It'll never happen, so companies need to deal with the reality we have.

We can build tons of infrastructure for cars that didn't exist before but can't for other things anymore? Seems like society is just becoming lethargic.

Re: Gemini 2.5 Computer Use model

#103

Earlier quoted context omitted.

It does, because it's hard to infer where each element will end up in the render. So a checkbox may be set up in a shitty way such that the corresponding text label is not properly placed in the DOM, so it's hard to tell what the checkbox controls just based on the DOM tree. You have to take into account the styling and placement pixel stuff, ie render it properly and look at it. That's just one obvious example, but…

Spatial continuity has nothing to do w/ how neural networks interpret an array of numbers. In fact, there is nothing about the topology of the input that is any way relevant to what calculations are done by the network. You are imposing an anthropomorphic structure that does not exist anywhere in the algorithm & how it processes information. Here is an example to demonstrate my point: https://x.com/s_scardapane/statu…

It would have to implicitly render the HTML+CSS to know which two elements visually end up next to each other, if the markup is spaghetti and badly done.

Re: Gemini 2.5 Computer Use model

#104

Earlier quoted context omitted.

None of that matters to neural networks.

It does, because it's hard to infer where each element will end up in the render. So a checkbox may be set up in a shitty way such that the corresponding text label is not properly placed in the DOM, so it's hard to tell what the checkbox controls just based on the DOM tree. You have to take into account the styling and placement pixel stuff, ie render it properly and look at it. That's just one obvious example, but…

[deleted]

Re: Gemini 2.5 Computer Use model

#105

Earlier quoted context omitted.

It does, because it's hard to infer where each element will end up in the render. So a checkbox may be set up in a shitty way such that the corresponding text label is not properly placed in the DOM, so it's hard to tell what the checkbox controls just based on the DOM tree. You have to take into account the styling and placement pixel stuff, ie render it properly and look at it. That's just one obvious example, but…

Spatial continuity has nothing to do w/ how neural networks interpret an array of numbers. In fact, there is nothing about the topology of the input that is any way relevant to what calculations are done by the network. You are imposing an anthropomorphic structure that does not exist anywhere in the algorithm & how it processes information. Here is an example to demonstrate my point: https://x.com/s_scardapane/statu…

Why are you talking about image processing ? The guy you’re talking to isn’t

Re: Gemini 2.5 Computer Use model

#107

Earlier quoted context omitted.

Spatial continuity has nothing to do w/ how neural networks interpret an array of numbers. In fact, there is nothing about the topology of the input that is any way relevant to what calculations are done by the network. You are imposing an anthropomorphic structure that does not exist anywhere in the algorithm & how it processes information. Here is an example to demonstrate my point: https://x.com/s_scardapane/statu…

Why are you talking about image processing ? The guy you’re talking to isn’t

What do you suppose "render" means?

Re: Gemini 2.5 Computer Use model

#110

Earlier quoted context omitted.

Spatial continuity has nothing to do w/ how neural networks interpret an array of numbers. In fact, there is nothing about the topology of the input that is any way relevant to what calculations are done by the network. You are imposing an anthropomorphic structure that does not exist anywhere in the algorithm & how it processes information. Here is an example to demonstrate my point: https://x.com/s_scardapane/statu…

It would have to implicitly render the HTML+CSS to know which two elements visually end up next to each other, if the markup is spaghetti and badly done.

The linked post demonstrates arbitrary re-ordering of image patches. Spatial continuity is not relevant to neural networks.
Post reply on HN