Live data from Hacker News

Computer use in Gemini 3.5 Flash

blog.google

51–60 of 175 posts

Re: Computer use in Gemini 3.5 Flash

#51
post #24

I wonder if it will be better at building TUI's. It has been absolutely abysmal at interacting with them and building them

Claude can build UI but it sucks at testing it and iterating on it. Fable showed some improvements in this regard but alas.

It seems to do it just fine when in desktop applications using Qt, fwiw., it leverages all the standard Qt GUI testing stuff (and if you have the money you can just integrate Squish which has LLM support now).

Re: Computer use in Gemini 3.5 Flash

#52

People using google’s models: am I holding it wrong or are the guardrails really overtuned? I had the dubious pleasure of testing gemini of late and I kept running into refusals. How do I transfer a sim number from one provider to another? No. What should I consider when making backups on ntfs less prone to data loss and more bitrot resistant? No. Evaluate this piece of code? No. I’m not sure if it’s cold feet from t…

Interesting. I have the Google AI Pro plan and use Gemini several times each day and I don't remember the last time I got a refusal. I wonder what criteria go into that, like maybe how they rate your Google account?

Re: Computer use in Gemini 3.5 Flash

#53

People using google’s models: am I holding it wrong or are the guardrails really overtuned? I had the dubious pleasure of testing gemini of late and I kept running into refusals. How do I transfer a sim number from one provider to another? No. What should I consider when making backups on ntfs less prone to data loss and more bitrot resistant? No. Evaluate this piece of code? No. I’m not sure if it’s cold feet from t…

Are you outside the US?

I'm outside the US, use Gemini models quite a bit, and I've never run into any refusals of any kind. I'm using them for a fairly wide range of things, I'm sure at least as risqué as asking how to transfer a sim. As a matter of fact I actually asked it's advice on how to transfer banking apps and auth apps from one phone about 3 weeks ago and got decent answers.

Re: Computer use in Gemini 3.5 Flash

#54

Where is 3.5 pro?

Google said June, and all its model updates seem to be on Tuesdays, Wednesdays or Thursdays. So unless the release is slipping, either tomorrow or Tuesday.

Rumor is now July, although preliminary A/B tests people are getting show promise with whatever they have right now.

Re: Computer use in Gemini 3.5 Flash

#55

Computer use is such a terrible idea. It's slow, insecure, error prone, expensive. I guess if you're trying to get people to tokenmaxx it may look like a valid strategy, but ain't no way this will be delightful to users. I think it's a symptom of just not understanding how LLMs should interface with the OS because we're still in their early days. Eventually there'll be an iPhone moment for the ergonomics of LLM usage…

Computer use is a great idea. It gets the job done when nothing else will. If you're a person trying to get their job done at a big company, but half your job is in 1-2 proprietary tools or is stuck behind an API you can't program against, computer use can allow you, a non-techie, to do your job more efficiently. I think it's an awesome way to circumvent gate keepers and the IT department to let people accomplish the…

I think there's a sweet spot- a lot of the time you're probably better off with "reverse engineer this web page and build me an API or personalized chrome extension to meet my needs".

I have an agent doing price checks for me for an item on a certain website. Instead of blasting through a zillion tokens processing the DOM over and over, it loaded the page once and figured out how to download a json with the price.

Re: Computer use in Gemini 3.5 Flash

#56
post #29
post #16

Earlier quoted context omitted.

> Computer use is such a terrible idea. It's slow, insecure, error prone, expensive. And yet having an agent able yo use a computer on your behalf is really useful. Recently I gave a Nix OS vm to my hermes agent and it has been a good experience. I don't really care if destroy the machine I can just rollback to an earlier version, and for any meaningful data he creates for me I make sure he creates a repo, commit and…

> And yet having an agent able yo use a computer on your behalf is really useful. I honestly cannot think of a single use case

I think the main advantage is adaptability.

Imagine you have a pretty exotic task you need to complete that involves converting a video file from one format to another.

You can use ChatGPT or something similar and the best you will get is either a script you can run on you machine that does what you need or he may decide to render a new video.

If you have something like OpenwebUI you could configure a MCP that converts videos and allow the model to use this MCP to do your task. This should work, but is quite a lot of work for something you'll ever do once.

But if the agent has it's own environment he can decide to install ffmpg, execute the transformation and serve you the file you want.

In reality there is no new capabilities with this approach, but things get a lot more comfortable.

Re: Computer use in Gemini 3.5 Flash

#57

Earlier quoted context omitted.

Are you outside the US?

I'm outside the US, use Gemini models quite a bit, and I've never run into any refusals of any kind. I'm using them for a fairly wide range of things, I'm sure at least as risqué as asking how to transfer a sim. As a matter of fact I actually asked it's advice on how to transfer banking apps and auth apps from one phone about 3 weeks ago and got decent answers.

It's more dependent on the specific country they are in (and I don't know the specifics). But Google is large enough to have lawyers for every country, and Google is in a never ending whirlwind of national lawsuits/fines, so you end up at the mercy of whatever the lawyers for your country think will not piss off regulators. The EU (and individual states) have pretty heavy AI regulations, and Google even just got fined for an AI overview being incorrect.

It also could just be which way the wind was blowing for OP, the models are stochastic to some degree, but there is no shortage of complaints from (mostly euro) users getting stonewalled.

Re: Computer use in Gemini 3.5 Flash

#58

Earlier quoted context omitted.

I'm outside the US, use Gemini models quite a bit, and I've never run into any refusals of any kind. I'm using them for a fairly wide range of things, I'm sure at least as risqué as asking how to transfer a sim. As a matter of fact I actually asked it's advice on how to transfer banking apps and auth apps from one phone about 3 weeks ago and got decent answers.

It's more dependent on the specific country they are in (and I don't know the specifics). But Google is large enough to have lawyers for every country, and Google is in a never ending whirlwind of national lawsuits/fines, so you end up at the mercy of whatever the lawyers for your country think will not piss off regulators. The EU (and individual states) have pretty heavy AI regulations, and Google even just got fine…

I've seen similar refusals on X from Claude from users in Germany when the LLM assumed the users are asking for something forbidden about certain topics.

Ultimately I think that in 10 years time, this is what's gonna kill paid consumer LLMs, and boost the usage of Chinese LLMs self hosted at home an your own hardware that people will torrent via VPNs, as they will also be banned because of "disinformation and misinformation".

So the end winners will be the hardware companies that will sell AI chips to consumers after the datacenter bubble pops. Unless of course the EU will ban the sale of AI chips that don't have some limitations baked in on which models you're allowed to run (the state approved ones). Interesting times ahead. I think in 10-20 years time we'll look back at present day LLMs the way we look back at the open internet of the 90's-00's.

Re: Computer use in Gemini 3.5 Flash

#59
post #56
post #29

Earlier quoted context omitted.

> And yet having an agent able yo use a computer on your behalf is really useful. I honestly cannot think of a single use case

I think the main advantage is adaptability. Imagine you have a pretty exotic task you need to complete that involves converting a video file from one format to another. You can use ChatGPT or something similar and the best you will get is either a script you can run on you machine that does what you need or he may decide to render a new video. If you have something like OpenwebUI you could configure a MCP that conver…

This doesn't require computer use, just a bash tool (and possibly fetch to get ffmpeg documentation)

Re: Computer use in Gemini 3.5 Flash

#60
Today I asked Gemini to extract a table from an PDF appendix and create C++ data table with its contents. After 15 or so iterations with corrections and new mistakes, it eventually gave up. I was floored when it said “I’m sorry, I cannot do this simple task, I’ve exceeded my error threshold and cannot do this task for you. My LLM prediction engine invents data instead of doing a simple data copy/reformat”.

Stunned to see that Gemini threw its digital arms in the air and gave up.

Post reply on HN