Gemini 2.5 Pro Preview

Post by des429 » Sat, May 10, 2025, 1:21 AM UTC

NeutralForest wrote: post #125

koakuma-chan wrote: post #55

Earlier quoted context omitted.

No, it's just bad. I've been writing a lot of Python code past two days with Gemini 2.5 Pro Preview, and all of its code was like: ```python def whatever(): --- SECTION ONE OF THE CODE --- ... --- SECTION TWO OF THE CODE --- try: [some "dangerous" code] except Exception as e: logging.error(f"Failed to save files to {output_path}: {e}") # Decide whether to raise the error or just warn # raise IOError(f"Failed to save…

I'm seeing it trying to catch blind exceptions in Python all the time. I see it in my colleagues code all the time, it's driving me nuts.

Post by astrange » Sat, May 10, 2025, 10:35 PM UTC

whartung wrote: post #446

astrange wrote: post #437

Earlier quoted context omitted.

> * "my coworkers will just ruin it" This turns out to be a big issue. I read everything about software design I could get my hands on in years, but then at an actual large company it turned out to not help, because I'd never read anything about how to get others to follow the advice in my head from all that reading.

Indeed. The LLMs will ruin it. They still very much struggle to grasp a code set of any reasonable size. Asking one to make changes to such a code set, and you will get whatever branch the dice told the tree to go down that day. To paraphrase, “LLMs are like a box of chocolates…”. And if you have the patience to try and tack the AI to get back on track, you probably could have just done the work faster yourself.

Post by Quiark » Tue, May 13, 2025, 2:36 AM UTC

disgruntledphd2 wrote: post #306

toomuchtodo wrote: post #300

Earlier quoted context omitted.

It seems like the fix is straightforward (check the output against a machine readable spec before providing it to the user), but perhaps I am a rube. This is no different than me clicking through a search result to the underlying page to verify the veracity of the search result surfaced.

Why coding agents et al don't make use of the AST through LSP is a question I've been asking myself since the first release of GitHub copilot. I assume that it's trickier than it seems as it hasn't happened yet.

Post by ditti » Fri, May 16, 2025, 2:24 PM UTC

cma wrote: post #496

danpalmer wrote: post #492

Earlier quoted context omitted.

From the linked tweet the author seems to be using Gemini through another layer called OpenRouter - it seems quite possible that the issue around lack of clarity of billing/caching could be from that extra layer of indirection.

OpenRouter lets you fund a wallet and spend no more than that. Google will let it go out of control and they purposely delay the billing console by up to 24 hours so if you don't track it all yourself you can get hit big, especially if it is a coding error that uses up to the rate limits.