Gemini 2.5 Pro Preview • Hacker News Board

Re: Gemini 2.5 Pro Preview

#141

Post by sitkack » Tue, May 06, 2025, 4:45 PM UTC

FireBeyond wrote: post #124

diggan wrote: post #118

Earlier quoted context omitted.

Ok, so saying "Implement feature X" leads to a ton of comments. How do you rewrite that comment to not include "don't write comments" while making the output not containing comments? "Write only source code, no plain text with special characters in the beginning of the line" or what are you suggesting here in practical terms?

"Implement feature X, and as you do, insert only minimal and absolutely necessary comments that explain why something is being done, not what is being done."

You would say "omit the how". That word has negation built in.

Re: Gemini 2.5 Pro Preview

#142

Post by shawabawa3 » Tue, May 06, 2025, 4:45 PM UTC

brandall10 wrote: post #68

koakuma-chan wrote: post #55

Earlier quoted context omitted.

No, it's just bad. I've been writing a lot of Python code past two days with Gemini 2.5 Pro Preview, and all of its code was like: ```python def whatever(): --- SECTION ONE OF THE CODE --- ... --- SECTION TWO OF THE CODE --- try: [some "dangerous" code] except Exception as e: logging.error(f"Failed to save files to {output_path}: {e}") # Decide whether to raise the error or just warn # raise IOError(f"Failed to save…

It's certainly annoying, but you can try following up with "can you please remove superfluous comments? In particular, if a comment doesn't add anything to the understanding of the code, it doesn't deserve to be there".

You don't need a follow up

Just end your prompt with "no code comments"

Re: Gemini 2.5 Pro Preview

#143

Post by merksittich » Tue, May 06, 2025, 4:45 PM UTC

andy12_ wrote: post #74

Interestingly, when compering benchmarks of Experimental 03-25 [1] and Experimental 05-06 [2] it seems the new version scores slightly lower in everything except on LiveCodeBench. [1] https://storage.googleapis.com/model-cards/documents/gemini-... [2] https://deepmind.google/technologies/gemini/

According to the article, "[t]he previous iteration (03-25) now points to the most recent version (05-06)." I assume this applies to both the free tier gemini-2.5-pro-exp-03-25 in the API (which will be used for training) and the paid tier gemini-2.5-pro-preview-03-25.

Fair enough, one could say, as these were all labeled as preview or experimental. Still, considering that the new model is slightly worse across the board in benchmarks (except for LiveCodeBench), it would have been nice to have the option to stick with the older version. Not everyone is using these models for coding.

Re: Gemini 2.5 Pro Preview

#144

Post by elliot07 » Tue, May 06, 2025, 4:46 PM UTC

oellegaard wrote: post #47

Is there anything like Claude code for other models such as gemini?

OpenAi has a version called Codex that has support. It's lacking in a few features like MCP right now and the TUI isn't there yet, but interestingly they are building a Rust version (it's all open source) that seems to include MCP support and looks significantly higher quality. I'd bet within the next few weeks there will be a high quality claude code alternative.

Re: Gemini 2.5 Pro Preview

#145

Post by mickeyp » Tue, May 06, 2025, 4:46 PM UTC

revicon wrote: post #84

oellegaard wrote: post #73

Earlier quoted context omitted.

I'm actually very happy with everything in Claude code, eg the CLI so im really just curious to try other models

Same! I prefer the CLI, way easier when I’m connected via ssh from another network somewhere.

The CLI definitely has its advantages!

But with my app: you can install the host anywhere and connect to it securely (via SSH forwarding or private VPN or what have you) so that workflow definitely still works!

Re: Gemini 2.5 Pro Preview

#146

Post by asadm » Tue, May 06, 2025, 4:47 PM UTC

ranyume wrote: post #11

I don't know if I'm doing something wrong, but every time I ask gemini 2.5 for code it outputs SO MANY comments. An exaggerated amount of comments. Sections comments, step comments, block comments, inline comments, all the gang.

you need to do a 2nd step as a post-process to erase the comments.

Models use comments to think, asking to remove will affect code quality.

Re: Gemini 2.5 Pro Preview

#147

Post by merksittich » Tue, May 06, 2025, 4:48 PM UTC

ranyume wrote: post #11

I don't know if I'm doing something wrong, but every time I ask gemini 2.5 for code it outputs SO MANY comments. An exaggerated amount of comments. Sections comments, step comments, block comments, inline comments, all the gang.

My favourites are comments such as: from openai import DefaultHttpxClient # Import the httpx client

Re: Gemini 2.5 Pro Preview

#148

Post by shawabawa3 » Tue, May 06, 2025, 4:48 PM UTC

ziml77 wrote: post #49

ChadMoran wrote: post #24

Earlier quoted context omitted.

I've tried this, aggressively and it still does it for me. I gave up.

I tried this as well. I'm interfacing with Gemini 2.5 using Cursor and I have rules to to limit the comments. It still ends up over-commenting.

I have a feeling this may be a cursor issue, perhaps cursors system prompt asks for comments? Asking in the aistudio UI for code and ending the prompt with "no code comments" has always worked for me

Re: Gemini 2.5 Pro Preview

#149

Post by pzo » Tue, May 06, 2025, 4:50 PM UTC

martinald wrote: post #43

I'm totally lost again! If I use Gemini on the website (gemini.google.com), am I using 2.5 Pro IO edition, or am I using the old one?

"The previous iteration (03-25) now points to the most recent version (05-06), so no action is required to use the improved model"

Re: Gemini 2.5 Pro Preview

#150

Post by [deleted] » Tue, May 06, 2025, 4:50 PM UTC

koakuma-chan wrote: post #55

Benjammer wrote: post #25

Earlier quoted context omitted.

I've found that heavily commented code can be better for the LLM to read later, so it pulls in explanatory comments into context at the same time as reading code, similar to pulling in @docs, so maybe it's doing that on purpose?

No, it's just bad. I've been writing a lot of Python code past two days with Gemini 2.5 Pro Preview, and all of its code was like: ```python def whatever(): --- SECTION ONE OF THE CODE --- ... --- SECTION TWO OF THE CODE --- try: [some "dangerous" code] except Exception as e: logging.error(f"Failed to save files to {output_path}: {e}") # Decide whether to raise the error or just warn # raise IOError(f"Failed to save…

[deleted]