Gemini 2.5 Pro Preview

Post by energy123 » Tue, May 06, 2025, 3:59 PM UTC

uh_uh wrote: post #44

herpdyderp wrote: post #22

I agree it's very good but the UI is still usually an unusable, scroll-jacking disaster. I've found it's best to let a chat sit for around a few minutes after it has finished printing the AI's output. Finding the `ms-code-block` element in dev tools and logging `$0.textContext` is reliable too.

Noticed this too. There's something funny about billion dollar models being handicapped by stuck buttons.

Post by ChocolateGod » Tue, May 06, 2025, 4:00 PM UTC

segphault wrote: post #18

My frustration with using these models for programming in the past has largely been around their tendency to hallucinate APIs that simply don't exist. The Gemini 2.5 models, both pro and flash, seem significantly less susceptible to this than any other model I've tried. There are still significant limitations, no amount of prompting will get current models to approach abstraction and architecture the way a person doe…

Post by sitkack » Tue, May 06, 2025, 4:00 PM UTC

Trasmatta wrote: post #53

Maxatar wrote: post #34

Earlier quoted context omitted.

Tell it not to write so many comments then. You have a great deal of flexibility in dictating the coding style and can even include that style in your system prompt or upload a coding style document and have Gemini use it.

Every time I ask an LLM to not write comments, it still litters it with comments. Is Gemini better about that?

Post by mohsen1 » Tue, May 06, 2025, 4:00 PM UTC

        +------------------------------+---------+--------------+
        |         Benchmark            |   o3    | Gemini 2.5   |
        |                              |         |    Pro       |
        +------------------------------+---------+--------------+
        | ARC-AGI (High Compute)       |  87.5%  |     —        |
        | GPQA Diamond (Science)       |  87.7%  |   84.0%      |
        | AIME 2024 (Math)             |  96.7%  |   92.0%      |
        | SWE-bench Verified (Coding)  |  71.7%  |   63.8%      |
        | Codeforces Elo Rating        |  2727   |     —        |
        | MMMU (Visual Reasoning)      |  82.9%  |   81.7%      |
        | MathVista (Visual Math)      |  86.8%  |     —        |
        | Humanity’s Last Exam         |  26.6%  |   18.8%      |
        +------------------------------+---------+--------------+

Post by PaulHoule » Tue, May 06, 2025, 4:01 PM UTC

amarcheschi wrote: post #12

ramesh31 wrote: post #4

>Best-in-class frontend web development It really is wild to have seen this happen over the last year. The days of traditional "design-to-code" FE work are completely over. I haven't written a line of HTML/CSS in months. If you are still doing this stuff by hand, you need to adapt fast. In conjunction with an agentic coding IDE and a few MCP tools, weeks worth of UI work are now done in hours to a higher level of qua…

i'm surprised by no line of css html in months. maybe it's an exageration and that's okay. However, just today i was building a website for fun with gemini and had to manually fix some issues with css that he struggled with. as it often happens, trying to let it repair the damage only made it go into a pit of despair (for me). i fixed the issues in about a glance and 5 minutes. This is not to say it's bad, but someti…