Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Gemini 2.0: our new AI model for the agentic era

blog.google

Post reply on HN
Print view View original

271–280 of 512 posts

Re: Gemini 2.0: our new AI model for the agentic era

#271

Post by ipsum2 »

gbickford wrote: post #235
ipsum2 wrote: post #163

Tested out Gemini-2 Flash, I had such high hopes that a better base model would help. It still hallucinates like crazy compared to GPT-4o.

Small models don't "know" as much so they hallucinate more. They are better suited for generations that are based in a ground truth, like in a RAG setup. A better comparison might be Flash 2.0 vs 4o-mini. Even then, the models aren't meant to have vast world knowledge, so benchmarking them on that isn't a great indicator of how they would be used in real-world cases.

Yes, it's not an apples to apples comparison. My point is the position it's at on the lmarena leaderboard is misplaced due to the hallucination issues.

Re: Gemini 2.0: our new AI model for the agentic era

#272

Post by rrdharan »

tbarbugli wrote: post #221
crazygringo wrote: post #177

Earlier quoted context omitted.

> and Google has been famously bad at getting people aligned and driving in one direction. To be fair, it's not that they're bad at it -- it's that they generally have an explicit philosophy against it. It's a choice. Google management doesn't want to "pick winners". It prefers to let multiple products (like messaging apps, famously) compete and let the market decide. According to this way of thinking, you come out a…

Google is not winning on cloud, AWS is winning and MS gaining ground.

That was 2023; more recently Microsoft is losing ground to Google (in 2024).

Re: Gemini 2.0: our new AI model for the agentic era

#273

Post by stavros »

UltraSane wrote: post #262
pcwelder wrote: post #256

Earlier quoted context omitted.

Code execution is okay, but soon runs into the problem of missing packages that it can't install. Practically, sandboxing hasn't been super important for me. Running claude with mcp based shell access has been working fine for me, as long as you instruct it to use venv, temporary directory, etc.

Is there a guide on how to do that?

I wrote a program that can do more or less the same thing, if you only care about the LLM running commands to help you do something:

https://github.com/skorokithakis/sysaidmin

Re: Gemini 2.0: our new AI model for the agentic era

#274

Post by nuancebydefault »

I'm quite impressed with the flash demo's reasoning capabilities. Did the 20 questions game with it, it found the computer mouse i had in my head. At first it was confused about our roles and said something weird, it thought that it had to guess its own word. Afterwards I had a meta conversation about that weirdness and it gave impressive insights:

" Why My "I Guess What I Have in Mind" Statement Doesn't Make Sense

    The Problem of Agency: You're spot-on when you say it doesn't make sense for me to state "I guess what I (the computer) have in mind." AI does not have a "mind" in the same way that humans do. My internal state is a complex pattern of numerical data, not conscious thoughts or intentions in the way you have things in mind. My phrasing gave the illusion of having a "thing in mind," but in reality, I don't have this capacity.

    Misinterpretation of the Task: My statement "I guess what I have in mind" misinterprets the task. You were clearly signaling that I needed to ask questions to uncover what you were thinking of. My failure to grasp this created a weird scenario where it seemed like I was trying to determine my own data set!"

Re: Gemini 2.0: our new AI model for the agentic era

#275

Post by stavros »

fluoridation wrote: post #201
iamdelirium wrote: post #196

Earlier quoted context omitted.

Why did you specifically ignore the remainder of the sentence? "...all of our products — including all 7 of them with 2 billion users..." It tells people that 7 of their products have 2b users.

That's not really any better, since "all of our products" already includes the subset that has at least 2B users. "I brought all my shoes, including all my red shoes."

They're pointing out that seven of their products have more than 2 billion users.

"I brought all my shoes, including the pairs that cost over $10,000" is saying something about what shoes you brought, more than "all of them".

Re: Gemini 2.0: our new AI model for the agentic era

#276

Post by bravura »

simonw wrote: post #113

I released a new llm-gemini plugin with support for the Gemini 2.0 Flash model, here's how to use that in the terminal: llm install -U llm-gemini llm -m gemini-2.0-flash-exp 'prompt goes here' LLM installation: https://llm.datasette.io/en/stable/setup.html Worth noting that the Gemini models have the ability to write and then execute Python code. I tried that like this: llm -m gemini-2.0-flash-exp -o code_execution 1…

Question: Have you tried using this for video?

Alternately, if I wanted to pipe a bunch of screencaps into it and get one grand response, how would I do that?

e.g. "Does the user perform a thumbs up gesture in any of these stills?"

[edit: also, do you know the vision pricing? I couldn't find it easily]

Re: Gemini 2.0: our new AI model for the agentic era

#278

Post by TIPSIO »

rtsil wrote: post #215
bippihippi1 wrote: post #204

Earlier quoted context omitted.

why not just make a business / project account?

That won't help. Their TOS and policies are vague enough that they can terminate all accounts you own (under "Use of multiple accounts for abuse" for instance).

To be fair, I believe this is reserved for things like fighting fraud.

Re: Gemini 2.0: our new AI model for the agentic era

#279

Post by jvolkman »

tpoacher wrote: post #150

I know this isn't really a useful comment, but, I'm still sour about the name they chose. They MUST have known about the Gemini protocol. I'm tempted to think it was intentional, even. It's like Microsoft creating an AI tool and calling it Peertube. "Hurr durr they couldn't possibly be confused; one is a decentralised video platform and the other is an AI tool hurr durr. And ours is already more popular if you 'bing'…

> It's like Microsoft creating an AI tool and calling it Peertube.

How is it like that? Gemini is a much more common word than Peertube. https://en.wikipedia.org/wiki/Gemini

Re: Gemini 2.0: our new AI model for the agentic era

#280

Post by p1esk »

CamperBob2 wrote: post #251
p1esk wrote: post #13

Earlier quoted context omitted.

Are these benchmarks still meaningful?

I've started keeping an eye out for original brainteasers, just for that reason. GCHQ's Christmas puzzle just came out [1], and o1-pro got 6 out of 7 of them right. It took about 20 minutes in total. I wasn't going to bother trying those because I was pretty sure it wouldn't get any of them, but decided to give it an easy one (#4) and was impressed at the CoT. Meanwhile, Google's newest 2.0 Flash model went 0 for 7.…

Wow! That’s all I need to know about Google’s model.
Post reply on HN