Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Gemini 3.0 spotted in the wild through A/B testing

ricklamers.io

Post reply on HN
Print view View original

211–220 of 280 posts

Re: Gemini 3.0 spotted in the wild through A/B testing

#211

Post by thaumasiotes »

kridsdale3 wrote: post #62
dmd wrote: post #15

Earlier quoted context omitted.

I find Claude and Gemini to be wildly inferior to ChatGPT when it comes to doing searches to establish grounding. Gemini seems to do a handful of searches and then make shit up, where ChatGPT will do dozens or even hundreds of searches - and do searches based on what it finds in earlier ones.

Try "AI Mode" on Google.com (Disclaimer, I recently joined the team that makes this product). It isn't Gemini (the product, those are different orgs) though there may (deliberately left ambiguous) be overlap in LLM level bytes. My recommendation for you in this use-case comes from the fact that AI Mode is a product that is built to be a good search engine first, presented to you in the interface of an AI Chatbot. Rat…

OK, I tried it.

---

[me] dark legacy comics who wants some bamboo

[AI Mode] In Dark Legacy Comics, the phrase "who wants some bamboo?" is a catchphrase of sorts used by the panda character Keydar. It is often used before the panda charges into a fight or expresses a desire to participate in some aggressive action. In the context of the comics, it is a humorous and slightly absurd representation of his aggressive streak.

The character of Keydar is known for his sometimes-contradictory actions; he is a panda (typically associated with peacefulness) but displays a more chaotic and aggressive side, and the "bamboo" catchphrase highlights this comedic contrast.

---

Out of this response, the following information is accurate:

1. There is a character in Dark Legacy Comics whose name is "Keydar".

2. Nothing else.

Keydar does appear in the strip containing that phrase ( https://darklegacycomics.com/335 ), but he's the one who isn't a panda.

I'm intrigued that it's possible to run this search repeatedly on Google and get "AI Overview" responses that are all wildly different from each other. A new overview every time! They do not ever get anything right. The closest I've seen an overview come is one that said "there is no strip featuring that phrase", which still isn't true.

In fact, here's one (to the extent that they're different things, this is "AI Overview", not "AI Mode") that I just Googled up:

---

The line "who wants some bamboo" is from Dark Legacy Comics #338: "Mists of... something". The comic was a satirical commentary on the announcement of the World of Warcraft: Mists of Pandaria expansion.

In the comic, the main characters express their surprise and confusion over the new expansion's focus on pandaren (a humanoid panda race). One of them, after hearing the news, sarcastically holds up a piece of bamboo and says, "Who wants some bamboo?" to his guildmates, who look on with expressions of deep disappointment. The comic satirized the player base's initial skepticism about the expansion's direction.

---

Verification...

1. The line is from strip #338: false

2. Strip #338 is titled "Mists of... something": false

3. Strip #338 is a commentary on the announcement of Mists of Pandaria: false [It appears to be a commentary on a change implemented in Warlords of Draenor, except it was published far too early for that. I guess it's a commentary on the stag form, which is technically an MoP change.]

4. Synopsis: entirely made up

Re: Gemini 3.0 spotted in the wild through A/B testing

#212

Post by krisgenre »

jmkni wrote: post #3

I might be in the minority here but I've consistently found Gemini to be better than ChatGPT, Claude and Deepseek (I get access to all of the pro models through work) Maybe it's just the kind of work I'm doing, a lot of web development with html/scss, and Google has crawled the internet so they have more data to work with. I reckon different models are better at different kinds of work, but Gemini is pretty excellent…

So far, I have had a very good experience using Gemini Live with the camera turned on. Just today, I wanted to find out the name of a spare part inside a bathroom faucet. First, Gemini said it was a thermostatic cartridge, but I responded that it couldn't be, as it doesn't control temperature. Then it asked me what it did, and I said it has a button that controls the flow of water between the tap and shower. It correctly guessed that it was a diverter cartridge.

Re: Gemini 3.0 spotted in the wild through A/B testing

#213

Post by Lucasoato »

elcomet wrote: post #208

I don't understand all the hype for generating SVG with LLM. The task is not really useful, doesn't seem that interesting in single shot as it's really hard, and no human could do it (it would be more useful if the model has visual feedback and could correct the result). And also, since it becomes a popular task, companies will add the examples in their training set, so you're just benchmarking who has the better tex…

One of my co-founders lost the SVG of our startup logo, and the designer who helped us was away on vacation. I really wanted to experiment with some logo animations for an upcoming demo, so I decided to take matters into my own hands.

I grabbed a high-quality PNG, gave it to ChatGPT, and managed to recreate the SVG from the image, after quite a bit of prompting and tweaking. But it worked out great!

Re: Gemini 3.0 spotted in the wild through A/B testing

#214

Post by mac-monet »

jmkni wrote: post #3

I might be in the minority here but I've consistently found Gemini to be better than ChatGPT, Claude and Deepseek (I get access to all of the pro models through work) Maybe it's just the kind of work I'm doing, a lot of web development with html/scss, and Google has crawled the internet so they have more data to work with. I reckon different models are better at different kinds of work, but Gemini is pretty excellent…

Gemini is the only plan I have not replaced. Claude and ChatGPT I will switch to depending on the ability of the coding agent, but Gemini is still my favorite for general information and especially for writing assistance.

Re: Gemini 3.0 spotted in the wild through A/B testing

#216

Post by jacquesm »

simonw wrote: post #120
jacquesm wrote: post #106

Earlier quoted context omitted.

That's good? Looks like complete crap to me.

Here's my collection from the past year. It's definitely better than any of these! https://simonwillison.net/tags/pelican-riding-a-bicycle/

Ok, so we're in the dancing pig stage now. We appreciate that the pig can dance, not how well it dances.

Re: Gemini 3.0 spotted in the wild through A/B testing

#217

Post by aabhay »

jstanley wrote: post #153
jacquesm wrote: post #106

Earlier quoted context omitted.

That's good? Looks like complete crap to me.

I was confused too at first. This is an SVG generated by an LLM - it's not from an image model. How well do you reckon you could draw a pelican on a bicycle by typing out an SVG file blind?

I mean how well do you reckon you can denoise a jpg by hand until its a piece of art? That way of thinking isn’t helpful to understanding AI IMO

Re: Gemini 3.0 spotted in the wild through A/B testing

#218

Post by fauigerzigerk »

speedgoose wrote: post #198
nextworddev wrote: post #137

My friends at Google hate AI coding with passion. I have some theories as to why. But anyone here venture a guess?

Conservatisme, resistance to change, fear of losing the skills and becoming irrelevant.

Possibly, but I think something else could be happening at large companies that are fearful of missing a sea change.

Managers will be wary of exactly the sort of motivations for resistance that you mentioned. So they will try to counteract that by putting in place quantitative metrics to incentivise or even force AI use where it doesn't necessarily make sense.

This could cause resentment and fear irrespective of the real benefits that AI undboutedly brings.

This is complete speculation on my part where Google specifically is concerned. It's just something I think will inevitably happen at some companies.

Re: Gemini 3.0 spotted in the wild through A/B testing

#219

Post by hennell »

elcomet wrote: post #208

I don't understand all the hype for generating SVG with LLM. The task is not really useful, doesn't seem that interesting in single shot as it's really hard, and no human could do it (it would be more useful if the model has visual feedback and could correct the result). And also, since it becomes a popular task, companies will add the examples in their training set, so you're just benchmarking who has the better tex…

My take is no one really cares about generating SVG, but it's a structured "code" format with very direct visual results. I can't look at 3 piles of code and instantly tell which is best (assuming minimum competence) , but I can judge the SVG outputs very easily. As a quick shot it gets a point across faster and with easier comparison. As a technical comparison it's not so strong, but thats harder to do and judge and less fun to read.

Re: Gemini 3.0 spotted in the wild through A/B testing

#220

Post by fennecbutt »

dingnuts wrote: post #92
bogtog wrote: post #59

Earlier quoted context omitted.

I agree with the bit about creative writing, and I would add writing more generally. Gemini also allows dumping in >500k tokens of your own writing to give it a sense of your style. The other big use-case I like Gemini for is summarizing papers or teaching me scholarly subjects. Gemini's more verbose than GPT-5, which feels nice for these cases. GPT-5 strikes me as terrible at this, and I'd also put Claude ahead of G…

using an LLM for "creative writing" is like getting on a motorcycle and then claiming you went for a ride on a bicycle no, wait, that analogy isn't even right. it's like going to watch a marathon and then claiming you ran in it.

Using a pencil is cheating. You should be marking paper with your fingernails.
Post reply on HN