Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Gemini 3.0 spotted in the wild through A/B testing

ricklamers.io

Post reply on HN
Print view View original

21–30 of 280 posts

Re: Gemini 3.0 spotted in the wild through A/B testing

#21

Post by a_t48 »

cj wrote: post #7
jmkni wrote: post #3

I might be in the minority here but I've consistently found Gemini to be better than ChatGPT, Claude and Deepseek (I get access to all of the pro models through work) Maybe it's just the kind of work I'm doing, a lot of web development with html/scss, and Google has crawled the internet so they have more data to work with. I reckon different models are better at different kinds of work, but Gemini is pretty excellent…

I use LLMs a lot for health related things (e.g. “Here are 6 bloodwork panels over the past 12 months, here’s a list of medical information, please identify trends/insights/correlations [etc]”) I default to using ChatGPT since I like the Projects feature (missing from Gemini I think?). I occasionally run the same prompts in Gemini to compare. A couple notes: 1) Gemini is faster to respond in 100% of cases (most of my…

The last time I tried with ChatGPT (just to look at some MRIs to get an idea of what might be up before the turnaround from doc) it refused.

Re: Gemini 3.0 spotted in the wild through A/B testing

#22

Post by CaptainOfCoit »

jmkni wrote: post #3

I might be in the minority here but I've consistently found Gemini to be better than ChatGPT, Claude and Deepseek (I get access to all of the pro models through work) Maybe it's just the kind of work I'm doing, a lot of web development with html/scss, and Google has crawled the internet so they have more data to work with. I reckon different models are better at different kinds of work, but Gemini is pretty excellent…

> consistently found Gemini to be better than ChatGPT, Claude and Deepseek

I used Pro Mode in ChatGPT since it was available, and tried Claude, Gemini, Deepseek and more from time to time, but none of them ever get close to Pro Mode, it's just insanely better than everything.

So when I hear people comparing "X to ChatGPT", are you testing against the best ChatGPT has to offer, or are you comparing it to "Auto" and calling it a day? I understand people not testing their favorite models against Pro Mode as it's kind of expensive, but it would really help if people actually gave some more concrete information when they say "I've tried all the models, and X is best!".

(I mainly do web dev, UI and UX myself too)

Re: Gemini 3.0 spotted in the wild through A/B testing

#23

Post by smusamashah »

https://x.com/chetaslua is experimenting a lot with Gemini 3 and posting its results (various web desktops, a vampire survivor clone which is actually very playable, voxel 3d models, other game clones, SVG etc). They look really good, specially when they are one-shot.

Re: Gemini 3.0 spotted in the wild through A/B testing

#24

Post by solarkraft »

I hope they are going to solve the looping problem. It’s real and it’s awful. It’s so bad that the CLI has a loop detection which I promptly ran into after a minute of use.

In the Gemini app 2.5 Pro also regularly repeats itself VERBATIM after explicitly being told not to multiple times to the point of uselessness.

Re: Gemini 3.0 spotted in the wild through A/B testing

#25

Post by behnamoh »

schainks wrote: post #19
jmkni wrote: post #3

I might be in the minority here but I've consistently found Gemini to be better than ChatGPT, Claude and Deepseek (I get access to all of the pro models through work) Maybe it's just the kind of work I'm doing, a lot of web development with html/scss, and Google has crawled the internet so they have more data to work with. I reckon different models are better at different kinds of work, but Gemini is pretty excellent…

Yes. Jules even writes more testable code, but people I know regularly use codex because it will bang its head against the wall and eventually give you a working implementation even though it took longer.

Maybe because Jules is made by Google and 95% of Google products end up dead as soon as the product manager gets a promotion?

Re: Gemini 3.0 spotted in the wild through A/B testing

#26

Post by sosodev »

jmkni wrote: post #3

I might be in the minority here but I've consistently found Gemini to be better than ChatGPT, Claude and Deepseek (I get access to all of the pro models through work) Maybe it's just the kind of work I'm doing, a lot of web development with html/scss, and Google has crawled the internet so they have more data to work with. I reckon different models are better at different kinds of work, but Gemini is pretty excellent…

I swear HN commenters say this about every frontier model.

Re: Gemini 3.0 spotted in the wild through A/B testing

#27

Post by jmkni »

CaptainOfCoit wrote: post #22
jmkni wrote: post #3

I might be in the minority here but I've consistently found Gemini to be better than ChatGPT, Claude and Deepseek (I get access to all of the pro models through work) Maybe it's just the kind of work I'm doing, a lot of web development with html/scss, and Google has crawled the internet so they have more data to work with. I reckon different models are better at different kinds of work, but Gemini is pretty excellent…

> consistently found Gemini to be better than ChatGPT, Claude and Deepseek I used Pro Mode in ChatGPT since it was available, and tried Claude, Gemini, Deepseek and more from time to time, but none of them ever get close to Pro Mode, it's just insanely better than everything. So when I hear people comparing "X to ChatGPT", are you testing against the best ChatGPT has to offer, or are you comparing it to "Auto" and ca…

well I'm giving them the exact same prompts and comparing the output

Re: Gemini 3.0 spotted in the wild through A/B testing

#28

Post by [deleted] »

cj wrote: post #7
jmkni wrote: post #3

I might be in the minority here but I've consistently found Gemini to be better than ChatGPT, Claude and Deepseek (I get access to all of the pro models through work) Maybe it's just the kind of work I'm doing, a lot of web development with html/scss, and Google has crawled the internet so they have more data to work with. I reckon different models are better at different kinds of work, but Gemini is pretty excellent…

I use LLMs a lot for health related things (e.g. “Here are 6 bloodwork panels over the past 12 months, here’s a list of medical information, please identify trends/insights/correlations [etc]”) I default to using ChatGPT since I like the Projects feature (missing from Gemini I think?). I occasionally run the same prompts in Gemini to compare. A couple notes: 1) Gemini is faster to respond in 100% of cases (most of my…

[deleted]

Re: Gemini 3.0 spotted in the wild through A/B testing

#29

Post by cj »

a_t48 wrote: post #21
cj wrote: post #7

Earlier quoted context omitted.

I use LLMs a lot for health related things (e.g. “Here are 6 bloodwork panels over the past 12 months, here’s a list of medical information, please identify trends/insights/correlations [etc]”) I default to using ChatGPT since I like the Projects feature (missing from Gemini I think?). I occasionally run the same prompts in Gemini to compare. A couple notes: 1) Gemini is faster to respond in 100% of cases (most of my…

The last time I tried with ChatGPT (just to look at some MRIs to get an idea of what might be up before the turnaround from doc) it refused.

Hm, I've also uploaded MRI images to ChatGPT and it worked as expected.

I went back to the censored chat I mentioned earlier, and got it to give me an answer when adding "You are a lifestyle health coach" to steer it away from throwing a bunch of disclaimers at you.

Re: Gemini 3.0 spotted in the wild through A/B testing

#30

Post by montebicyclelo »

jmkni wrote: post #3

I might be in the minority here but I've consistently found Gemini to be better than ChatGPT, Claude and Deepseek (I get access to all of the pro models through work) Maybe it's just the kind of work I'm doing, a lot of web development with html/scss, and Google has crawled the internet so they have more data to work with. I reckon different models are better at different kinds of work, but Gemini is pretty excellent…

Agreed, and its larger context window is fantastic. My workflow:

- Convert the whole codebase into a string

- Paste it into Gemini

- Ask a question

People seem to be very taken with "agentic" approaches were the model selects a few files to look at, but I've found it very effective and convenient just to give the model the whole codebase, and then have a conversation with it, get it to output code, modify a file, etc.

Post reply on HN