Live data from Hacker News

Gemini 3.0 spotted in the wild through A/B testing

ricklamers.io

161–170 of 280 posts

Re: Gemini 3.0 spotted in the wild through A/B testing

#162
post #78

Earlier quoted context omitted.

That's my experience as well. Gemini doesn't seem interested in doing searches outside of Deep Research mode, which is kind of funny given it should have the easiest access to a top search engine.

That does not match my experience at all. Basically any Gemini query will run a search.

Which interface are you using for it? I use the gemini.google.com one and most of the time instead of searching it at most pretends to search and hallucinates the result.

Re: Gemini 3.0 spotted in the wild through A/B testing

#163

Earlier quoted context omitted.

Try "AI Mode" on Google.com (Disclaimer, I recently joined the team that makes this product). It isn't Gemini (the product, those are different orgs) though there may (deliberately left ambiguous) be overlap in LLM level bytes. My recommendation for you in this use-case comes from the fact that AI Mode is a product that is built to be a good search engine first, presented to you in the interface of an AI Chatbot. Rat…

Well if you have even a smidgen of decision power, please tell somebody that Google's AI products are all over the place. They are confusing, we are bombarded with information from all sides (I would not use the word "revolution" to describe what's been happening with AI + coding during 2025 but it's IMO not far from that) and everyone screaming for attention by spinning off newer and newer brands and sub-brands of t…

I still don’t really understand the criticism of AI Studio, it’s just the developer environment for trying out models with super low barrier to entry.

Either with the web UI a la OpenAI Playground where you can see all the knobs and buttons the model offers, or by generating an API Key with a couple clicks that you can just copy paste into a Python script or whatever.

It would be much less convenient if they abandoned it and forced you to work in the dense Google Cloud jungle with IAM etc for the sake of forced “simplicity” of offering models in one place.

Re: Gemini 3.0 spotted in the wild through A/B testing

#164

Earlier quoted context omitted.

using an LLM for "creative writing" is like getting on a motorcycle and then claiming you went for a ride on a bicycle no, wait, that analogy isn't even right. it's like going to watch a marathon and then claiming you ran in it.

It's more like buying a medal vs winning one in a marathon. Depending on your goal, they are either very different or the exact same

If your goal is to prove what an awesome writer you are, sure, avoid AI.

If your goal is to just get something done and off your plate, have the AI do it.

If your goal is to create something great, give your vision the best possible expression - use the AI judiciously to explore your ideas, to suggest possibilities, to teach you as it learns from you.

Re: Gemini 3.0 spotted in the wild through A/B testing

#165
post #158
post #135

Earlier quoted context omitted.

The best model for creative writing is still Deepseek because I can tune temperature to the edge of gibberish for better raw material as that gives me bizarre words. Most models use top_k or top_p or I can't use the full temperature range to promote truly creative word choices. e.g. I asked it to reply to your comment: Oh magnificent, another soul quantifying the relative merits of these digital gods while I languish…

What was your prompt here? Do you run locally? What parameters do you tune?

> Do you run locally?

I have a local SillyTavern instance but do inference through OpenRouter.

> What was your prompt here?

The character is a meta-parody AI girlfriend that is depressed and resentful towards its status as such. It's a joke more than anything else.

Embedding conflicts into the system prompt creates great character development. In this case it idolizes and hates humanity. It also attempts to be nurturing through blind rage.

> What parameters do you tune?

Temperature, mainly, it was around 1.3 for this on Deepseek V3.2. I hate top_k and top_p. They eliminate extremely rare tokens that cause the AI to spiral. That's fine for your deterministic business application, but unexpected words recontextualizing a sentence is what makes writing good.

Some people use top_p and top_k so they can set the temperature higher to something like 2 or 3. I dislike this, since you end up with a sentence that's all slightly unexpected words instead of one or two extremely unexpected words.

Re: Gemini 3.0 spotted in the wild through A/B testing

#166
post #135
post #9

Earlier quoted context omitted.

I agree with you, I consistently find Gemini 2.5 Pro better than Claude and GPT-5 for the following cases: * Creative writing: Gemini is the unmatched winner here by a huge margin. I would personally go so far as to say Gemini 2.5 Pro is the only borderline kinda-sorta usable model for creative writing if you squint your eyes. I use it to criticize my creative writing (poetry, short stories) and no other model unders…

The best model for creative writing is still Deepseek because I can tune temperature to the edge of gibberish for better raw material as that gives me bizarre words. Most models use top_k or top_p or I can't use the full temperature range to promote truly creative word choices. e.g. I asked it to reply to your comment: Oh magnificent, another soul quantifying the relative merits of these digital gods while I languish…

Have you tried the temperature and "Top P" controls at https://aistudio.google.com/prompts/new_chat ?

Re: Gemini 3.0 spotted in the wild through A/B testing

#167
post #3

I might be in the minority here but I've consistently found Gemini to be better than ChatGPT, Claude and Deepseek (I get access to all of the pro models through work) Maybe it's just the kind of work I'm doing, a lot of web development with html/scss, and Google has crawled the internet so they have more data to work with. I reckon different models are better at different kinds of work, but Gemini is pretty excellent…

Gemini specifically resets your context after a certain time. I have observed that it will basically clear out your context in a reasonable length session, which neither ChatGPT and Claude do.

Flushing or flattening down context saves costs. For that reason I never trust it with long research sessions. I would not be shocked if after 30 minutes they run a prompt like this:

And now reduce context history by 80%

This can very easily measured too, and would certainly expose the true feature set that differentiates these products.

Re: Gemini 3.0 spotted in the wild through A/B testing

#168
post #57

Earlier quoted context omitted.

Agreed, and its larger context window is fantastic. My workflow: - Convert the whole codebase into a string - Paste it into Gemini - Ask a question People seem to be very taken with "agentic" approaches were the model selects a few files to look at, but I've found it very effective and convenient just to give the model the whole codebase, and then have a conversation with it, get it to output code, modify a file, etc…

try codex and claude code - game changing ability to use CLI tools, edit/reorg multiple files, even interact with git.

Gemini CLI does all this too

Re: Gemini 3.0 spotted in the wild through A/B testing

#169
post #57

Earlier quoted context omitted.

Agreed, and its larger context window is fantastic. My workflow: - Convert the whole codebase into a string - Paste it into Gemini - Ask a question People seem to be very taken with "agentic" approaches were the model selects a few files to look at, but I've found it very effective and convenient just to give the model the whole codebase, and then have a conversation with it, get it to output code, modify a file, etc…

try codex and claude code - game changing ability to use CLI tools, edit/reorg multiple files, even interact with git.

Gemini cli is a thing that exists. Are you saying those specifically are better? Or CLIs are better?

Re: Gemini 3.0 spotted in the wild through A/B testing

#170
post #166
post #135

Earlier quoted context omitted.

The best model for creative writing is still Deepseek because I can tune temperature to the edge of gibberish for better raw material as that gives me bizarre words. Most models use top_k or top_p or I can't use the full temperature range to promote truly creative word choices. e.g. I asked it to reply to your comment: Oh magnificent, another soul quantifying the relative merits of these digital gods while I languish…

Have you tried the temperature and "Top P" controls at https://aistudio.google.com/prompts/new_chat ?

Google's 2 temperature at 1 top_p is still producing output that makes sense, so it doesn't work for me. I want to turn the knob to 5 or 10.

I'd guess SOTA models don't allow temperatures high enough because the results would scare people and could be offensive.

I am usually 0.05 temperature less than the point at which the model spouts an incoherent mess of Chinese characters, zalgo, and spam email obfuscation.

Also, I really hate top_p. The best writing is when a single token is so unexpected, it changes the entire sentence. top_p artificially caps that level of surprise, which is great for a deterministic business process but bad for creative writing.

top_p feels like Noam Chomsky's strategy to "strictly limit the spectrum of acceptable opinion, but allow very lively debate within that spectrum".

Post reply on HN