The best thing about gemini models is the huge context windows, you can just throw big documents and find stuff real fast, rather than struggling with cut off in perplexity or Claude.
Gemini 2.0: our new AI model for the agentic era
231–240 of 512 posts
Re: Gemini 2.0: our new AI model for the agentic era
#232Re: Gemini 2.0: our new AI model for the agentic era
#233Earlier quoted context omitted.
BERT and Gemma 2B were both some of the highest-performing edge models of their time. Google does really well - in terms of pushing efficiency in the community they're second to none. They also don't need to rely on inordinate amounts of compute because Google's differentiating factor is the products they own and how they integrate it. OpenAI is API-minded, Google is laser-focused on the big-picture experience. For e…
> Google is laser-focused on the big-picture experience. This doesn't match my experience of any Google product.
I disagree - another way you could phrase this is that Google is presbyopic. They're very capable of thinking long-term (eg. Google Deepmind and AI as a whole, cloud, video, Drive/GSuite, etc.), but as a result they struggle to respond to quick market changes. AdSense is the perfect example of Google "going long" on a product and reaping the rewards to monopolistic ends. They can corner a market when the set their sights on it.
I don't think Google (or really any of FAANG) makes "good" products anymore. But I do think there are things to appreciate in each org, and compared to the way Apple and Microsoft are flailing helplessly I think Google has proven themselves in software here.
Re: Gemini 2.0: our new AI model for the agentic era
#234Earlier quoted context omitted.
Huh, all three words you mentioned as replacement are equally buzzwordy and I see them a lot in CVs while screen candidates for job interview.
At least all three of them are actually in the dictionary
That's not necessarily a good thing because they are overloaded while novel jargon is specific.
We use new words so often that we take it for granted. You've passively picked up dozens of new words over the last 5 or 10 years without questioning them.
Re: Gemini 2.0: our new AI model for the agentic era
#235Tested out Gemini-2 Flash, I had such high hopes that a better base model would help. It still hallucinates like crazy compared to GPT-4o.
Small models don't "know" as much so they hallucinate more. They are better suited for generations that are based in a ground truth, like in a RAG setup.
A better comparison might be Flash 2.0 vs 4o-mini. Even then, the models aren't meant to have vast world knowledge, so benchmarking them on that isn't a great indicator of how they would be used in real-world cases.
Re: Gemini 2.0: our new AI model for the agentic era
#236Earlier quoted context omitted.
The Pixel 9 runs many small proprietary Gemini models on the internal TPU.
Gemini nano weights are leaked and google doesn't care about it being leaked. Google would definitely care if Pro weights are leaked.
Is there any phone in the world that can realistically run pro weights?
Re: Gemini 2.0: our new AI model for the agentic era
#237Think of Google as of a tanker ship. It takes a while to change course, but it has great momentum. Sundar just needs to make sure the course is right.
That's almost word for word what people said about Windows Phone when I was at Microsoft.
But Windows Phone was actually good, like Xune, it was just late, and it was incredibly popular to hate Microsoft at the time.
Additionally, Microsoft didn't really have any advantage in the smart phone space.
Google is already a product the majority of people on the planet use regularly to answer questions.
That seems like a competitive advantage to me.
Re: Gemini 2.0: our new AI model for the agentic era
#238What's everyone's favorite LLM leaderboard? Gemini 2 seems to be edging out 4o on chatbot arena( https://lmarena.ai/?leaderboard )
AI benchmarks and leaderboards are complete nonsense though. Find something you like, use it, be ready to look again in a month or two.
poe.com has a decent model where you buy credits and spend them talking to any LLM which makes it nice to swap between them even during the same conversation instead of paying for multiple subscriptions.
Though gpt-4o could say "David Mayer" on poe.com but not on chat.openai.com which makes me wonder if they sometimes cheat and sneak in different models.
Re: Gemini 2.0: our new AI model for the agentic era
#239Anyone else annoyed how the ML/AI community just adopted the word "reasoning" when it seems like it is being used very out of context when looking at what the model actually does?
These kind of simplifications continue to make me an expert in LLM applications.
So... its a trade secret to know how it actually works...
Re: Gemini 2.0: our new AI model for the agentic era
#240What's everyone's favorite LLM leaderboard? Gemini 2 seems to be edging out 4o on chatbot arena( https://lmarena.ai/?leaderboard )
Leaderboards are not that useful for measuring real-life effectiveness of the models atleast in my day-today usage. I am currently struggling to diagnose an ipv6 mis-configuration in my enormous aws cloudformation yaml code. I gave the same input to Claude Opus, Gemini and ChatGPT ( o1 and 4o). 4o was the worst. verbose and waste of my time. Claude completely went off-tangent and began recommending fixes for ipv4 whi…
Sonnet 3.5 as of today is superior to Opus, curious if sonnet could have solved your problem