Speed looks good vis-a-vis 4o-mini, and quality looks good so far against my eval set. If it's cheaper than 4o-mini too (which, it probably will be?) then OpenAI have a real problem, because switching between them is a value in a config file.
Gemini 2.0: our new AI model for the agentic era
151–160 of 512 posts
Re: Gemini 2.0: our new AI model for the agentic era
#152Big companies can be slow to pivot, and Google has been famously bad at getting people aligned and driving in one direction. But, once they do get moving in the right direction the can achieve things that smaller companies can't. Google has an insane amount of talent in this space, and seems to be getting the right results from that now. Remains to be seen how well they will be able to productize and market, but hard…
> Remains to be seen how well they will be able to productize and market
The challenge is trust.
Google is one of the leaders in AI and are home to incredibly talented developers. But they also have an incredibly bad track record of supporting their products.
It's hard to justify committing developers and money to a product when there's a good chance you'll just have to pivot again once they get bored. Say what you will about Microsoft, but at least I can rely on their obsession with supporting outdated products.
Re: Gemini 2.0: our new AI model for the agentic era
#153Earlier quoted context omitted.
Isn't that just "intelligent"?
We need something to describe a behavioral element in business processes. Something goes into it, something comes out of it - though in this case nondeterminism is involved and it may not be concrete outputs so much as further actioning. Intelligence is a characteristic.
Volitional, independent, spontaneous, free-willed, sovereign...
Re: Gemini 2.0: our new AI model for the agentic era
#154Was this written by an LLM? It's pretty bad copy. Maybe they laid off their copywriting team...?
> "Now millions of developers are building with Gemini. And it’s helping us reimagine all of our products — including all 7 of them with 2 billion users — and to create new ones"
and
> "We’re getting 2.0 into the hands of developers and trusted testers today. And we’re working quickly to get it into our products, leading with Gemini and Search. Starting today our Gemini 2.0 Flash experimental model will be available to all Gemini users."
Re: Gemini 2.0: our new AI model for the agentic era
#155No mention of Perplexity yet in the comments but it's obvious to me that they're targeting Perplexity Pro directly with their new Deep Research feature ( https://blog.google/products/gemini/google-gemini-deep-resea... ). I still wonder why Perplexity is worth $7 billion when the 800-pound gorilla is pounding on their door (albeit slowly).
Just tried the deep search. It's a much much slower experience than perplexity at the moment - taking sweet many minutes to return result. Maybe it's more extensive but I use perplexity for quick information summary a lot and this is a very different UX.
Haven't used it enough to evaluate the quality, however.
Re: Gemini 2.0: our new AI model for the agentic era
#156OT: I’m not entirely sure why, but "agentic" sets my teeth on edge. I don't mind the concept, but the word itself has that hollow, buzzwordy flavor I associate with overblown LinkedIn jargon, particularly as it is not actually in the dictionary...unlike perfectly serviceable entries such as "versatile", "multifaceted" or "autonomous"
Need a general term for autonomous intelligent decision making.
No, we need a scientific understanding of autonomous intelligent decision-making. The problem with “agentic AI” is the same old “Artificial Intelligence, Natural Stupidity” problem: we have no clue what “reasoning” or “intelligence” or “autonomous” actually means in animals, and trying to apply these terms to AI without understanding them (or inventing a new term without nailing down the underlying concept) is doomed to fail.
Re: Gemini 2.0: our new AI model for the agentic era
#157Was this written by an LLM? It's pretty bad copy. Maybe they laid off their copywriting team...? > "Now millions of developers are building with Gemini. And it’s helping us reimagine all of our products — including all 7 of them with 2 billion users — and to create new ones" and > "We’re getting 2.0 into the hands of developers and trusted testers today. And we’re working quickly to get it into our products, leading…
Sorry, what's wrong with these phrases?
Re: Gemini 2.0: our new AI model for the agentic era
#158Big companies can be slow to pivot, and Google has been famously bad at getting people aligned and driving in one direction. But, once they do get moving in the right direction the can achieve things that smaller companies can't. Google has an insane amount of talent in this space, and seems to be getting the right results from that now. Remains to be seen how well they will be able to productize and market, but hard…
> Remains to be seen how well they will be able to productize and market The challenge is trust. Google is one of the leaders in AI and are home to incredibly talented developers. But they also have an incredibly bad track record of supporting their products. It's hard to justify committing developers and money to a product when there's a good chance you'll just have to pivot again once they get bored. Say what you w…
> they also have an incredibly bad track record of supporting their products
Incredibly bad track record of supporting products that don't grow. I'm not saying this to defend Google, I'm still (perhaps unreasonably) angry because of Reader, it's just that there is a pattern and AI isn't likely to fit that for a long while.
Re: Gemini 2.0: our new AI model for the agentic era
#159Was this written by an LLM? It's pretty bad copy. Maybe they laid off their copywriting team...? > "Now millions of developers are building with Gemini. And it’s helping us reimagine all of our products — including all 7 of them with 2 billion users — and to create new ones" and > "We’re getting 2.0 into the hands of developers and trusted testers today. And we’re working quickly to get it into our products, leading…
Sorry, what's wrong with these phrases?
It reads like a transcribed speech. You can picture this being read from a teleprompter at a conference keynote.
Short sentence fact. And aspirational tagline - pause for some metrics - and more. And. Today. And. And. Today.
Re: Gemini 2.0: our new AI model for the agentic era
#160What's everyone's favorite LLM leaderboard? Gemini 2 seems to be edging out 4o on chatbot arena( https://lmarena.ai/?leaderboard )
AI benchmarks and leaderboards are complete nonsense though. Find something you like, use it, be ready to look again in a month or two.
FWIW I've found the 'coding' 'category' of the leaderboard to be reasonably accurate. Claude was the best, o1-mini then was typically stronger, now the Gemini Exp 1206 is at the top.
I find myself just paying a la carte via the API rather than paying the $20/mo so I can switch between the models.