Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Gemini 2.0: our new AI model for the agentic era

blog.google

Post reply on HN
Print view View original

301–310 of 512 posts

Re: Gemini 2.0: our new AI model for the agentic era

#301

Post by whimsicalism »

menaerus wrote: post #261
whimsicalism wrote: post #194

Earlier quoted context omitted.

> Afaik there is no commodity hardware that can run state of the art models like chatgpt-o1. Stack enough GPUs and any of them can run o1. Building a chip to infer LLMs is much easier than building a training chip. Just because one cost dwarfs another does not mean that this is where the most marginal value from developing a better chip will be, especially if other people are just doing it for you. Google gets a good…

Each GPU costs ~50k. You need at least 8 of them to run mid-sized models. Then you need a server to plug those GPUs into. That's not commodity hardware.

more like ~$16k for 16 3090s. AMD chips can also run these models. The parts are expensive but there is a competitive market in processors that can do LLM inference. Less so in training.

Re: Gemini 2.0: our new AI model for the agentic era

#302

Post by whimsicalism »

simonw wrote: post #291
SimianSci wrote: post #225

Earlier quoted context omitted.

I think Apple is uniquely disadvantaged in the AI race to a point people dont realize. They have less training data to use, having famously been focused on privacy for its users and thus having no particular advantage in this space due to not having customer data to train on. They have little to no cloud business, and while they operate a couple of services for their users, they do not have the infrastructure scale t…

"having famously been focused on privacy for its users and thus having no particular advantage in this space due to not having customer data to train on" That may not be as big a disadvantage as you think. Anthropic claim that they did not use any data from their users when they trained Claude 3.5 Sonnet.

sure but they certainly acquired data from mass scraping (including of data produced by their users) and/or data brokering aka paying someone to do the same.

Re: Gemini 2.0: our new AI model for the agentic era

#303

Post by bravura »

simonw wrote: post #287
bravura wrote: post #276

Earlier quoted context omitted.

Question: Have you tried using this for video? Alternately, if I wanted to pipe a bunch of screencaps into it and get one grand response, how would I do that? e.g. "Does the user perform a thumbs up gesture in any of these stills?" [edit: also, do you know the vision pricing? I couldn't find it easily]

Previous Gemini models worked really well for video, and this one can even handle steaming video: https://simonwillison.net/2024/Dec/11/gemini-2/#the-streamin...

Wow this is amazing. It just gave me critique on my bodyweight squat form.

But I also found it hard to prompt to tutor in French or Portuguese; the accents were gruesomely bad.

Re: Gemini 2.0: our new AI model for the agentic era

#304

Post by whimsicalism »

bloomingkales wrote: post #116
panabee wrote: post #86

Earlier quoted context omitted.

With many research areas converging to comparable levels, the most critical piece is arguably vertical integration and forgoing the Nvidia tax. They haven't wielded this advantage as powerfully as possible, but changes here could signal how committed they are to slaying the search cash cow. Nadella deservedly earned acclaim for transitioning Microsoft from the Windows era to cloud and mobile. It will be far more impr…

They have to not get blind sided by Sora, while at the same time fighting the cloud war against MS/Amazon. Weirdly Google is THE AI play. If AI is not set to change everything and truly is a hype cycle, then Google stock withstands and grows. If AI is the real deal, then Google still withstands due to how much bigger the pie will get.

sora is not a big factor in this

Re: Gemini 2.0: our new AI model for the agentic era

#306

Post by px1999 »

fluoridation wrote: post #260
Fidelix wrote: post #250

Earlier quoted context omitted.

That's different from "killing" the product / technology, which is what Google does.

Only because they operate different businesses. Google is primarily a service provider. They have few software products that are not designed to integrate with their servers. Many of Microsoft's businesses work fundamentally differently. There's nothing Microsoft could do to Windows to disable all MFC applications and only MFC applications, and if there was it would involve more work than simply not doing anything el…

The business model doesn't matter.

I can write something with Microsoft tech and expect it with reasonable likelihood to work in 10 years (even their service-based stuff), but can't say the same about anything from Google.

That alone stops me/my org buying stuff from Google.

Re: Gemini 2.0: our new AI model for the agentic era

#307

Post by EternalFury »

griomnib wrote: post #125
EternalFury wrote: post #47

Think of Google as of a tanker ship. It takes a while to change course, but it has great momentum. Sundar just needs to make sure the course is right.

And where is the ship headed if they are no longer supporting the open web? Publishers are being squeezed and going under, or replacing humans with hallucinated genai slop. It’s like we’re taking the private equity model of extracting value and killing something off to the entire web. I’m not sure where this is headed, but I don’t think Sundar has any strategy here other than playing catch up. Demis’ goal is pretty t…

The Web is dead. It’s pretty clear future web pages, if we call them that, will be assembled on-the-fly by AI based your user profile and declared goals, interests and requests.

Re: Gemini 2.0: our new AI model for the agentic era

#308

Post by purple-leafy »

WA wrote: post #227
jncfhnb wrote: post #16

Am I alone in thinking the word “agentic” is dumb as shit? Most of these things seem to just be a system prompt and a tool that get invoked as part of a pipeline. They’re hardly “agents”. They’re modules.

Gemini, too, for the sole reason that non-native speakers have no clue how to pronounce it.

pronounced: juh-meany .... right?

Re: Gemini 2.0: our new AI model for the agentic era

#309

Post by [deleted] »

whimsicalism wrote: post #194
rowanG077 wrote: post #166

Earlier quoted context omitted.

That makes no sense. Inference cost dwarf training cost if you have a succesfull product pretty quickly. Afaik there is no commodity hardware that can run state of the art models like chatgpt-o1.

> Afaik there is no commodity hardware that can run state of the art models like chatgpt-o1. Stack enough GPUs and any of them can run o1. Building a chip to infer LLMs is much easier than building a training chip. Just because one cost dwarfs another does not mean that this is where the most marginal value from developing a better chip will be, especially if other people are just doing it for you. Google gets a good…

[deleted]

Re: Gemini 2.0: our new AI model for the agentic era

#310

Post by lxgr »

talldayo wrote: post #233
closewith wrote: post #165

Earlier quoted context omitted.

> Google is laser-focused on the big-picture experience. This doesn't match my experience of any Google product.

I disagree - another way you could phrase this is that Google is presbyopic. They're very capable of thinking long-term (eg. Google Deepmind and AI as a whole, cloud, video, Drive/GSuite, etc.), but as a result they struggle to respond to quick market changes. AdSense is the perfect example of Google "going long" on a product and reaping the rewards to monopolistic ends. They can corner a market when the set their si…

Google does software/features relatively well, but they are completely lost when it comes to marketing, shipping, and continuing to support products.

Or how would you describe their handling of Stadia, or their weird obsession about shipping and cancelling about a dozen instant messengers?

Post reply on HN