Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Gemini AI

deepmind.google

Post reply on HN
Print view View original

721–730 of 1001 posts

Re: Gemini AI

#721

Post by dekhn »

risyachka wrote: post #556
tikkun wrote: post #60

One observation: Sundar's comments in the main video seem like he's trying to communicate "we've been doing this ai stuff since you (other AI companies) were little babies" - to me this comes off kind of badly, like it's trying too hard to emphasize how long they've been doing AI (which is a weird look when the currently publicly available SOTA model is made by OpenAI, not Google). A better look would simply be to sh…

Google literally invented transformers that are at the core of all current AI/LLMs so Sundar's comment is very accurate.

Sundar's comments about Google doing AI (really ML) are based more on things that people externally know very little about. Systems like SETI, Sibyl, RePhil, SmartASS. These were all production ML systems that used fairly straightforward and conventional ML combined with innovative distributed computing and large-scale infrastructure to grow Google's product usage significantly over the past 20 years.

For example here's a paper 10 years old now: https://static.googleusercontent.com/media/research.google.c... and another close to 10 years old now: https://research.google/pubs/pub43146/ The learning they expose in those papers came from the previous 10 years of operating SmartASS.

However, SmartASS and sibyl weren't really what external ML people wanted- it was just fairly boring "increase watch time by identifying what videos people wioll click on" and "increase mobile app installs" or "show the ads people are likely to click on".

It really wasn't until vincent vanhoucke stuffed a bunch of GPUs into a desktop and demonstrated scalable and dean/ng built their cat detector NN that google started being really active in deep learning. That was around 2010-2012.

Re: Gemini AI

#722

Post by [deleted] »

SeanAnderson wrote: post #340

Gemini Ultra isn't released yet and is months away still. Bard w/ Gemini Pro isn't available in Europe and isn't multi-modal, https://support.google.com/bard/answer/14294096 No public stats on Gemini Pro. (I'm wrong. Pro stats not on website, but tucked in a paper - https://storage.googleapis.com/deepmind-media/gemini/gemini_... ) I feel this is overstated hype. There is no competitor to GPT-4 being released today. I…

[deleted]

Re: Gemini AI

#724

Post by alaskamiller »

lossolo wrote: post #557
tikkun wrote: post #60

One observation: Sundar's comments in the main video seem like he's trying to communicate "we've been doing this ai stuff since you (other AI companies) were little babies" - to me this comes off kind of badly, like it's trying too hard to emphasize how long they've been doing AI (which is a weird look when the currently publicly available SOTA model is made by OpenAI, not Google). A better look would simply be to sh…

> we've been doing this ai stuff since you (other AI companies) were little babies Actually, they kind of did. What's interesting is that they still only match GPT-4's version but don't propose any architectural breakthroughs. From an architectural standpoint, not much has changed since 2017. The 'breakthroughs', in terms of moving from GPT to GPT-4, included: adding more parameters (GPT-2/3/4), fine-tuning base mode…

In short: a chat bot is not AI.

Re: Gemini AI

#725

Post by kromem »

milesward wrote: post #136

This demo is nuts: https://youtu.be/UIZAiXYceBI?si=8ELqSinKHdlGlNpX

The multimodal capabilities are, but the tone and insight comes across as very juvenile compared to the SotA models.

I suspect this was a fine tuning choice and not an in context level choice, which would be unfortunate.

If I was evaluating models to incorporate into an enterprise deployment, "creepy soulless toddler" isn't very high up on the list of desired branding characteristics for that model. Arguably I'd even have preferred histrionic Sydney over this, whereas "sophisticated, upbeat, and polite" would be the gold standard.

While the technical capabilities come across as very sophisticated, the language of the responses themselves do not at all.

Re: Gemini AI

#726

Post by joshstrange »

alberth wrote: post #457
EZ-E wrote: post #362

Earlier quoted context omitted.

Investors are getting impatient! ChatGPT has already replaced Google for me and I wonder if Google starts to feel the pressure.

> "ChatGPT has already replaced Google for me" Would you mind elaborating more on this. Like how are you "searching" with ChatGPT?

I wouldn't say it's replaced search for me (Kagi in my case) but for anything where I'm looking for an answer with a bit of background ChatGPT takes the cake. It completely removes the need for me to click through to multiple websites and sum it up myself manually.

In the same way google/search made it possible to answer a question in real-time in a group of friends, ChatGPT does that but better in most cases. Yes, you have to deal with hallucinations and while they happen less often they do happen but you have to deal with crap in web searches as well.

Search is a super-power (most people suck at searching) and being able to grab information via ChatGPT feels very similar.

Re: Gemini AI

#727

Post by bastawhiz »

xnx wrote: post #92
walthamstow wrote: post #32

Gemini Nano sounds like the most exciting part IMO. IIRC Several people in the recent Pixel 8 thread were saying that offloading to web APIs for functions like Magic Eraser was only temporary and could be replaced by on-device models at some point. Looks like this is the beginning of that.

I think a lot of the motivation for running it in the cloud is so they can have a single point of control for enforcing editing policies (e.g. swapping faces).

Do you have evidence of that? Photoshop has blocked you from editing pictures of money for ages and that wasn't in the cloud. Moreover, how does a Google data center know whether you're allowed to swap a particular face versus your device? It's quite a reach to assume Google would go out of their way to prevent you from doing things on your device in their app when other AI-powered apps on your device already exist and don't have such policy restrictions.

Re: Gemini AI

#728

Post by kromem »

nojvek wrote: post #328

One of my biggest concerns with many of these benchmarks is that it’s really hard to tell if the test data has been part of the training data. There are terabytes of data fed into the training models - entire corpus of internet, proprietary books and papers, and likely other locked Google docs that only Google has access to. It is fairly easy to build models that achieve high scores in benchmarks if the test data has…

Even if they aren't, there's a separate concern that we're past the inflection point of Goodhart's Law and this blind focus on a handful of tests evaluating a small scope of capabilities is going to be leading to model regression in areas that aren't being evaluated or measured as a target.

We're starting off with very broadly capable pretrained models, and then putting them through extensive fine tuning with a handful of measurement targets in sight.

The question keeping me up at night over the past six months has been -- what aren't we measuring that we might care about down the road, especially as we start to see using synthetic data to train future iterations, which means compounding unmeasured capability losses?

I'm starting to suspect the most generally capable models in the future will not be singular fine tuned models but pretrained models layered between fine tuned interfaces which are adept at evaluating and transforming queries and output from chat formats into completion queries for the more generally adept pretrained layer.

Re: Gemini AI

#729

Post by aenis »

TrackerFF wrote: post #611
spaceman_2020 wrote: post #594

Earlier quoted context omitted.

I'm legitimately starting to wonder what white collar workers will even do in 5-10 years. This just Year 1 of this stuff going mainstream. Careers are 25-30 years long. What will someone entering the workforce today even be doing in 2035?

Yes, imagine being a HS student now, deciding what to do 5-6-7 years from now.

The options are: - be pretty - have fine motor skills - have wealthy parents

Re: Gemini AI

#730

Post by vinniepukh »

password54321 wrote: post #469
vinniepukh wrote: post #416

Earlier quoted context omitted.

No surprises here. Google DeepMind squandered their lead in AI so much that they now have to have “Google” prepended to their name to show that adults are now in charge.

What an ugly statement. DeepMind has been very open with their research since the beginning because their objective was much more on making breakthroughs with moonshot projects than near term profit.

[dead]
Post reply on HN