Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Bard and new AI features in Search

blog.google

Post reply on HN
Print view View original

861–870 of 1000 posts

Re: Bard and new AI features in Search

#861

Post by dotancohen »

DannyBee wrote: post #816
eklitzke wrote: post #418

Earlier quoted context omitted.

The point about the economics of running these models is an important one that slides under the radar a lot of times. The training costs for large language models like GPT are enormous, and the inference costs are substantial too. Right now things like ChatGPT are very cool parlor tricks, but there's absolutely no way to justify them in terms of the economics of running the service today. Obviously this is all going…

+1 For a group of people on a site frequented by startup people, did nobody read the terms of MS's investment into OpenAI? "Microsoft would reportedly put down $10 billion for a 75% share of the profits that OpenAI earns until the money on the investment is paid back. Then when Microsoft breaks even on the $10 billion investment, they would get a 49% stake in OpenAI. These are not the terms you would take if, tomorro…

  > Microsoft would reportedly put down $10 billion for a 75% share of the profits
  > that OpenAI earns until the money on the investment is paid back. Then when Microsoft
  > breaks even on the $10 billion investment, they would get a 49% stake in OpenAI.
To put that in perspective, which is often difficult with large sums of money like this, $10 billion is _half_ of what Facebook paid for Whatsapp.

Re: Bard and new AI features in Search

#862

Post by auser987 »

https://chat.openai.com/chat

Q: Is this boilerplate?

AI is the most profound technology we are working on today. Whether it’s helping doctors detect diseases earlier or enabling people to access information in their own language, AI helps people, businesses and communities unlock their potential. And it opens up new opportunities that could significantly improve billions of lives. That’s why we re-oriented the company around AI six years ago — and why we see it as the most important way we can deliver on our mission: to organize the world’s information and make it universally accessible and useful.

A: Yes, this text is a boilerplate.

Q: Why?

A: This text appears to be a standardized or formulaic description of the value of AI technology and its potential impact, likely used as a marketing or promotional tool by a company. Boilerplate language is often used to convey a consistent message across various platforms or materials.

Re: Bard and new AI features in Search

#863

Post by flakeoil »

senttoschool wrote: post #812
brookst wrote: post #798

Earlier quoted context omitted.

Agree, but much less than 10 years. Now that the transformer is establishing itself as the model, we’ll see dedicated HW acceleration for transformers, encoders, decoders, etc. I will eat my hat* if we don’t see local inference for 200B+ parameters within 5 years. * I don’t own a hat

Which chip company do you think will benefit from the move to transformers?

No-one in particular. It will be integrated in the processors (the intels/AMDs on PC, the Mx on Macs and the Qualcomms, Mediateks and Samsungs on phones).

Not much different from video and graphics accelerators being integrated today, or DSP focused instructions in the instruction set.

They just have to do it to stay relevant.

Re: Bard and new AI features in Search

#864

Post by XenophileJKO »

taylorius wrote: post #838
q7xvh97o2pDhNrh wrote: post #782

Earlier quoted context omitted.

> What do I stand to gain from it The AI will absorb your words, and some small part of you will gain immortality. In some small but very real way, you'll live forever, some part of you ensconced safely for all eternity in a handful of vectors deep inside a pile of inscrutable matrices. ...at least, until some CEO lays off that whole team to juice the stock price.

"The AI will absorb your words, and some small part of you will gain immortality. In some small but very real way, you'll live forever, some part of you ensconced safely for all eternity in a handful of vectors deep inside a pile of inscrutable matrices." That sounds like a sort-of-religion of the future, actually.

I did have chatGPT create a new religion for me. I have to admit, it was quite compelling.

Re: Bard and new AI features in Search

#865

Post by flakeoil »

brookst wrote: post #801
ehzy wrote: post #627

Earlier quoted context omitted.

With no attribution or way to discover the source. That's great for propagandists but maybe less great for everyone else.

When a real person tells you something in person today, how do you know the original source?

You can ask where they heard it from.

Re: Bard and new AI features in Search

#866

Post by flakeoil »

zone411 wrote: post #768
acdha wrote: post #727

Earlier quoted context omitted.

This is the opposite of true in my experience: if you run a content-heavy site, Wikipedia is going to be one of your top traffic sources — especially for time on site since the visitors who arrive tend to have a very low bounce rate.

Look at my profile, I own content-heavy sites and have for many years. I can show you logs - Wikipedia does virtually nothing. And the content of my sites has been regurgitated by Wikipedia thousands of times.

It maybe doesn't drive much traffic directly from Wikipedia, but you might have a higher SEO rank when people search in google for whatever your sites are about. Thanks to the links from Wikipedia.

Re: Bard and new AI features in Search

#867

Post by ReptileMan »

alain94040 wrote: post #388
wiremine wrote: post #232

I agree this is bland corporate speak. But it reminded me of a question that's been floating around: A number of pundits, here on HN and elsewhere, keep referring to these large language models are "google killers." This just doesn't make sense to me. It feels like Google can easily pivot its ad engine to work with the AI-driven chat systems. It can augment answers with links to additional sources of information, be…

Those new language models are "Google killers" because they reset all the assumptions that people have made about search for several decades. Imagine that people start using those chat bots massively as a replacement for Google search. Then the notion of keyword disappears. Google AdSense becomes mostly irrelevant. Of course, Google is a giant today with a history of machine learning innovation. So they have a good c…

>Those new language models are "Google killers" because they reset all the assumptions that people have made about search for several decades.

There is problem with those AIs - you view the world trough the ideological prism of their creators and censors. So chatgpt that is more than happy to make jokes for some races and not others or other types of shenanigans is something I am sure will happily hide the information I actually want to find and feeds me what it wants me to find. So until there are guarantees about ideological neutrality they are not suitable for search for me.

Re: Bard and new AI features in Search

#868

Post by flakeoil »

coredog64 wrote: post #451
deltree7 wrote: post #402

Earlier quoted context omitted.

Delusional to think Ads work only on Keywords. Where there is human attention, there will always be ads. The more context, the better ads.

There’s a smaller surface are for ads in a targeted chat session. At present, Google can show me ads on the results page. Each subsequent result that I view is an additional slice of my attention. It’s possible that Google can deliver a few targeted ads, but what if they can’t? What about the rest of the market that’s now gone? Possible that all those missed opportunities remove the ability to discover price.

As you have a detailed conversation with the Chatbot it will know a scary amount of detail about what you are looking for. It can target you in extreme detail. It does not have to show it on many places of with vivid pictures. It's enough with the text dialog based on your detailed inputs.

Re: Bard and new AI features in Search

#869

Post by inimino »

dietr1ch wrote: post #851
inimino wrote: post #608

Earlier quoted context omitted.

"Attention is all you need"? Joking aside, there's no reason AdWords can't become AdWordVectors and be even more effectively targeted.

How do you know it's not that way now? Keywords will still be around at the user interface for people buying ads, they are easy to grasp. Part of the secret sauce is getting those keywords mapped into the right entities in a sort of knowledge graph of things you can spend money on that is also connected to all the content of the places you can serve ads on.

Good point.

Re: Bard and new AI features in Search

#870

Post by flakeoil »

yunwal wrote: post #550
scarmig wrote: post #396

Earlier quoted context omitted.

Google has far more resources for training models and inference. Likely more than all their nearest competitors combined.

If you’re talking about physical hardware, Google pales in comparison to Amazon, and Gcloud is still smaller than Azure. It’s possible google’s private compute makes up for the Azure difference but it’s not like they’re in different leagues in terms of access to hardware.

But you are confusing yourself. Just because AWS has more servers being rented to and used by their customers doesn't necessarily mean they have the most CPU power available for themselves to run AI models.

I also doubt computing power is the real bottleneck. Anyone of these companies (and most other companies too) can build enough large servers sites and they have the money. The costly and difficult part is the engineering resources, doing the right thing technically (AI wise) and business wise, not lose time, not bet on the wrong horse etc.

Post reply on HN