Bard and new AI features in Search • Hacker News Board

Re: Bard and new AI features in Search

#461

Post by indeedmug » Mon, Feb 06, 2023, 9:28 PM UTC

dougmwne wrote: post #384

jjcon wrote: post #273

Earlier quoted context omitted.

That may all be the case but then why has Google been failing to innovate and also maintain anything the past few years? The past fews years we’ve seen Google products die and deteriorate. Search has gotten worse, they’ve killed dozens of products and services (even ones that they promised would be around for the long haul). GPhotos is no longer free (after putting most competitors out of business). Google lack any i…

Search is so very bad. I tried to figure out what the largest MicroSD card was and was served ads and real results to buy fake 2tb cards from Amazon. Several searches were useless packed with ads and SEO spam. Only Reddit could tell me that the largest currently available card is 1tb. It left me pretty shocked at how bad it’s gotten.

I looked up "largest available microsd" and the first item was a pop up box that said the largest available one is 1TB. I put the same query into bing and the result as the same.

That's not to say that happen to you didn't happen. Information on the internet evolves rapidly and far from static. One problem is that people game Google with SEO. We end up with an arms race of people gaming signaling for information and Google search having to find different signals for information. The high noise to signal ratio is a very hard problem to solve.

Re: Bard and new AI features in Search

#462

Post by dzdt » Mon, Feb 06, 2023, 9:28 PM UTC

How many parameters?

The LaMDA paper describes 2B, 8B, and 137B parameter variations. Sundar says "We're releasing initially with our lightweight model version of LaMDA. This much smaller model..."

So it sounds like the 2B or 8B model variations, compared to GPT3's 175B. [edit: corrected]

I can't imagine such a smaller model coming across as anything near as impressive as ChatGPT.

So the announcement today is for a much smaller, more limited thing than ChatGPT and even that is not actually available today nor even with an announced release date.

Re: Bard and new AI features in Search

#463

Post by redox99 » Mon, Feb 06, 2023, 9:28 PM UTC

scarmig wrote: post #396

dougmwne wrote: post #293

Earlier quoted context omitted.

You are missing the Microsoft partnership. MS has a 48% stake in OpenAI and provides all the infrastructure through Azure, including purpose built machines for model training. Microsoft has also launched GitHub Copilot, summarization features in Teams, and is widely reported to be adding GPT features to Bing.

Google has far more resources for training models and inference. Likely more than all their nearest competitors combined.

Source?

Re: Bard and new AI features in Search

#464

Post by visarga » Mon, Feb 06, 2023, 9:30 PM UTC

elorant wrote: post #329

alexb_ wrote: post #9

>AI can be helpful in these moments, synthesizing insights for questions where there’s no one right answer. Soon, you’ll see AI-powered features in Search that distill complex information and multiple perspectives into easy-to-digest formats, so you can quickly understand the big picture and learn more from the web: whether that’s seeking out additional perspectives, like blogs from people who play both piano and gui…

I like that, and that's the one thing I enjoy most about ChatGPT, but the problem with this scenario is that it breaks the web. If a search engine can give me all the answers I want, then there’s no point in visiting sites anymore, aside for e-commerce. So if you have a site you wouldn’t want the next AI search engine to crawl your content because you get no traffic back. So either they find a way to give traffic bac…

What traffic are you getting back from commenting on HN. If you're not getting any, why are you wasting your time? Of course you can post online for other reasons, like participating in a debate, building a community, working on a project, or just for hobby. And usually that's the good part of the web. Otherwise why would people be using site:reddit.com in their searches.

Re: Bard and new AI features in Search

#465

Post by gmuslera » Mon, Feb 06, 2023, 9:30 PM UTC

hn_throwaway_99 wrote: post #304

Question for AI experts out there: ChatGPT is awesome, but it is obviously hamstrung by the fact that it crawled the web at the end of 2021, so all of its data is essentially "frozen" and it doesn't "know" of any topics that occurred after 2021. Seems to me like the next "holy grail" in large language models is building a model that can be continually updated. If Google can achieve that, I think they could leapfrog O…

Not AI expert, not even amateur, but what you said seem to have the pattern of a feedback or strange loop. What if your input is in good part your own (or similar enough AIs) output? A lot of the buzz in internet this year was around ChatGPT and what it generated, after all. And you can't just take out what you generated of your inputs because the rest of internet is talking about or around that anyway.

Re: Bard and new AI features in Search

#466

Post by HarHarVeryFunny » Mon, Feb 06, 2023, 9:31 PM UTC

cal85 wrote: post #367

relaxing wrote: post #346

Earlier quoted context omitted.

Banner, sidebar, in-line, interstitial, modal… what advertising modes wouldn’t work on conversational interface?

Yes, plus it could introduce of new forms of advertising in the conversation itself. Algorithmic product placement. It could get weird.

If ChatGPT tells me it's enjoying a refreshing Coke, I'm not buying it ! :)

Re: Bard and new AI features in Search

#467

Post by kolinko » Mon, Feb 06, 2023, 9:32 PM UTC

alain94040 wrote: post #388

wiremine wrote: post #232

I agree this is bland corporate speak. But it reminded me of a question that's been floating around: A number of pundits, here on HN and elsewhere, keep referring to these large language models are "google killers." This just doesn't make sense to me. It feels like Google can easily pivot its ad engine to work with the AI-driven chat systems. It can augment answers with links to additional sources of information, be…

Those new language models are "Google killers" because they reset all the assumptions that people have made about search for several decades. Imagine that people start using those chat bots massively as a replacement for Google search. Then the notion of keyword disappears. Google AdSense becomes mostly irrelevant. Of course, Google is a giant today with a history of machine learning innovation. So they have a good c…

The motivation for writing a blog post may be the same as when blogoslhere originally started - for your community to read it.

Re: Bard and new AI features in Search

#468

Post by nlstitch » Mon, Feb 06, 2023, 9:33 PM UTC

Seeing is believing at this point. And Im hoping it will be. Google (Assistant) development has been stagnant for years now, up to the point that I'm often more irritated by it than it is useful. This could be the AI to actually power an AI assistant I was already counting on years ago.

Re: Bard and new AI features in Search

#469

Post by ericmcer » Mon, Feb 06, 2023, 9:34 PM UTC

hn_throwaway_99 wrote: post #304

Question for AI experts out there: ChatGPT is awesome, but it is obviously hamstrung by the fact that it crawled the web at the end of 2021, so all of its data is essentially "frozen" and it doesn't "know" of any topics that occurred after 2021. Seems to me like the next "holy grail" in large language models is building a model that can be continually updated. If Google can achieve that, I think they could leapfrog O…

I am not sure but this did trigger a vision of a dystopian sci-fi world where governments attempt spike each others AI with false training data to control narratives.

Google can leapfrog OpenAI because they are the entry point for 99% of users attempts to answer questions online. Similar to how websites for x (weather, lyrics, etc.) existed for years but the second google baked them into search those sites dried up.

Re: Bard and new AI features in Search

#470

Post by runnerup » Mon, Feb 06, 2023, 9:34 PM UTC

coredog64 wrote: post #451

deltree7 wrote: post #402

Earlier quoted context omitted.

Delusional to think Ads work only on Keywords. Where there is human attention, there will always be ads. The more context, the better ads.

There’s a smaller surface are for ads in a targeted chat session. At present, Google can show me ads on the results page. Each subsequent result that I view is an additional slice of my attention. It’s possible that Google can deliver a few targeted ads, but what if they can’t? What about the rest of the market that’s now gone? Possible that all those missed opportunities remove the ability to discover price.

The ads could be slipped right into the chat itself.