Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Bard and new AI features in Search

blog.google

Post reply on HN
Print view View original

511–520 of 1000 posts

Re: Bard and new AI features in Search

#511

Post by drcode »

alexb_ wrote: post #9

>AI can be helpful in these moments, synthesizing insights for questions where there’s no one right answer. Soon, you’ll see AI-powered features in Search that distill complex information and multiple perspectives into easy-to-digest formats, so you can quickly understand the big picture and learn more from the web: whether that’s seeking out additional perspectives, like blogs from people who play both piano and gui…

Yeah what I totally want when I have a nuanced question is an AI that just gives me a mealy-mouthed, non-committal response, such as in the example for this post on whether guitar or piano is easier to learn.

If you asked your friend, who's a serious musician, and they gave this kind of couched answer, you would be really annoyed at them.

Re: Bard and new AI features in Search

#512

Post by jiggawatts »

hn_throwaway_99 wrote: post #304

Question for AI experts out there: ChatGPT is awesome, but it is obviously hamstrung by the fact that it crawled the web at the end of 2021, so all of its data is essentially "frozen" and it doesn't "know" of any topics that occurred after 2021. Seems to me like the next "holy grail" in large language models is building a model that can be continually updated. If Google can achieve that, I think they could leapfrog O…

> So my question is, how hard of a problem is that with LLMs? I get the sense that LLMs are trained on a very large data set all at once, but that it is difficult to incrementally update them with new data.

It's the opposite. Getting an LLM to learn the basics of grammar and paragraph-level language structure is the "hard" part. Once you have that, further fine-tuning, specialisation, or other incremental changes are comparatively easy.

Catching up to current events could be done in almost real time, it's "just" continuous training.

The only challenge is trying to do that and also have an LLM that's filtered to exclude profanity, racism, etc...

That filter is usually added on as a final supervised training step, and requires many man-hours to train the AI to be well behaved.

I suspect that it would be possible to automate the filtering by making another AI that can evaluate responses and score them bases on profanity level.

Re: Bard and new AI features in Search

#513

Post by cypress66 »

dzdt wrote: post #462

How many parameters? The LaMDA paper describes 2B, 8B, and 137B parameter variations. Sundar says "We're releasing initially with our lightweight model version of LaMDA. This much smaller model..." So it sounds like the 2B or 8B model variations, compared to GPT3's 175B. [edit: corrected] I can't imagine such a smaller model coming across as anything near as impressive as ChatGPT. So the announcement today is for a m…

GPT3 is 175B parameters, but I agree with you.

Re: Bard and new AI features in Search

#514

Post by iandanforth »

jacooper wrote: post #364
hn_throwaway_99 wrote: post #304

Question for AI experts out there: ChatGPT is awesome, but it is obviously hamstrung by the fact that it crawled the web at the end of 2021, so all of its data is essentially "frozen" and it doesn't "know" of any topics that occurred after 2021. Seems to me like the next "holy grail" in large language models is building a model that can be continually updated. If Google can achieve that, I think they could leapfrog O…

There is already LLM search engines out there https://perplexity.ai

https://weaviate.io/ also allows for generative search.

Re: Bard and new AI features in Search

#515

Post by Agraillo »

qwertox wrote: post #175

There's a Product from Google which I like very much: "Discover" in Google Chrome on Android devices. It is similar to what the normal "Google" app offers: snippets with links to articles which may either be currently relevant for me (currently as in: this day you searched a lot for X, so we recommend you Y), or which may be a bit older but still of interest to me. A personalized Google News but much less news orient…

At least for this audience there's much less sophisticated algorithm for discovering - F5 on Hacker News

Re: Bard and new AI features in Search

#516

Post by dougmwne »

indeedmug wrote: post #461
dougmwne wrote: post #384

Earlier quoted context omitted.

Search is so very bad. I tried to figure out what the largest MicroSD card was and was served ads and real results to buy fake 2tb cards from Amazon. Several searches were useless packed with ads and SEO spam. Only Reddit could tell me that the largest currently available card is 1tb. It left me pretty shocked at how bad it’s gotten.

I looked up "largest available microsd" and the first item was a pop up box that said the largest available one is 1TB. I put the same query into bing and the result as the same. That's not to say that happen to you didn't happen. Information on the internet evolves rapidly and far from static. One problem is that people game Google with SEO. We end up with an arms race of people gaming signaling for information and…

That’s entertaining, because I just tried your query. I got this from the Google curated info, all of which is wrong:

(Summarizing) People also ask

What’s the largest MicroSD card you can get? 256gb (wrong)

Will there be a 2tb card? Yes (press release of company I’ve never heard of that I’m pretty sure is not legit.)

What the largest card you can get? 512gb with 1 and 2 on the horizon. (Out of date and also wrong, no legit company has announced a 2tb)

Who makes a 2tb card? (List of companies that are scammers and make fake cards.)

Do 1tb cards work? All 1tb cards are fake (wrong or out of date)

Re: Bard and new AI features in Search

#517

Post by rippercushions »

pphysch wrote: post #397
gchokov wrote: post #279

Earlier quoted context omitted.

Sundar did nothing but failed projects. Google is still where it was many years ago.

My Google phone can instantly translate almost any foreign language, embedded in an image, without an internet connection. Pretty sure that was not a thing 8 years ago. If/when Google embeds an (local and/or lightweight) Bard model into every Pixel phone, that will be a game-changer.

That's WordLens, which Google acquired in 2014, 9 years ago.

https://techcrunch.com/2014/05/16/google-has-acquired-quest-...

Re: Bard and new AI features in Search

#518

Post by dzdt »

cypress66 wrote: post #513
dzdt wrote: post #462

How many parameters? The LaMDA paper describes 2B, 8B, and 137B parameter variations. Sundar says "We're releasing initially with our lightweight model version of LaMDA. This much smaller model..." So it sounds like the 2B or 8B model variations, compared to GPT3's 175B. [edit: corrected] I can't imagine such a smaller model coming across as anything near as impressive as ChatGPT. So the announcement today is for a m…

GPT3 is 175B parameters, but I agree with you.

Oops. Corrected. Thanks.

Re: Bard and new AI features in Search

#519

Post by afro88 »

Bit of a sidebar, but I find it sad that people use AI tools to connect with their kids. Whether it's getting it to make up a little story for them to tell, or a fully illustrated book, or in the case of the gif from this post: a list of recent discoveries made by the James Webb telescope that the AI thinks a 9 year old might like.

Re: Bard and new AI features in Search

#520

Post by Denzel »

alain94040 wrote: post #388
wiremine wrote: post #232

I agree this is bland corporate speak. But it reminded me of a question that's been floating around: A number of pundits, here on HN and elsewhere, keep referring to these large language models are "google killers." This just doesn't make sense to me. It feels like Google can easily pivot its ad engine to work with the AI-driven chat systems. It can augment answers with links to additional sources of information, be…

Those new language models are "Google killers" because they reset all the assumptions that people have made about search for several decades. Imagine that people start using those chat bots massively as a replacement for Google search. Then the notion of keyword disappears. Google AdSense becomes mostly irrelevant. Of course, Google is a giant today with a history of machine learning innovation. So they have a good c…

All these conversations have one glaring omission. As it stands right now, ChatGPT is a net negative on the ecosystem it exists in. What does that mean?

ChatGPT extracts value from the ecosystem by hoovering up primary sources to provide answers, but what value does ChatGPT give back to these primary sources? What incentivizes content creators to continue producing for ChatGPT?

Right now, nothing.

ChatGPT (or its descendants) must solve this problem to be economically viable.

Post reply on HN