I agree this is bland corporate speak. But it reminded me of a question that's been floating around: A number of pundits, here on HN and elsewhere, keep referring to these large language models are "google killers." This just doesn't make sense to me. It feels like Google can easily pivot its ad engine to work with the AI-driven chat systems. It can augment answers with links to additional sources of information, be…
Those new language models are "Google killers" because they reset all the assumptions that people have made about search for several decades. Imagine that people start using those chat bots massively as a replacement for Google search. Then the notion of keyword disappears. Google AdSense becomes mostly irrelevant. Of course, Google is a giant today with a history of machine learning innovation. So they have a good c…
Bard and new AI features in Search
531–540 of 1000 posts
Re: Bard and new AI features in Search
#532Earlier quoted context omitted.
I guess a couple of reasons: 1) Because it is disruptive. Things may get shook up, and Google may not end up in as exclusive position as they are currently in. There's risk. 2) Because it's not obvious how advertising would fit in with a conversational interface. Google may stay as #1 search/answer engine, but would revenue be adversely affected?
Banner, sidebar, in-line, interstitial, modal… what advertising modes wouldn’t work on conversational interface?
Re: Bard and new AI features in Search
#533Earlier quoted context omitted.
The announcement is probably targeting Wall Street more than any potential "user" (aka advertising target). The press was already bad - internal "code red" at Google due to panic that people saw ChatGPT as an alternative to search. Meta/FaceBook's head of AI, Yann LeCun, is in similar panic mode, issuing a non-stop torrent of tweets about how useless and unimpressive ChatGPT has... Presumably a reflection that FaceBo…
FWIW, Facebook's AI division has made some pretty insane contributions to the field relative to Google or Apple. I wouldn't disregard the stuff they're doing, even if I personally don't have a stake in Facebook or Meta's success.
Re: Bard and new AI features in Search
#534Question for AI experts out there: ChatGPT is awesome, but it is obviously hamstrung by the fact that it crawled the web at the end of 2021, so all of its data is essentially "frozen" and it doesn't "know" of any topics that occurred after 2021. Seems to me like the next "holy grail" in large language models is building a model that can be continually updated. If Google can achieve that, I think they could leapfrog O…
There is already LLM search engines out there https://perplexity.ai
Re: Bard and new AI features in Search
#535Earlier quoted context omitted.
For a chatbot, it's a feature. For the large proportion of search queries that are "give me context for $newsitem", "what is $latestthing", "what is $celebrity up to", "can you solve my problem with the latest version of x" it's a show stopping bug (frankly Google weighting established content higher in most contexts is already an issue for the last of those queries: Googling error messages etc). And at least all the…
I'm not sure if, from the perspective of consumers, it's a feature or a bug. Sort of the only thing keeping ChatGPT or equivalent from being a massive blogspam creator that puts mostly young writers cranking out content for pennies out on the street is that it can only create relatively evergreen content.
Re: Bard and new AI features in Search
#536Earlier quoted context omitted.
There’s a smaller surface are for ads in a targeted chat session. At present, Google can show me ads on the results page. Each subsequent result that I view is an additional slice of my attention. It’s possible that Google can deliver a few targeted ads, but what if they can’t? What about the rest of the market that’s now gone? Possible that all those missed opportunities remove the ability to discover price.
You completely ignore the fact that companies will show ads everywhere, there is no reason that they would not try to inject ads into chat. "Here is the answer to your question about oranges. But did you know Tropicana is made from 100% real orange juice?" "A project manager is a ... Often the software project managers use is Zoho Projects for the best agile sprint planning" If they can put ads in it, there will be a…
Re: Bard and new AI features in Search
#537Anybody remember how we used to learn new words and build our vocabulary? Perhaps it went something like: "What does this word mean"? "Look it up in the dictionary" "Why can't you just tell me??" I remember the hassle of looking things up in a paper dictionary. Over the long term, it massively helped improve my ability to not just recall a simple definition, but also learn new words, as they were adjacent to what I w…
This sounds an awful lot like email's "Spam" folder, an AI driven bullshit detector that I am particularly fond of.
Re: Bard and new AI features in Search
#538Re: Bard and new AI features in Search
#539Earlier quoted context omitted.
> So my question is, how hard of a problem is that with LLMs? I get the sense that LLMs are trained on a very large data set all at once, but that it is difficult to incrementally update them with new data. It's the opposite. Getting an LLM to learn the basics of grammar and paragraph-level language structure is the "hard" part. Once you have that, further fine-tuning, specialisation, or other incremental changes are…
It's not about "Well behaved." All we're teaching it is our biases.
Re: Bard and new AI features in Search
#540Question for AI experts out there: ChatGPT is awesome, but it is obviously hamstrung by the fact that it crawled the web at the end of 2021, so all of its data is essentially "frozen" and it doesn't "know" of any topics that occurred after 2021. Seems to me like the next "holy grail" in large language models is building a model that can be continually updated. If Google can achieve that, I think they could leapfrog O…
> So my question is, how hard of a problem is that with LLMs? I get the sense that LLMs are trained on a very large data set all at once, but that it is difficult to incrementally update them with new data. It's the opposite. Getting an LLM to learn the basics of grammar and paragraph-level language structure is the "hard" part. Once you have that, further fine-tuning, specialisation, or other incremental changes are…
Like - hmm. I could see taking a snapshot after the grammar/language stuff is in, and then every N weeks retraining on the current web, adding in something about recentness, but that doesn't seem like "continuous" training.
I'd imagine "continuous" training would be, well, going on continuously, all the time, but that would mean that, to include "recentness", something would have to change with the weights that were from that "old" stuff, which sounds an awful lot like the human process of "forgetting".