Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Bard and new AI features in Search

blog.google

Post reply on HN
Print view View original

871–880 of 1000 posts

Re: Bard and new AI features in Search

#871

Post by fomine3 »

yunwal wrote: post #550
scarmig wrote: post #396

Earlier quoted context omitted.

Google has far more resources for training models and inference. Likely more than all their nearest competitors combined.

If you’re talking about physical hardware, Google pales in comparison to Amazon, and Gcloud is still smaller than Azure. It’s possible google’s private compute makes up for the Azure difference but it’s not like they’re in different leagues in terms of access to hardware.

I suspect that Google's own usage (search, YouTube, CDN, etc) is still bigger than GCP, is it correct?

Re: Bard and new AI features in Search

#872

Post by ohashi »

nabakin wrote: post #852
tstrimple wrote: post #699

Earlier quoted context omitted.

The incentive to what, be an unpaid content creator for Google? Search results lead to sources which land users on the content creators "property". Chat results, especially based on what we see right now, won't do that.

How can you call garbage SEO websites 'content creators'? I think we'll be better off with websites which spread knowledge for the sake of spreading knowledge. Down with ads and low quality copy-paste sites.

So everything being done for free except for Google taking all the profits?

Are you kidding me?

People need to make a living, creating good content isn't easy. Sure a few folks do it for free, but wholesale trying to kill off everyone who does it by making it financially non-viable is long term idiotic. What are you going to train on once everyone stops writing or letting your scrape their data to train from?

Search engines scraping your content is an agreement that they can look at it and use it, and send you traffic if it matches well with a user. Why would anyone subscribe to a deal that there is literally zero benefit except training some AI which will repurpose your knowledge.

Re: Bard and new AI features in Search

#873

Post by waynesonfire »

firefeathered wrote: post #807
somenameforme wrote: post #779

Earlier quoted context omitted.

GLM-130B[1] is something comparable to GPT-3. It's a 130billion parameter model vs GPT-3's 175 billion, and it can comfortably run on current-gen high end consumer level hardware. A system with 4 RTX 3090s ( The proverbial 'some guy on Twitter'[2] got it setup, and broke down the costs, demonstrated some prompts, and what not. The output's pretty terrible, but it's unclear to me whether that's inherent or a result of…

Stable diffusion can already run on an iphone. Hopefully that trend will come to LLMs too.

Oh it will. We'll be asking our iphone questions and it'll be returning seo spam and ads for viagra in a chatbox. Meanwhile, the big boys get the firehose feed.

Re: Bard and new AI features in Search

#874

Post by bzbee10 »

Here's a concrete scenario: StackOverflow makes money because people go to it for answers to their questions. The answers are provided by people who write them because they get points for providing good answers, that they use for reputation points to get good jobs. It's an ecosystem. Everybody profits. Now Google scrapes the contents, and provides a service where you just ask your question and it gives the best, most accurate answer. Nobody goes to StackOverflow any more. People stop posting answers, because nobody asks the questions, and nobody reads their answers any more. StackOverlow goes under, and the ecosystem dies. Where does Google gets its information now? The feeder pipeline has died.

Re: Bard and new AI features in Search

#875

Post by arbol »

bzbee10 wrote: post #874

Here's a concrete scenario: StackOverflow makes money because people go to it for answers to their questions. The answers are provided by people who write them because they get points for providing good answers, that they use for reputation points to get good jobs. It's an ecosystem. Everybody profits. Now Google scrapes the contents, and provides a service where you just ask your question and it gives the best, most…

I use github copilot to create simple functions by typing the function name and copilot does the rest. This works reasonably well for basic stuff. It becomes unhelpful and starts creating incorrect paths to library functions as soon as you add your work context.

Re: Bard and new AI features in Search

#876

Post by jb1991 »

arbol wrote: post #875
bzbee10 wrote: post #874

Here's a concrete scenario: StackOverflow makes money because people go to it for answers to their questions. The answers are provided by people who write them because they get points for providing good answers, that they use for reputation points to get good jobs. It's an ecosystem. Everybody profits. Now Google scrapes the contents, and provides a service where you just ask your question and it gives the best, most…

I use github copilot to create simple functions by typing the function name and copilot does the rest. This works reasonably well for basic stuff. It becomes unhelpful and starts creating incorrect paths to library functions as soon as you add your work context.

This doesn't address the parent's excellent question: how do these models continually get trained and updated if they put their key sources of training data out of business?

Related: I'd be quite worried if I was a Q/A site like StackOverflow or Quora.

Re: Bard and new AI features in Search

#877

Post by abliefern »

jb1991 wrote: post #876
arbol wrote: post #875

Earlier quoted context omitted.

I use github copilot to create simple functions by typing the function name and copilot does the rest. This works reasonably well for basic stuff. It becomes unhelpful and starts creating incorrect paths to library functions as soon as you add your work context.

This doesn't address the parent's excellent question: how do these models continually get trained and updated if they put their key sources of training data out of business? Related: I'd be quite worried if I was a Q/A site like StackOverflow or Quora.

> This doesn't address the parent's excellent question

That's a large part of HN in a nutshell.

Re: Bard and new AI features in Search

#878

Post by hcks »

bzbee10 wrote: post #874

Here's a concrete scenario: StackOverflow makes money because people go to it for answers to their questions. The answers are provided by people who write them because they get points for providing good answers, that they use for reputation points to get good jobs. It's an ecosystem. Everybody profits. Now Google scrapes the contents, and provides a service where you just ask your question and it gives the best, most…

I don’t understand this scenario. If someone already posted the answer then asking the question again on SO has no value. If the LLM can automate giving answers then we don’t need SO as much as before.

Re: Bard and new AI features in Search

#879

Post by simiones »

hcks wrote: post #878
bzbee10 wrote: post #874

Here's a concrete scenario: StackOverflow makes money because people go to it for answers to their questions. The answers are provided by people who write them because they get points for providing good answers, that they use for reputation points to get good jobs. It's an ecosystem. Everybody profits. Now Google scrapes the contents, and provides a service where you just ask your question and it gives the best, most…

I don’t understand this scenario. If someone already posted the answer then asking the question again on SO has no value. If the LLM can automate giving answers then we don’t need SO as much as before.

> If the LLM can automate giving answers then we don’t need SO as much as before.

This is probably the misunderstanding: the LLM can only automate giving answers because it has been trained on all of SO (or other similar communities). It's a summary of SO, not an alternative to it. When new problems arise, the LLM will need to be re-trained to include the new SO answers, it will not be able to synthesize new knowledge.

So, if SO is dead, the LLM can't get the info anymore to answer questions about new topic - but you won't be able to tell for a long time, long enough to kill SO most likely (assuming this actually gets traction, of course).

Re: Bard and new AI features in Search

#880

Post by Kiro »

bzbee10 wrote: post #874

Here's a concrete scenario: StackOverflow makes money because people go to it for answers to their questions. The answers are provided by people who write them because they get points for providing good answers, that they use for reputation points to get good jobs. It's an ecosystem. Everybody profits. Now Google scrapes the contents, and provides a service where you just ask your question and it gives the best, most…

Google already shows snippets from SO and has done so for years, without AI. Why would this be any different?
Post reply on HN