My ONLY question: where's imagen?
Bard and new AI features in Search
991–1000 of 1000 posts
Re: Bard and new AI features in Search
#992Earlier quoted context omitted.
I think the point is when taking information from some source (like the web) to just represent that source fairly, which is a reasonable expectation of a search engine, for example.
"Fair" isn't well-defined. Is it "fair" if Amazon results are seen as "more trustworthy" than a random new startup web store? Even ignoring SEO manipulation of any rules publicly believed to exist, that's the default outcome for things like PageRank. Going beyond sources to conclusions, given LLMs aren't search engines and do synthesise results: Politically, low-tax advocates see it as "fair" for people to take home…
Well, I think you're going beyond the parameters of the discussion... LLMs synthesize datasets and that is all they do. They are not reasoning agents and they don't have opinions about anything. All we can say is that they reflect the biases inherent in the dataset, and to say anything else would be dishonest at best. It's only because most people have no idea how these things work that we get all this magical thinking.
Re: Bard and new AI features in Search
#993Earlier quoted context omitted.
1- the chips are not efficient currently (graphic card reused as neural net) 10X-100X gain 2- Moore’s Laws 3- Algorithm/architecture improvement
1. Im not sure who you believe will produce these chips, or who will use them. You are correct that specialized inference chips will get you a 10x gain. So what? If you want several million of them in a datacenter, that's a tall order. That's on top of A. the hundreds of millions it will take to get a design to production. B. The complete and total lack of allocation at anybody who could make you chips, except at ver…
I am thinking about Tesla with Dojo and Tenstorrent.
Both have a similar architecture (different scale) where they dich most of the vram for a fabric of identical cores.
Instead of being limited by the vram bandwidth they run at the chip speed.
Nvidia/Intel/AMD/Apple/Google and others surely have plans underway.
As the demand for AI grow (now clear that there is a huge market) I think we will see more players enter this field.
The landscape of software will have a dramatic shift, how much of the current cpu running in datacenter will be chips for AI in the future, I think it will be most of them.
Jim Keller has a few good interviews about it.
Re: Bard and new AI features in Search
#994Earlier quoted context omitted.
And META reportedly has spent billions on the meta-verse. It's kind of interesting that language models are now making meta-tech look outdated. Then again maybe language models will create the metaverse
Did metaverse ever not look like a VR rehash of second life? I’m genuinely curious, I‘ve had VR headsets since Oculus DK1 I’ve never seen anything very compelling on the VR persistent alternate reality front.
Metaverse wanted to do what VRChat had already done tbh. VRChat just needs polish & moderation/to create a proper platform.
Realistically VR clients needs to pose as browsers to load vr:// links which can be connected to objects/actions in VR ie
That way it's done in an open, browsable way compatible with the expectations that we've gained from regular web experiences. Ie you have your VR home, there's a "bookmark" door you can walk through to go to Amazon's showroom, you search for a particular product and it lets you walk around and pick-up and examine the various options, you can then jump to a particular brand's individual showroom, etc.
Some people might feel that's a little dystopian I suppose but I think it's cool.
Re: Bard and new AI features in Search
#995Earlier quoted context omitted.
Those new language models are "Google killers" because they reset all the assumptions that people have made about search for several decades. Imagine that people start using those chat bots massively as a replacement for Google search. Then the notion of keyword disappears. Google AdSense becomes mostly irrelevant. Of course, Google is a giant today with a history of machine learning innovation. So they have a good c…
All these conversations have one glaring omission. As it stands right now, ChatGPT is a net negative on the ecosystem it exists in. What does that mean? ChatGPT extracts value from the ecosystem by hoovering up primary sources to provide answers, but what value does ChatGPT give back to these primary sources? What incentivizes content creators to continue producing for ChatGPT? Right now, nothing. ChatGPT (or its des…
The majority of content on the web is just rehashes/remixes/duplication of existing content. The percentage of unique, original content is small in comparison, imo.
Ie there may be 10-100 news articles about an event all with the same source. Youtube has tonnes of duplication/"reaction" videos where the unique content portion is very minimal.
Re: Bard and new AI features in Search
#996Earlier quoted context omitted.
Potentially good for users initially. But I can't see how anyone will be incentivized to create and post content for Google to scrape if they won't have any traffic from Google. It could actually be a huge benefit in some ways if it chokes out the content mills. However, something tells me that they have little to no overhead compared to the people who actually toil away to post good, original content.
Website are not posting content for the sake of Google scraping it currently anyways. Look at reddit for example: fake internet points
Ya, but if you don't get fake internet points or any responses/comments on your work, what will be the incentive.
Re: Bard and new AI features in Search
#997Earlier quoted context omitted.
The point was not that the profits are long tailed but rather if openai thought there were massive future profits and the potential to become a google killer then they wouldn’t give away half of their company today for $10B.
To me, the fact that MSFT invested on these terms doesn’t mean that the financials are shaky, it means that there’s a huge first mover advantage as well as a huge start up cost. OpenAI could make their money back or they could get taken out back by Google if they’re bottlenecked by cash.
OpenAI is projected to make 200m in 2023 and 1bn in revenue in 2024. If they can (roughly) keep this YoY growth rate, they will become a money printer in 3–5 years.
Re: Bard and new AI features in Search
#998Earlier quoted context omitted.
I guess a couple of reasons: 1) Because it is disruptive. Things may get shook up, and Google may not end up in as exclusive position as they are currently in. There's risk. 2) Because it's not obvious how advertising would fit in with a conversational interface. Google may stay as #1 search/answer engine, but would revenue be adversely affected?
I think it could fit in with a conversational chat bot the same way that ads are part of podcasts and YouTube channels: a conversational and explicit ad that helps pay for the otherwise freely available content. Full disclosure: I work at Google, but nowhere near the chatbot stuff. This is my humble opinion and nothing more.
The problem with this is that it pretty explicitly makes the chatbot a worse product. The beauty of google ads is that they don't degrade the service. If they're not interesting just scroll right past. I don't think people would use the adbot service if Bing is providing a competitor that only has banner ads or maybe a clearly marked ad link. Bing wins because they go from making no money on search to some, but if google copies the strategy their market size is destroyed.
Re: Bard and new AI features in Search
#999Earlier quoted context omitted.
It still can be a Google killer even if Google comes up with something better because Google makes its money from sending people to the highest bidder. So far there's no clear path to make money from ChatGPT, let alone match the sum Google is making from Search. If this new paradigm dominates the way people use computers and it's not as profitable as Search, Google might indeed have to scale back.
ChatGPT can make money by subscriptions, or they can also put ads next to the chat?
Can they make $100 billion a year profit?
Re: Bard and new AI features in Search
#1000Earlier quoted context omitted.
1. Im not sure who you believe will produce these chips, or who will use them. You are correct that specialized inference chips will get you a 10x gain. So what? If you want several million of them in a datacenter, that's a tall order. That's on top of A. the hundreds of millions it will take to get a design to production. B. The complete and total lack of allocation at anybody who could make you chips, except at ver…
I think you missed the TPU, which is a Google chip that gets you the 10x in inference, and there are millions of them ALREADY in the datacenters, designed, fabricated and installed. You can use one, for free, with Colab
I know a surprising amount about of Google and TPU's :)
This is not accurate - they are neither cheap nor really built for inference.
I'd have to go look hard at what is public vs not if you want me to go into more.