I don't think Google will win this race, not because they lack the technical expertise, but because they are too cheap. This is so telling: "We’re releasing it initially with our lightweight model version of LaMDA. This much smaller model requires significantly less computing power, enabling us to scale to more users, allowing for more feedback" They are richer than Croesus, that is no reason for them to hold back an…
The actual product is the user interactions. ChatGPT etc is trained on examples in the thousands. What google will be doing is trying to get 100s of millions of labelled interactions by getting the users to do it for them. Then they’ll use those to train its final model.
Google just launched Bard, its answer to ChatGPT
71–80 of 81 posts
Re: Google just launched Bard, its answer to ChatGPT
#72Earlier quoted context omitted.
That's pretty surprising it can't do the months in alphabetical order. I just tried with LLaMA 30B. This is running on my MacBook Air with llama.cpp, quantized to 4 bits, and is a "raw" model (not alpaca / instruction tuned at all). Obviously some models will be better at some things (and will have different outputs given the same inputs) and worse at other, but you'd think Bard would be able to do that pretty simple…
> Bob: Certainly. January, February, March, April, May, June, July, August, September, October, November, December. > User: That's not in alphabetical order. Redo. > Bob: Sorry about that. Here are the months again, this time in alphabetical order: April, August, December, February, July, June, March, May, November, October, September. (Also LLaMA, 30B, llama.cpp on x86 Processor) At least LLaMA sees its mistake and…
Re: Google just launched Bard, its answer to ChatGPT
#73Earlier quoted context omitted.
> Bob: Certainly. January, February, March, April, May, June, July, August, September, October, November, December. > User: That's not in alphabetical order. Redo. > Bob: Sorry about that. Here are the months again, this time in alphabetical order: April, August, December, February, July, June, March, May, November, October, September. (Also LLaMA, 30B, llama.cpp on x86 Processor) At least LLaMA sees its mistake and…
er... "You missed out January, try again"?
> User: Almost, but you missed January. Try again.
> Bob: Okay. Let's see...January, February, March, April, May, June, July, August, September, October, November, December.
Very brittle.
Re: Google just launched Bard, its answer to ChatGPT
#74Google looks to be caught in an innovator dilemma. They can’t roll out a good chat system comparable to its competitors because it directly competes with their core revenue stream of search. From my angle, LLM’s are the next big step in search. If the company whose core business revolves around search can’t update their product to meaningfully compete with their competitors who view search as a side business, it shou…
>Google looks to be caught in an innovator dilemma. They can’t roll out a good chat system comparable to its competitors because it directly competes with their core revenue stream of search. That's one way to look at it. The other is the immense advertising opportunity these systems can provide. You no longer need to perform multiple queries and various results to get your answer. You're now essentially in a walled…
Yup. We are entering the age of Advertising God Mode.
Google and Facebook are both going to train these LLMs directly at individual users. They're going to feed it all your email, texts, posts, comments, and page views and these systems are going to fill your feeds with bespoke advertising content that is lovingly crafted by the AI to appeal to you. No longer just product->user matching, but actual ad copy and images will be AI-tailored to wedge its way into your psyche. We have no chance against this kind of commercial psy-ops.
Re: Google just launched Bard, its answer to ChatGPT
#75I don't think Google will win this race, not because they lack the technical expertise, but because they are too cheap. This is so telling: "We’re releasing it initially with our lightweight model version of LaMDA. This much smaller model requires significantly less computing power, enabling us to scale to more users, allowing for more feedback" They are richer than Croesus, that is no reason for them to hold back an…
You're making the assumption that quality is the only feature that matters, rather than it being a multi- dimensional tradeoff where we don't know at all what tradeoffs consumers actually prefer. For example, a smaller model will run faster, right? At this exact moment, ChatGPT is giving me about a word every 2-3 seconds. It's basically useless. But even when the system is not overloaded, there's a noticeable delay.…
Re: Google just launched Bard, its answer to ChatGPT
#76Earlier quoted context omitted.
4 months after ChatGPT is "too little too late"? Where does this entitlement come from?
There were like at least 60 LLama and alpaca releases in the last 3 weeks! Google needs to be at least 3x better!!
And from what I see, none of these models are as good as ChatGPT so what's the point of counting them?
Re: Google just launched Bard, its answer to ChatGPT
#77Earlier quoted context omitted.
gpt4: months in alphabetical order Here are the months in alphabetical order: April August December February January July June March May November October September
I've never seen the months listed in alphabetical order before. And it's absolutely breaking my brain. Which is a reaction I did not expect. It looks so wrong .
Re: Google just launched Bard, its answer to ChatGPT
#78Google looks to be caught in an innovator dilemma. They can’t roll out a good chat system comparable to its competitors because it directly competes with their core revenue stream of search. From my angle, LLM’s are the next big step in search. If the company whose core business revolves around search can’t update their product to meaningfully compete with their competitors who view search as a side business, it shou…
This observation made me re-interpret the motivation behind Zuckerberg's attempt to start the "metaverse." If Meta's core business of advertising on social media becomes irrelevant, his company is in trouble. But if the company is already the leader of the technology that replaces social media—e.g. connections over VR—the company can remain a leader and keep growing. Zuckerberg might be wrong that the "metaverse" is…
Re: Google just launched Bard, its answer to ChatGPT
#79Earlier quoted context omitted.
You're making the assumption that quality is the only feature that matters, rather than it being a multi- dimensional tradeoff where we don't know at all what tradeoffs consumers actually prefer. For example, a smaller model will run faster, right? At this exact moment, ChatGPT is giving me about a word every 2-3 seconds. It's basically useless. But even when the system is not overloaded, there's a noticeable delay.…
Basically useless? I use it to write articles for me[0], hardly could a human turn text around as fast, and I both do not pay it nor owe it anything. It could be slower still, and if you went back just 5 years to 2018 it would seem a miracle to our past selves, just for the quality output. [0]: https://generativereview.substack.com/p/the-generative-revie...
Re: Google just launched Bard, its answer to ChatGPT
#80Google Bard waitlist - https://news.ycombinator.com/item?id=35246260 - March 2023 (386 comments)
Also related:
Bard uses a Hacker News comment as source to say that Bard has shut down - https://news.ycombinator.com/item?id=35255864 - March 2023 (194 comments)
Bard is much worse at puzzle solving than ChatGPT - https://news.ycombinator.com/item?id=35256867 - March 2023 (78 comments)