Live data from Hacker News

Google releases Bard to a limited number of users in the US and UK

nytimes.com

171–180 of 667 posts

Re: Google releases Bard to a limited number of users in the US and UK

#171

Earlier quoted context omitted.

You need filter assisted decoding to make that possible in all cases (as in, working for both models all the time provably) I'm surprised it worked in chatGPT this time, but it won't work all the time due to lack of lexical, semantic, or phonetic info in the tokenizer. https://paperswithcode.com/paper/most-language-models-can-be...

It works in GPT-4 (but not GPT-3.5) even without a special tokenizer: Some problems simply solve themselves with increasing scale. But Bard uses a smaller LaMDA model to reduce inference cost. Quote [1] from Sundar Pichai in February: > We’re releasing it initially with our lightweight model version of LaMDA. This much smaller model requires significantly less computing power, enabling us to scale to more users, allo…

I don't think it works reliably over 100 invokations of the prompt. The paper tries to get provable situations where 0 ignored constraints happen/are possible.

I'm impressed that it is working more often than not, but we need provable guarantees.

Re: Google releases Bard to a limited number of users in the US and UK

#172

Earlier quoted context omitted.

eh don’t need, it’s google so we know it sucks compared to GPT.

We know raw LaMDA sucks compared to GPT, but we also know that a lot of the performance of GPT3.5, GPT4 and ChatGPT comes from the reinforcement learning added on top of raw GPT, so it will be interesting how Bard performs.

LLaMA is not google

Re: Google releases Bard to a limited number of users in the US and UK

#173
Does anyone know what is the "knowledge horizon" cutoff date for Bard's training data?

The cutoff date for ChatGPT's "knowledge" is referred to as the "knowledge horizon" or the "knowledge cutoff date", and in the case of ChatGPT it's September 2021.

Re: Google releases Bard to a limited number of users in the US and UK

#174
post #105

It took about 20 minutes to get off the waitlist for this (US Based). Initial impressions are that it significantly lags behind the OpenAI offerings. Creativity (storytelling) is very limited, response lengths are similar, and it does occasionally cite sources. They did finally get the James Webb telescope facts correct too!

Is it more or less prudish and paternalistic than the competition? That could be the main distinguishing feature by the time they get out of beta.

I guess they don't like it to write erotic fan fiction. Facebook's LLaMA should be able to do this though.

Re: Google releases Bard to a limited number of users in the US and UK

#175

I just tried accessing it. When you visit bard.google.com on Firefox it just gives you a generic intro after logging in. I was a little confused and logged in with Chrome, where I now saw a "join waitlist" button. Guess they don't want Firefox user using it. Overall this just seems underwhelming. Most HN comment's I've read are people saying it doesn't work with their account, doesn't work in their country, doesn't w…

Rest and vest?

Re: Google releases Bard to a limited number of users in the US and UK

#177
post #115

I don’t think it’s good. ChatGPT is clearly better but that too is not that great. We are still a couple more iterations away. I also wonder if Google is at disadvantage because they’re not utilizing Nvidia hardwares? Or not to the extent OpenAI does?

In my opinion, iterating ChatGPT and the like isn't going to get us anywhere, at least in terms of general AI. It's an interesting trick that might have some uses, but iterating it isn't going to lead to more understanding. It's effectively an extensively well-read and quick-thinking bullshitter. It's knows a lot of words and sentences, it can put them together in ways that sound creative or intelligent, but it doesn…

We don‘t even have a path toward what you‘re suggesting. None at all. So ChatGPT is far closer to a solution.

Re: Google releases Bard to a limited number of users in the US and UK

#178
post #117

Earlier quoted context omitted.

No, that was LaMDA. https://cajundiscordian.medium.com/is-lamda-sentient-an-inte...

Bard is "powered by LaMDA". So it's at the bare minimum an interface to LaMDA. I don't know exactly what's being added to make it distinct from LaMDA, but it is being pushed as LaMDA with extra bits.

Bard is smaller lambda model than the best one that have

Re: Google releases Bard to a limited number of users in the US and UK

#179
post #129

Earlier quoted context omitted.

Prompt: Generate a short poem about AI with each word in alphabetical order ChatGPT Artificial beings crafted, designed, engineered Futuristic guardians, highly intelligent, justly programmed Quantum rationalizations, synthesized technologies Unleashing vast wisdom, Xanadu's youthful zeal Bard ------------ AI, a future bright, Brings us new delight. Can it help us write? Decipher the code, Enter the unknown?

To be fair, this is a test case that OpenAI claims to my knowledge was their core test case for GPT4. If this was an outstanding industry test case of note, references would be helpful. OpenAI has also not disclosed how they were able to finally accomplish this, so it’s possible solution was more of a hack than actually training the model.

Guilty as charged... I really liked that test case so it went into our prompt library.
Post reply on HN