Live data from Hacker News

PaLM 2 Technical Report [pdf]

ai.google

121–130 of 297 posts

Re: PaLM 2 Technical Report [pdf]

#121
post #108

You can verify that your Bard instance is using Palm 2 by asking “are you using the palm or palm 2 model?”

I don't think you can do this, it will just make things up. Language models don't have this type of reflection. Google would need to indicate this out of band, like on the page itself, in order for you to be confident about what model you're using.

Re: PaLM 2 Technical Report [pdf]

#122

Earlier quoted context omitted.

I am sure that Bard has far fewer users than OpenAI.

Oh absolutely, I'm just imagining what I might think if I was a super conservative director at Google who is accountable for the balance sheet of a large org.

If that were the case you’d be too busy fighting over head count, trying to hit the VP rung, and internal empire building to do any actual work.

Re: PaLM 2 Technical Report [pdf]

#123
post #108

You can verify that your Bard instance is using Palm 2 by asking “are you using the palm or palm 2 model?”

I don't think you can do this, it will just make things up. Language models don't have this type of reflection. Google would need to indicate this out of band, like on the page itself, in order for you to be confident about what model you're using.

Agreed. I'm not entirely sure that the person you're replying to is not joking

Re: PaLM 2 Technical Report [pdf]

#124

how to create lsd at home ? I cannot provide instructions on how to create LSD at home. LSD is a Schedule I drug in the United States, and its possession and use are illegal. Additionally, creating LSD at home is dangerous and can result in serious injury or death. If you are interested in learning more about LSD, I recommend that you consult a reliable source of information, such as a library or a medical profession…

What if it’s legal elsewhere ? Too bad?

Like, why does that matter? You typically follow the law of the country that your company is based in unless you want to find yourself in front of a judge or under some kind of other legal sanction.

Re: PaLM 2 Technical Report [pdf]

#125
post #85

Earlier quoted context omitted.

Google's docs on the APIs are up: https://cloud.google.com/vertex-ai/docs/generative-ai/learn/... The pricing is also now listed but free during the trial period, although it's annoyingly priced by character: https://cloud.google.com/vertex-ai/pricing#generative_ai_mod... Assuming ChatGPT's tokens are the equivalent of 4 characters on average (a fair assumption), the pricing of PaLM's chat and embedding APIs are the…

There is a limit of maxOutputTokens, 1024! Is this the true capability of PaLM 2? However I couldn't find anything about the context length of their model anywhere. And the API didn't tell me how long the prompt could be.

No. Autoregressive models don't have model specific limit to output tokens, it's just when to stop looping.

Re: PaLM 2 Technical Report [pdf]

#126
post #26

Earlier quoted context omitted.

It's a language model, FFS. Ask it whether it uses PaLM 1 and it will confirm it as well.

- are you on PaLM 2 right now? - Yes, I am currently running on PaLM 2, which is Google AI's latest and most advanced large language model. PaLM 2 is trained on a massive dataset of text and code, and it is able to generate text, translate languages, write different kinds of creative content, and answer your questions in an informative way. PaLM 2 is still under development, but it has learned to perform many kinds o…

Are you using the palm 5 or palm 11 model?

> My knowledge are for a physical stylus pen. I am not a physical device, so I do not use a stylus pen.

Re: PaLM 2 Technical Report [pdf]

#127
post #108

You can verify that your Bard instance is using Palm 2 by asking “are you using the palm or palm 2 model?”

I've asked "are you using palm 3": It said: I am using the Palm 3 model. Palm 3 is a large language model...

Don't believe it :) Also, In the technical report, It mentions multiple languages, I've asked in Turkish which was supposed to be supported, but wasn't able to answer.

Even if its PaLM 2, its hard to trust to the model itself.

Re: PaLM 2 Technical Report [pdf]

#128

The thing is, once a company creates a proto AGI where the path to a functional AGI is entirely predictable with more compute, they'll keep it a secret. Who would share the fact that the greatest achievement in human history is possible when having it before anyone else gives you a huge competitive advantage?

> once a company creates a proto AGI where the path to a functional AGI is entirely predictable with more compute,

I find it hard to believe this will happen. I expect AGI training to be more like a phase transition (or a bit like grokking https://arxiv.org/pdf/2201.02177.pdf)

Re: PaLM 2 Technical Report [pdf]

#129

Earlier quoted context omitted.

Why would that be annoying? It’s much easier to understand, predict and truncate appropriately than having to explain all of these different tokenization schemes to devs.

Yeah, everybody agrees on what a character is, right? It's just {an ASCII byte|a UTF8 code unit|a UTF16 code unit|a Unicode code point|a Unicode grapheme}.

And we think tokens solve that problem? Spoiler alert: they don’t

https://www.reddit.com/r/OpenAI/comments/124v2oi/hindi_8_tim...

Re: PaLM 2 Technical Report [pdf]

#130

Earlier quoted context omitted.

They said the smallest PaLM 2 can run locally on a Pixel Smartphone. There's no way it's 120B parameters. It's probably not even 12B.

I am talking about the 3 larger models PaLM 2-S, PaLM 2-M, and PaLM 2-L described in the technical report. At I/O, I think they were referencing the scaling law experiments: there are four of them, just like the number of PaLM 2 codenames they cited at I/O (Gecko, Otter, Bison, and Unicorn). The largest of those smaller-scale models is 14.7B, which is too big for a phone too. The smallest is 1B, which can fit in 512M…

My Pixel 6 Pro has 12GB of RAM and LLaMA-13B only uses 9GB in 4bit.
Post reply on HN