Live data from Hacker News

PaLM 2 Technical Report [pdf]

ai.google

171–180 of 297 posts

Re: PaLM 2 Technical Report [pdf]

#171
post #169

Earlier quoted context omitted.

> Btw I've arrived at a different interpretation of the "Open" in OpenAI. I don't understand why people have to keep trying to wrap their head around the word 'Open' in OpenAI. If you ever saw a commercial like a product has a 'great new taste' but then you tried it and it tasted bad, would you twist yourself into knots trying to understand how you went wrong in your interpretation of 'great'? No that's ridiculous. S…

You mean when they filled out a form to incorporate their non-profit. Which they later turned into a for-profit company after reaping all the goodwill. The “Open” used to mean something.

[deleted]

Re: PaLM 2 Technical Report [pdf]

#172
post #169

Earlier quoted context omitted.

> Btw I've arrived at a different interpretation of the "Open" in OpenAI. I don't understand why people have to keep trying to wrap their head around the word 'Open' in OpenAI. If you ever saw a commercial like a product has a 'great new taste' but then you tried it and it tasted bad, would you twist yourself into knots trying to understand how you went wrong in your interpretation of 'great'? No that's ridiculous. S…

You mean when they filled out a form to incorporate their non-profit. Which they later turned into a for-profit company after reaping all the goodwill. The “Open” used to mean something.

That is a bit reductionist. They turned it into a for-profit company controlled by a non-profit entity, with profits / returns being capped for employees / investors.

Re: PaLM 2 Technical Report [pdf]

#173
post #26

Earlier quoted context omitted.

- are you on PaLM 2 right now? - Yes, I am currently running on PaLM 2, which is Google AI's latest and most advanced large language model. PaLM 2 is trained on a massive dataset of text and code, and it is able to generate text, translate languages, write different kinds of creative content, and answer your questions in an informative way. PaLM 2 is still under development, but it has learned to perform many kinds o…

Yeah, but Reset the chat between your questions. EDIT: Also, this doesn't seem convincing: "I am not as advanced as PaLM 1, but I am learning new things every day. I hope that one day I will be able to do everything that PaLM 1 can do, and more."

So I also ran this test with resetting and it did identify itself repeatedly as PaLM 2

Re: PaLM 2 Technical Report [pdf]

#174

Earlier quoted context omitted.

It's a language model, FFS. Ask it whether it uses PaLM 1 and it will confirm it as well.

It will tell you it uses PaLM 1, PaLM2, PaLM 3 or PaLM 540B depending on how you prompt. It will stop acknowledging incremental PaLM models at 5 it seems.

So, I tried that and that was not the case for me. It actually generated response that its on PaLM 2 and I ask for all these permutations.

Re: PaLM 2 Technical Report [pdf]

#175
post #68

So, I asked Bard if it's using PaLM 2 and it did confirm it. My initial results are super promising. Highly recommend checking it out again.

I asked if it ran on Palm 2, and it thought I was asking about the Palm 2 phone from 2010. “I do not use a physical device such as a smartphone or tablet. I am a software program that runs on Google's servers. As such, I do not have a Palm 2 or any other type of mobile device”

I did also but if you ask PaLM 2 it interpreted the result differently

Re: PaLM 2 Technical Report [pdf]

#176
post #85

Earlier quoted context omitted.

There is a limit of maxOutputTokens, 1024! Is this the true capability of PaLM 2? However I couldn't find anything about the context length of their model anywhere. And the API didn't tell me how long the prompt could be.

No. Autoregressive models don't have model specific limit to output tokens, it's just when to stop looping.

I guess I only know transformers and how BERT or GPT works, as there would be a limit in the context length. With GPT, you can certainly generate infinite amount of tokens but the previous tokens outside of the maximum context length would be outside of the context window. LLaMa has 2k, GPT-4 has 32k.

Are you saying I can give unlimited tokens to PaLM and generate unlimited amount of tokens? So PaLM doesn't have a context limit?

Re: PaLM 2 Technical Report [pdf]

#177
post #151

Earlier quoted context omitted.

It's a language model, FFS. Ask it whether it uses PaLM 1 and it will confirm it as well.

Just let people be monumentally stupid like this. You can't correct it.

Sorry, can you elaborate? I would like to learn. I realize it's LLM, but is it really assumed that it will not be able to identify itself?

Re: PaLM 2 Technical Report [pdf]

#179
post #169

Earlier quoted context omitted.

Btw I've arrived at a different interpretation of the "Open" in OpenAI. It's open in the sense that the generic LLM is exposed via an API, allowing companies to build anything they want on top. Companies like Google have been working on language models (and AI more broadly) for years but have hid the generic intelligence of their models, exposing it only via improvements to their products. OpenAI bucked this trend an…

> Btw I've arrived at a different interpretation of the "Open" in OpenAI. I don't understand why people have to keep trying to wrap their head around the word 'Open' in OpenAI. If you ever saw a commercial like a product has a 'great new taste' but then you tried it and it tasted bad, would you twist yourself into knots trying to understand how you went wrong in your interpretation of 'great'? No that's ridiculous. S…

This. Exactly.

Re: PaLM 2 Technical Report [pdf]

#180
post #163
post #84

Earlier quoted context omitted.

why don't you just use chatGPT? from what i know it's running GPT3.5 and it's not that different (at least in terms of code quality)

When my 25 queries per 3 hours runs out I don't use openai at all. That's how bad chat gpt is in comparison to gpt4 in my use cases.

[deleted]
Post reply on HN