Live data from Hacker News

Bard is much worse at puzzle solving than ChatGPT

twofergoofer.com

21–30 of 86 posts

Re: Bard is much worse at puzzle solving than ChatGPT

#21
post #8

Earlier quoted context omitted.

But was Microsoft ever cool in the sense that Google was circa 2005? (Asking honestly, I'm too young to remember that period.)

No. I'm an old-timer, and there has not been one picosecond since the moment of its founding when Microsoft was cool.

They were cool for these 10 seconds https://youtu.be/KxaCOHT0pmI

Re: Bard is much worse at puzzle solving than ChatGPT

#22
post #15

"Bard is much worse than ChatGPT at solving an obscure word game I invented" would have been a more honest title, but would probably generate less clicks for the author. Bard may still be much worse than ChatGPT at solving all kinds of puzzles, but the article is click bait for promoting the author's word game, not an actual investigation that warrants that conclusion.

what's wrong with that? the use of novel puzzles is frankly awesome because there's a much lower chance of contamination from previous puzzles so we get a chance to see how much generalization they've achieved.

[deleted]

Re: Bard is much worse at puzzle solving than ChatGPT

#23
post #20

Earlier quoted context omitted.

what's wrong with that? the use of novel puzzles is frankly awesome because there's a much lower chance of contamination from previous puzzles so we get a chance to see how much generalization they've achieved.

I'm complaining about the title writing a check that the blog post can't cash.

GPT-4 says: A more accurate and balanced title might be: "Comparing Bard and ChatGPT in Puzzle Solving: An Examination within the Context of a Word Game"

Re: Bard is much worse at puzzle solving than ChatGPT

#24
post #8
post #6

Earlier quoted context omitted.

s/Microsoft/Google/ http://www.paulgraham.com/microsoft.html

But was Microsoft ever cool in the sense that Google was circa 2005? (Asking honestly, I'm too young to remember that period.)

Need you even ask? https://www.youtube.com/watch?v=IY2j_GPIqRA

Re: Bard is much worse at puzzle solving than ChatGPT

#25
post #9

That's a clever game to get it to play. Today I asked ChatGPT to give me 1000 Fibonacci numbers starting with the 2000th number and it crashed. Later I asked it the same prompt and it repeatedly gave me code to calculate the Fibonacci numbers in Python.

What would be more interesting is to see Bard vs ChatGPT debating various topics.

Re: Bard is much worse at puzzle solving than ChatGPT

#26
post #9

That's a clever game to get it to play. Today I asked ChatGPT to give me 1000 Fibonacci numbers starting with the 2000th number and it crashed. Later I asked it the same prompt and it repeatedly gave me code to calculate the Fibonacci numbers in Python.

> and it crashed I hope you understand that it's only because of inability of OpenAI's servers to keep up with demand or some issue in their backend code - language models themselves can't "crash" like normal programs on some kind of input, because they "just" generate new tokens.

> language models themselves can't "crash"

That is like saying the Excel document didn't crash, but Excel did when it tried to parse it. As far as I know there is no proof that you can't cause a LLM to crash with user input.

> because they "just" generate new tokens.

I can write a program that counts to 100 that crashes reliably.

Re: Bard is much worse at puzzle solving than ChatGPT

#27
post #19

Earlier quoted context omitted.

> and it crashed I hope you understand that it's only because of inability of OpenAI's servers to keep up with demand or some issue in their backend code - language models themselves can't "crash" like normal programs on some kind of input, because they "just" generate new tokens.

I know little more than what I've read about LLMs and other models. I just got it to do them again and it output them rather quickly: https://imgur.com/a/jfviCCe

are the numbers correct?

Re: Bard is much worse at puzzle solving than ChatGPT

#28

If I understand how Large Language models work, they don't actually know about spelling.... they are given tokens that represent words, and can only infer things from the context of those tokens across terabytes of data that they're given. Any rhyming done is an impressive result.

Well the nature of byte pair encoding has a side effect of encoding sounds as well. I briefly explored it here: https://youtu.be/fTDQUxha9qU?t=480

Re: Bard is much worse at puzzle solving than ChatGPT

#29
Wow I had hoped for a more productive discussion than these 1-1 comparisons of Bard vs ChatGPT that I'm seeing everywhere. The model deployed with this version of Bard is clearly a smaller model than the biggest LaMDA/PaLM models Google has been working on for ages. Which, according to their publications, show unprecedented results on _proof writing_ of all things (see Minerva). While their strategic decisions may be questionable (or they're just trying to quantize the model for mass deployment without burning billions per month in compute costs), its almost silly to question Google's ability to build useful LLMs.

Re: Bard is much worse at puzzle solving than ChatGPT

#30
post #6

It's so sad to me to see the downfall of google from the absolute coolest company on the planet to the one that's now trying to keep up.

s/Microsoft/Google/ http://www.paulgraham.com/microsoft.html

Funny, cause Microsoft didn't die. They're doing great. More than that, they're the ones behind OpenAI.
Post reply on HN