Live data from Hacker News

Bard is much worse at puzzle solving than ChatGPT

twofergoofer.com

81–86 of 86 posts

Re: Bard is much worse at puzzle solving than ChatGPT

#81
post #56

Offtopic - have you seen Phind? https://www.phind.com/ It is very fast and wins the search benchmarks here: https://twitter.com/vladquant/status/1638305110869807104

Can your source be not someone with an animated profile picture?

Source's source: https://blog.kagi.com/kagi-ai-search#aitest

Re: Bard is much worse at puzzle solving than ChatGPT

#82
post #58

Earlier quoted context omitted.

From Chicago ... and with more than a thousand solves on that puzzle we've never received a single complaint about the rhyme on that one (plus the stats say users find it an extremely easy rhyme to solve)! Curious how you pronounce that one such that they don't rhyme?

According to the dictionary (and matching my own non-native pronunciation), cactus is /ˈkæktʌs/, practice is /ˈpɹæktɪs/ The terminal /tʌs/ is not quite the same thing as /tɪs/; since they are both unstressed, the difference can be hard to notice in fast speech, but becomes clear when enunciating.

There are differing definitions of “rhyme” in popular usage. See: https://youtu.be/_kQBVneC30o

A lot of “does this rhyme with that?” depends on the context in terms of how strict the rhyming must be or not.

Re: Bard is much worse at puzzle solving than ChatGPT

#83

Earlier quoted context omitted.

Protein and poutine do not rhyme if you pronounce poutine the proper way in Canadian French. And you are right of course that gelatin and practice have the short "ee" sound at the end whereas skeleton and and cactus have the "uh" sound.

> Protein and poutine do not rhyme if you pronounce poutine the proper way in Canadian French. I looked it up, and sure, it sounds about the same in Canadian French as someone saying Vladimir Putin[1]. But I've never heard anyone say it that way myself, and in neutral French (according to the linked video, at least), it's pronounced 'pooh-teen', which sounds exactly like protein (I don't know if you pronounce protein…

There's a funny restaurant called Vladimir Poutine in Montréal lol:

https://www.vice.com/en/article/vb7qwb/inside-vladimir-pouti...

Re: Bard is much worse at puzzle solving than ChatGPT

#84
post #77
post #26

Earlier quoted context omitted.

> language models themselves can't "crash" That is like saying the Excel document didn't crash, but Excel did when it tried to parse it. As far as I know there is no proof that you can't cause a LLM to crash with user input. > because they "just" generate new tokens. I can write a program that counts to 100 that crashes reliably.

It's a fixed number of matrix multiplications. You can't make matrix multiplication crash by feeding it any sort of strange numbers (unless they haven't handled their Infs and NaNs).

> You can't make matrix multiplication crash by feeding it any sort of strange numbers

Matrices don't multiply themselves. You need hardware and software. As I pointed out the LLM is effectively just data that is being processed by a program. It is silly to assume you have no bugs in that software or the underlying operating system.

Re: Bard is much worse at puzzle solving than ChatGPT

#85
post #84
post #77

Earlier quoted context omitted.

It's a fixed number of matrix multiplications. You can't make matrix multiplication crash by feeding it any sort of strange numbers (unless they haven't handled their Infs and NaNs).

> You can't make matrix multiplication crash by feeding it any sort of strange numbers Matrices don't multiply themselves. You need hardware and software. As I pointed out the LLM is effectively just data that is being processed by a program. It is silly to assume you have no bugs in that software or the underlying operating system.

The type of bug the first comment was discussing, where recursion could cause it to crash (out of memory? stack overflow?) is categorically impossible based on how the model works, and a bug in the software running it would not change that.

Re: Bard is much worse at puzzle solving than ChatGPT

#86

Earlier quoted context omitted.

> The author doesn't seem to understand rhyming too well (cactus practice is a weak rhyme at best) cactus / practice ? they rhyme to my mind skeleton / gelatin ? also rhyme to my ears protein / poutine also rhyme enough to be considered to rhyme You appear to be operating under the impression that the every syllable of a rhyming couplet has to rhyme exactly for it to be considered a rhyme. This is an incorrect assump…

What most people consider a rhyme is that the vowel and coda of the last syllable match (of course we don't mostly reach for the technical definition). I guess the examples there might be accent dependent. Protein/poutine is the only one of those first examples that really rhymes to me; skeleton/gelatin and cactus/practice both have different vowels. Maybe different for you though.

> What most people consider a rhyme is that the vowel and coda of the last syllable match

??? Oh yeah, says who?

protein / poutine

p[]oh teen / poo teen => both start with a p, then there's an oh or oo (which are similar) and both end the same way – disyllabic rhyme

cactus / practice ?

[]ah ck təss / []ah ck tiss => ignoring the first consonant (cluster) which anchors the rhyme and pronouncing the u as a schwa (which it is), the ck's are the same and təss and tiss are totes similar – disyllabic rhyme

skeleton / gelatin ?

trisyllabic goodness – again, the way we pronounce the on in first word is not like the on in frond but like the ən in motion (UHn) and the way we pronounce the at in the second word is not like the at in bat or cat but like the ət in … hmm, none spring to mind but it's an UHt sound here if you listen to it – sgɛ́lɪtən or ˈskelɪtən – ˈʤelətɪn – so you've k vying with g (both hard), e with e, l with l, ɪ with ə (close sounding!), t with t, ə with ɪ (close sounding!), n with n

===

listen with your ears, not with your eyes

Post reply on HN