Live data from Hacker News

Vicuna: An open-source chatbot impressing GPT-4 with 90% ChatGPT quality

vicuna.lmsys.org

131–140 of 185 posts

Re: Vicuna: An open-source chatbot impressing GPT-4 with 90% ChatGPT quality

#131
post #128

It's hilarious to see how these models can hallucinate stuff that doesn't exist... Q: What is the meaning of ABBA's song "I have a dream"? A: "I Have a Dream" is a song by the Swedish pop group ABBA, released in 1970. The song was written by Benny Andersson and Björn Ulvaeus, and it was the group's first hit single. The song is a ballad that talks about a person's dream of finding love and happiness. The lyrics descr…

I also asked about a recipe with mushrooms, tea, and dishwasher soap. It happily gave me one... mentioning at some point "Add the dishwasher soap to the tea, if desired. The soap will help to release the flavor of the mushrooms and give the tea a slightly soapy taste."

Re: Vicuna: An open-source chatbot impressing GPT-4 with 90% ChatGPT quality

#133
post #128

It's hilarious to see how these models can hallucinate stuff that doesn't exist... Q: What is the meaning of ABBA's song "I have a dream"? A: "I Have a Dream" is a song by the Swedish pop group ABBA, released in 1970. The song was written by Benny Andersson and Björn Ulvaeus, and it was the group's first hit single. The song is a ballad that talks about a person's dream of finding love and happiness. The lyrics descr…

I was doing some market research with ChatGPT some time ago, and I started asking about some of my competitors. The output matched what I saw people say in conversations online, so I got curious about what it knew about myself. I asked and the answer was completely false.

Re: Vicuna: An open-source chatbot impressing GPT-4 with 90% ChatGPT quality

#134

Earlier quoted context omitted.

“Can you name all of the soccer players whose names contain a Z”

It's so weird. No matter how I ask, it gets something wrong about this question. > Can you name 20 soccer players whose names contain a Z, and for each one, place brackets around the letter Z (Z)inedine (Z)idane Cristiano Ronaldo dos Santos A(ve)iro Andrej W(sz)ołek Nemanja Mati(c) Dusan Tadi(c) Gr(az)iano Pellè Jakub Bła(śc)z(ykowski) Kamil Glik Luk(asz) Pi(sz)czek Blai(se) Matuidi Miralem Pjani(c) Marek Ham(śi)k Lu…

> And why are we getting different results?

Because the output is random

Which is why it's so frustrating when people cherry-pick successes

Re: Vicuna: An open-source chatbot impressing GPT-4 with 90% ChatGPT quality

#135
post #128

It's hilarious to see how these models can hallucinate stuff that doesn't exist... Q: What is the meaning of ABBA's song "I have a dream"? A: "I Have a Dream" is a song by the Swedish pop group ABBA, released in 1970. The song was written by Benny Andersson and Björn Ulvaeus, and it was the group's first hit single. The song is a ballad that talks about a person's dream of finding love and happiness. The lyrics descr…

I Have a Dream wasn't 1970-Abba hadn't formed yet! - it was 79, I remember my sisters buying it. And it wasnt their first single, not even the first off that album. And it doesn't have those lyrics, which I don't recognise, I don't think they're even from Abba songs.

Re: Vicuna: An open-source chatbot impressing GPT-4 with 90% ChatGPT quality

#136
post #131
post #128

It's hilarious to see how these models can hallucinate stuff that doesn't exist... Q: What is the meaning of ABBA's song "I have a dream"? A: "I Have a Dream" is a song by the Swedish pop group ABBA, released in 1970. The song was written by Benny Andersson and Björn Ulvaeus, and it was the group's first hit single. The song is a ballad that talks about a person's dream of finding love and happiness. The lyrics descr…

I also asked about a recipe with mushrooms, tea, and dishwasher soap. It happily gave me one... mentioning at some point "Add the dishwasher soap to the tea, if desired. The soap will help to release the flavor of the mushrooms and give the tea a slightly soapy taste."

Well... it's not wrong...

Re: Vicuna: An open-source chatbot impressing GPT-4 with 90% ChatGPT quality

#137
post #128

It's hilarious to see how these models can hallucinate stuff that doesn't exist... Q: What is the meaning of ABBA's song "I have a dream"? A: "I Have a Dream" is a song by the Swedish pop group ABBA, released in 1970. The song was written by Benny Andersson and Björn Ulvaeus, and it was the group's first hit single. The song is a ballad that talks about a person's dream of finding love and happiness. The lyrics descr…

I Have a Dream wasn't 1970-Abba hadn't formed yet! - it was 79, I remember my sisters buying it. And it wasnt their first single, not even the first off that album. And it doesn't have those lyrics, which I don't recognise, I don't think they're even from Abba songs.

My bad, I should have noticed this!

Re: Vicuna: An open-source chatbot impressing GPT-4 with 90% ChatGPT quality

#138

Earlier quoted context omitted.

lmao what?

Parent is referring to this: https://m.youtube.com/watch?v=BKorP55Aqvg

That sketch should have ended with the Asian guy drawing the 7 mutually perpendicular lines (of course not showing the drawing board) and everybody else scratching their heads.

Re: Vicuna: An open-source chatbot impressing GPT-4 with 90% ChatGPT quality

#139
Patiently waiting for someone to say "We trained LLaMA with extremely high weight decay, and find that performance is much worse. Due to licensing constraints, we are providing a version of delta weights that build on the original LLaMA weights..."

Re: Vicuna: An open-source chatbot impressing GPT-4 with 90% ChatGPT quality

#140
post #128

It's hilarious to see how these models can hallucinate stuff that doesn't exist... Q: What is the meaning of ABBA's song "I have a dream"? A: "I Have a Dream" is a song by the Swedish pop group ABBA, released in 1970. The song was written by Benny Andersson and Björn Ulvaeus, and it was the group's first hit single. The song is a ballad that talks about a person's dream of finding love and happiness. The lyrics descr…

I was doing some market research with ChatGPT some time ago, and I started asking about some of my competitors. The output matched what I saw people say in conversations online, so I got curious about what it knew about myself. I asked and the answer was completely false.

But did it match what people were saying about yourself?
Post reply on HN