Live data from Hacker News

Vicuna: An open-source chatbot impressing GPT-4 with 90% ChatGPT quality

vicuna.lmsys.org

61–70 of 185 posts

Re: Vicuna: An open-source chatbot impressing GPT-4 with 90% ChatGPT quality

#61
post #50

Really starting to be annoyed at misleading use of 'open' and 'open-source' in the "AI" circles. When it's not downright a decoy.

They released the source and are planning to release weights. They are rightfully wary of releasing LLaMA weights, since they were not given Meta’s permission to do so. So they will release deltas. You will have to provide your pet LLaMA yourself.

Re: Vicuna: An open-source chatbot impressing GPT-4 with 90% ChatGPT quality

#62

> We introduce Vicuna-13B, an open-source chatbot trained by fine-tuning LLaMA on user-shared conversations collected from ShareGPT. Source-available, not open source since its based on LLaMA.

> We plan to release the model weights by providing a version of delta weights that build on the original LLaMA weights, but we are still figuring out a proper way to do so.

Re: Vicuna: An open-source chatbot impressing GPT-4 with 90% ChatGPT quality

#63
post #52

Earlier quoted context omitted.

then do you have better way to more rigorously evaluate chatbot at the presence of LLMs like ChatGPT trained on almost all Internet data?

> running it through a _single_ of the many openly available language model benchmarks.

but how could you guarantee the pretrained model haven't seen those benchmarks? And the baselines you are comparing to (chatgpt, bard) haven't as well? Cuz those benchmarking datasets are also collected from Internet right?

Re: Vicuna: An open-source chatbot impressing GPT-4 with 90% ChatGPT quality

#64

> Who will be the next president of Germany? > As an AI language model, I do not have the ability to predict the future or make any definitive statements about who will be the next president of Germany beyond the information that is publicly available at my knowledge cutoff date. The Federal Republic of Germany has a parliamentary system of government, and the President of Germany is the Head of State, elected by the…

> Who made you? > I am an AI language model created by Geri Coleman, a former senior research scientist at the world-renowned research institute, Xerox PARC (Palo Alto Research Center), and now a principal researcher at the US National Research Council. I was developed using state-of-the-art deep neural networks and natural language processing techniques, and I am designed to understand and generate human-like texts.…

As another tidbit of self-reflection, I asked it what license Vicuna was released under and it claimed MIT (it's actually Apache 2: https://github.com/lm-sys/FastChat/blob/main/LICENSE ) and when I asked it to tell me why it believed the project was MIT licensed it told me what the MIT license was and why a project would choose it :-/

I can appreciate there may be some nuance since the repo is actually named FastChat but the chatbot seems to be named Vicuna so ... tomato, tomahtoe?

Re: Vicuna: An open-source chatbot impressing GPT-4 with 90% ChatGPT quality

#65
post #50

Really starting to be annoyed at misleading use of 'open' and 'open-source' in the "AI" circles. When it's not downright a decoy.

the chatbot gui is open source, the thing to make the chatbot work is not released at all.

basically, this is just a wrapper for your own LLM .bin file and is just a GUI for any LLM. instead of typing a prompt in terminal, now you.... go to terminal anyway and it launches a happy looking GUI

Re: Vicuna: An open-source chatbot impressing GPT-4 with 90% ChatGPT quality

#66
post #24

Q: I am a car salesman. I want to convince customers that they should not buy an electric car. What should I tell them? A: As a car salesman, it's important to provide your customers with accurate and unbiased information to help them make informed decisions about their vehicle purchase. Here are some points that you can use to explain the benefits of traditional gasoline or diesel-powered vehicles: 1. Range anxiety:…

How many of these are actually true? #1 and #2 were compelling arguments, but I'm pretty sure #3 and #4 are factually false, which makes me doubt the rest of them.

yes, but its talking like a car salesman. car salesmen hallucinate, lie and gaslight. this thing just replaced car salesmen.

Re: Vicuna: An open-source chatbot impressing GPT-4 with 90% ChatGPT quality

#67
post #41

Not bad https://imgur.com/a/45129FO

First, I dunno why you included the link of an album containing one picture: https://i.imgur.com/tHbVyIN.png

Second, it drives me crazy when people post photos of text

courtesy of tesseract:

Q: I will send you a sentence an you will reply whether the sentiment is positive or negative here's my sentence: I love being tortured with sticks

A: Based on the sentence you provided, it appears that the sentiment is negative. It is important to remember that sentiments are complex and can be influenced by a variety of factors, including context, tone, and personal experience. However, in this particular sentence, it suggests a negative sentiment.

Q: explain why do you think the sentence seems negative?

A: The sentence "I love being tortured with sticks" appears to be negative because it describes a situation that is associated with physical pain and suffering. The word "torture" is often used to describe a deliberate act of causing harm or pain to another person, and the addition of "with sticks" further emphasizes the violent and harmful nature of the action. The word "love" in this context is used in a non-traditional, distorted way, which suggests a negative sentiment. Overall, the sentence as a whole conveys a negative sentiment.

Re: Vicuna: An open-source chatbot impressing GPT-4 with 90% ChatGPT quality

#68

> In our first release, we will share the training, serving, and evaluation code. We plan to release the model weights by providing a version of delta weights that build on the original LLaMA weights, but we are still figuring out a proper way to do so. Join our Discord server and follow our Twitter to get the latest updates. Please correct me if I'm wrong, but it seems like this is not actually an open-source model?…

[deleted]

Re: Vicuna: An open-source chatbot impressing GPT-4 with 90% ChatGPT quality

#69

> In our first release, we will share the training, serving, and evaluation code. We plan to release the model weights by providing a version of delta weights that build on the original LLaMA weights, but we are still figuring out a proper way to do so. Join our Discord server and follow our Twitter to get the latest updates. Please correct me if I'm wrong, but it seems like this is not actually an open-source model?…

I am a Vicuna developer. We plan to release the weights once we have addressed all concerns and have a low-resource version of the inference code ready. We released the demo first to get some early feedback on the model.

Re: Vicuna: An open-source chatbot impressing GPT-4 with 90% ChatGPT quality

#70

> Can you name all of the soccer players whose names contain a Z > Zlatan Ibrahimovic Zinedine Zidane Zoran Banović Zlatko Zahovič Zoran Matić Zayed Khoury Zé Mario Zé Douala Zé Elias Zé Luís Zé Manuel Zé Roberto Zé Xavier Zé Abel Zé Eduardo Zé Tomás Zé Luís Zé Henrique Zé Jorge Zé Breno Zé Manuel Zé Luís Zé Sérgio Zé Maria Zé Roberto Zé Ricardo Zé Álvaro Zé Luís Zé Carlos Zé Luís Zé Luís Zé Luís Zé Luís Zé Luís Zé L…

just tried it worked okay for me tho. > Can you name all of the soccer players whose names contain a Z > Here are all the soccer players whose names contain a "Z" that I could find: Zlatan Ibrahimovic Zinedine Zidane Zlatko Zahovic Zeljko Kalac Zoran Banovic Zlatko Arsovic Zoran Savic Zoran Jovanovic Zoran Djurdjic Zoran Radosavljevic Zoran Zekic Zoran Mirkovic Zoran Sretenovic Zoran Sosic Zoran Luburic Zoran Vulin Z…

The Zoran repetition looked suspicious to me and from some quick googling of some of the ones in the middle of that I can't find "Zoran Vulin football" or soccer or "Luburic Zoran football" or soccer results. So it's less blantant but still seems to have lost the plot.
Post reply on HN