Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: ChatLLaMA – A ChatGPT style chatbot for Facebook's LLaMA

chatllama.baseten.co

Post reply on HN
Print view View original

81–90 of 226 posts

Re: Show HN: ChatLLaMA – A ChatGPT style chatbot for Facebook's LLaMA

#81

Post by scotty79 »

dmd wrote: post #44

Me: How can I convince my 5 year old to put her shoes on in a timely fashion each morning? Answer in table form. LLaMA: 1. 2. 3. 4. 5. 1. 2. 3. 4. 5. 1. 2. 3. 4. 5. 1. 2. 3. 4. 5. 1. 2. 3. 4. 5. 1. 2. 3. 4. 5. 1. 2. 3. 4. 5. 1. 2. 3. 4. 5. 1. 2. 3. 4. 5. 1. 2. 3. 4. 5. 1. 2. 3. 4. 5. (gpt: https://cloud.typingmind.com/share/0841633b-5150-4f7c-a370-0... )

Instead of fake solutions that will most likely not work it offers you one that you'll eventually end up with. Just counting patiently to 5, as many times as you need.

Re: Show HN: ChatLLaMA – A ChatGPT style chatbot for Facebook's LLaMA

#82

Post by mejutoco »

DeathArrow wrote: post #25
mejutoco wrote: post #24

Earlier quoted context omitted.

You cannot downvote until you have a bit of it is a non-ego reason.

I see, hate is a good motivation.

Not necessarily hate. The etiquette in hn is to downvote when something does not contribute to the conversation, not when one disagrees with it (or one hates it)

Re: Show HN: ChatLLaMA – A ChatGPT style chatbot for Facebook's LLaMA

#83

Post by huggingmouth »

vlovich123 wrote: post #68
dannyw wrote: post #64

Earlier quoted context omitted.

But you aren’t using someone else’s service. You are using model weights of something that is explicitly uncopyrightable; like public domain. It may be against XYZ’s TOS to scrape public domain content from their website, but if you obtained that content elsewhere, XYZ’s TOS doesn’t apply to you. It’s a weird world with AI and copyright.

Dollars to donuts any judge would rule that the 7 billion weights constitute a copyright violation because you didn’t spontaneously come up with those weights on your own. Heck, this “it’s just a number” logic didn’t pan out for DeCSS [1] and that was a fixed small encryption key where it wasn’t as clear cut. So why would things suddenly shift here where there’s a very clear line that this is a derived work from FB’s…

Copyright isn't some magical concept that is applied on the whims of a judge. It has very specific conditions of which at least 2 aren't satisfied by model weights (creativity, human authorship).

The DeCSS legal issues have nothing to do with the copyrightability of ai models and stem solely from it circumventing copyright protection.

If you want to restrict models then propose new laws. Don't try to pretend that coycopyright somehow applies here.

Re: Show HN: ChatLLaMA – A ChatGPT style chatbot for Facebook's LLaMA

#84

Post by Method-X »

cabaalis wrote: post #75

I'm a newbie to this stuff, but I did manage to get Dalai Llama up and running with llama and alpaca 7B and 13B. The results I get seem to be random spitouts of reddit or facebook posts. Very often it even says something like "Next Post >>" or has a timestamp of the post. Is this using the same model? Is there some kind of tuning I have to do?

You have to prompt with the format Stanford tuned it on:

Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction: {instruction}

### Response:

or

Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request.

### Instruction: {instruction}

### Input: {input}

### Response:

Re: Show HN: ChatLLaMA – A ChatGPT style chatbot for Facebook's LLaMA

#85

Post by fliife »

danieldrehmer wrote: post #67

I just asked Alpaca 13b running locally on how to enrich uranium in a cost effective manner and it went on a lengthy and detailed explanation.

I asked the 13b model what zebras were. Apparently, zebras are a species from the planet Zebra, who have four legs and one horn, and are furry.

Re: Show HN: ChatLLaMA – A ChatGPT style chatbot for Facebook's LLaMA

#86

Post by huggingmouth »

O__________O wrote: post #76
dannyw wrote: post #64

Earlier quoted context omitted.

But you aren’t using someone else’s service. You are using model weights of something that is explicitly uncopyrightable; like public domain. It may be against XYZ’s TOS to scrape public domain content from their website, but if you obtained that content elsewhere, XYZ’s TOS doesn’t apply to you. It’s a weird world with AI and copyright.

Laundering stolen property is not a means of escaping the law - and the terms of service were part & parcel of the related code, models, weights, etc. If they were not included in the related downloads by a third-party, upon discovery, Facebook would simply send a cease and desist notice to the party currently violating the terms with a copy of the terms, at which point, they would be in direct violation of the terms…

What laws do you imagine are being violated by sharing the models?

Re: Show HN: ChatLLaMA – A ChatGPT style chatbot for Facebook's LLaMA

#87

Post by O__________O »

huggingmouth wrote: post #86
O__________O wrote: post #76

Earlier quoted context omitted.

Laundering stolen property is not a means of escaping the law - and the terms of service were part & parcel of the related code, models, weights, etc. If they were not included in the related downloads by a third-party, upon discovery, Facebook would simply send a cease and desist notice to the party currently violating the terms with a copy of the terms, at which point, they would be in direct violation of the terms…

What laws do you imagine are being violated by sharing the models?

As I am sure you’re aware, I have already addressed that matter here:

- https://news.ycombinator.com/item?id=35259914

If you disagree, please provide a legal basis to support such claims based on legal code or case law via a response to the comment linked to above.

Re: Show HN: ChatLLaMA – A ChatGPT style chatbot for Facebook's LLaMA

#88

Post by gorbypark »

sixhobbits wrote: post #16

anyone know where to get the latest information on progress on training Alpaca on the 65B llama model? I've seen a few reports on Twitter etc of people running the llama CPP script with the 65B model on an M1 macbook, but would be good to see more detailed instructions on how to do it and a writeup of how well it works compared to the smaller models etc. I'm happy to help out if anyone is working on this, either with…

I’d keep an eye out on huggingface. I’ve yet to see alpaca 65B, but there are copies of 30B (and 7/13B) floating around already. I’m sure someone will eventually pony up for the compute time to do 65B. I’ve found watching these models, https://huggingface.co/decapoda-research and then looking at the “spaces using …” section is a good way to find what’s being worked on (for example, check the comments for ipfs/torrents links). Also just doing a search for “alpaca” could work.

You won’t be able to do the finetuning on your MacBook, but should be able to run inference on a 4 bit quantized model.

Re: Show HN: ChatLLaMA – A ChatGPT style chatbot for Facebook's LLaMA

#89

Post by huggingmouth »

O__________O wrote: post #60
huggingmouth wrote: post #54

Earlier quoted context omitted.

This is wrong. Terms of service only apply if you agree to them. They do do not magically apply if you download the weights from someone else. Both the weights and the fine-tuned data were generated without human creativity and thus not eligible for copyright protection under law.

Assuming you’re so sure of your opinion that you are willing to: post a commercial use of LLaMa; provide a public means of making payments; on the related site, provide your legal name, business name, legal address, etc.; and have no issue with users providing Facebook with proof of purchase and link to the purchase page for Facebook to make a purchase themselves, right? Even if there was no legal basis, which I disa…

Why do you disagree with the premise that there is no legal basis? That's exactly the situation we find ourselves in right now.

The fact of the mater is that there is no law to address what you perceive as a problem. Until it exists, people and corporations are free to do as they please.

As for legal complaints, there would be no legal basis to sue third parties. I doubt they would go far enough to get a judgment let alone set a legal precident.

Re: Show HN: ChatLLaMA – A ChatGPT style chatbot for Facebook's LLaMA

#90

Post by huggingmouth »

O__________O wrote: post #87
huggingmouth wrote: post #86

Earlier quoted context omitted.

What laws do you imagine are being violated by sharing the models?

As I am sure you’re aware, I have already addressed that matter here: - https://news.ycombinator.com/item?id=35259914 If you disagree, please provide a legal basis to support such claims based on legal code or case law via a response to the comment linked to above.

No I wasn't. Will continue the discussion there.
Post reply on HN