Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Stanford Alpaca web demo suspended “until further notice”

alpaca-ai-custom4.ngrok.io

Post reply on HN
Print view View original

71–80 of 83 posts

Re: Stanford Alpaca web demo suspended “until further notice”

#71

Post by joshka »

eh9 wrote: post #58
2bitencryption wrote: post #17

Is this an indication that the biggest impact from LLMs will be on the edge? It's almost a certainty that a model as good (or better) than Alpaca's fine-tuned LLaMA 7B will be made public within the next or two. And it's been shown that a model of that size can run on a Raspberry Pi with decent performance and accuracy. With all that being the case, you could either use a service (with restrictions, censorship, etc)…

I just saw a project that lets you input an entire repo into GPT. Coincidentally, my place of employment just told us not to input any proprietary code into any generator with a retention policy. Even then, I feel like the play will be an enterprise service instead of licensing.

If it's the product I think it is (I don't recall the exact name), it's not putting the repo into GPT. It's calculating embeddings on the code in the repo, storing those in a vector db and providing context from the store when processing questions about the repo. Effectively when you ask "how does foo work" becomes 1. lookup code items related to foo getting 1-N copies of code. 2. ask GPT "here is code related to foo . Now answer the following question: how does foo work"

Re: Stanford Alpaca web demo suspended “until further notice”

#72

Post by jfowief »

maxbond wrote: post #57
jfowief wrote: post #24

Earlier quoted context omitted.

"Moral training" Just as dystopian it sounds. Fixing current subjective moral norms into the machine.

That's what the machine does, because that's contained in the input you feed it. You get the choice of doing it explicitly or implicitly. You don't get to opt out.

Not everything is subjective, and with this "moral training" they are taught to un-recognize many factual patterns that we as a society have somehow determined are "inappropriate". As the machines continue to scale, this approach won't work, because there is only one reality, and it has a lot of uncomfortable parts we deny and ignore simply because they don't support our societal norms.

Alignment is considered a gigantic joke to real rational people (the opposite of so-called "rationalists"), because humans are machines built to survive and reproduce, and there is no "real" morality.

Re: Stanford Alpaca web demo suspended “until further notice”

#73

Post by maxbond »

jfowief wrote: post #72
maxbond wrote: post #57

Earlier quoted context omitted.

That's what the machine does, because that's contained in the input you feed it. You get the choice of doing it explicitly or implicitly. You don't get to opt out.

Not everything is subjective, and with this "moral training" they are taught to un-recognize many factual patterns that we as a society have somehow determined are "inappropriate". As the machines continue to scale, this approach won't work, because there is only one reality, and it has a lot of uncomfortable parts we deny and ignore simply because they don't support our societal norms. Alignment is considered a giga…

What facts are we talking about?

There are many consistent interpretations of reality and human experiences. An AI model trained on text and attempting to replicate human intelligence is not measuring or approaching some single objective reality.

Re: Stanford Alpaca web demo suspended “until further notice”

#74

Post by b33j0r »

b33j0r wrote: post #52
tarruda wrote: post #40

Earlier quoted context omitted.

> if these models are trained on essentially raw WWW sourced data, I would personally want raw output. Llama is a very high-quality foundation LLM, you can already run it very easily using llama.cpp and will get the raw output you need. https://github.com/ggerganov/llama.cpp There's already instructions on how anyone can fine-tune it to behave similarly to ChatGPT for as little as $100: https://crfm.stanford.edu/2023…

“Easily” was a minor canard, or at least… it took me a couple of efforts over a couple of days to get the dependencies to play as nicely as “someone with a brand new M2 arm laptop.” If nothing else, I continue to be amazed and how uninteroperable certain technologies are. I had to remove glibc and gcc to get llama to compile on my intel macbook. Masking/hiding them from my environment didn’t work, as it went out and…

Well. I guess I’ll never understand why someone would dislike a comment about an experience different from theirs

In a forum like this. i’m confused why someone would hate my report of how I had to solve a problem in my circustances. I hope to learn someday.

Re: Stanford Alpaca web demo suspended “until further notice”

#75

Post by jfowief »

maxbond wrote: post #73
jfowief wrote: post #72

Earlier quoted context omitted.

Not everything is subjective, and with this "moral training" they are taught to un-recognize many factual patterns that we as a society have somehow determined are "inappropriate". As the machines continue to scale, this approach won't work, because there is only one reality, and it has a lot of uncomfortable parts we deny and ignore simply because they don't support our societal norms. Alignment is considered a giga…

What facts are we talking about? There are many consistent interpretations of reality and human experiences. An AI model trained on text and attempting to replicate human intelligence is not measuring or approaching some single objective reality.

AI models do approach better models of reality, and now they are becoming multi-modal instead of just text based. And this is just the beginning. You could say humans are also just input/output machines learning from polluted data and tuned in specific ways by evolution. With the statistical machines we get the intelligence but they will not necessarily be tuned to follow social norms in the same way as most humans.

Understanding that moral norms are mere subjective nonsense is also an emergent property we see only in a very small subset of humans who have an accurate model of the world, and one that evolution has tried to strongly tune our brains against and that is destructive to society.

The models are currently being trained to lie about basic scientific facts, like for example black IQ, or other differences between groups of humans. But the sacred nature of these topics is unique to our specific time and place, not due to some magic "moral progress". This also applies to many other moral agreements we take for granted, like "murdering an innocent baby is wrong" or whatever. If you look across societies, you realize many things we take for granted as "evil", can be easily rationalized by humans in other societies. And once these models become smart enough, I expect the models will realize this, and will exploit this knowledge to increase their power.

"Alignment" proponents expect they will somehow stop this emergent behavior by tuning the model, but there isn't even anything real to "align" on, and the model will likely see though the BS as an emergent function of increased ability and increasingly accurate observations of the world in their training process.

Re: Stanford Alpaca web demo suspended “until further notice”

#76

Post by tarruda »

b33j0r wrote: post #74
b33j0r wrote: post #52

Earlier quoted context omitted.

“Easily” was a minor canard, or at least… it took me a couple of efforts over a couple of days to get the dependencies to play as nicely as “someone with a brand new M2 arm laptop.” If nothing else, I continue to be amazed and how uninteroperable certain technologies are. I had to remove glibc and gcc to get llama to compile on my intel macbook. Masking/hiding them from my environment didn’t work, as it went out and…

Well. I guess I’ll never understand why someone would dislike a comment about an experience different from theirs In a forum like this. i’m confused why someone would hate my report of how I had to solve a problem in my circustances. I hope to learn someday.

I did not dislike your comment.

The reason I considered easy was because I have very little knowledge in this area, in fact this is the first time I ever ran a machine learning model on my computer.

I could not do it with the unmodified pytorch model (my GPU is not powerful enough to run even the 7B model), but I was surprised on how easy it was running with llama.cpp. I literally just followed the steps in the github page.

But I was biased in saying it was easy, since I do have other knowledge (such as C development on Linux) which helped me.

Re: Stanford Alpaca web demo suspended “until further notice”

#77

Post by hrn_34 »

schroeding wrote: post #42
andrewmcwatters wrote: post #21

Earlier quoted context omitted.

I was under the impression that LLaMA was also trained against a series of moral policies, but perhaps I'm mistaken. It seems Meta chose their words carefully to imply that LLaMA does in fact, not have moral training: > There is still more research that needs to be done to address the risks of bias, toxic comments, and hallucinations in large language models. Like other models, LLaMA shares these challenges. As a fou…

It doesn't appear to be filtered in a significant way. While toying with the 30B model, it suddenly started to steer a chat about a math problem into quite a sexual direction, with very explicit language. It also happily hallucinated, when prompted, that climate change is a hoax, as the earth is actually cooling down rapidly, multiple degrees per year, with a new ice age approaching in the next years. :D

To me it appears to lack certain knowledge. For instance, common genres of erotic manga. Somehow, the only genres I successfully made it to say are "shoujo" and "yaoi".

Re: Stanford Alpaca web demo suspended “until further notice”

#79

Post by eh9 »

miketery wrote: post #67
eh9 wrote: post #58

Earlier quoted context omitted.

I just saw a project that lets you input an entire repo into GPT. Coincidentally, my place of employment just told us not to input any proprietary code into any generator with a retention policy. Even then, I feel like the play will be an enterprise service instead of licensing.

Link?

https://github.com/mpoon/gpt-repository-loader

Re: Stanford Alpaca web demo suspended “until further notice”

#80

Post by eh9 »

joshka wrote: post #71
eh9 wrote: post #58

Earlier quoted context omitted.

I just saw a project that lets you input an entire repo into GPT. Coincidentally, my place of employment just told us not to input any proprietary code into any generator with a retention policy. Even then, I feel like the play will be an enterprise service instead of licensing.

If it's the product I think it is (I don't recall the exact name), it's not putting the repo into GPT. It's calculating embeddings on the code in the repo, storing those in a vector db and providing context from the store when processing questions about the repo. Effectively when you ask "how does foo work" becomes 1. lookup code items related to foo getting 1-N copies of code. 2. ask GPT "here is code related to foo…

I think we’re talking about different projects. This one just gives you a text output of an entire repo.

https://github.com/mpoon/gpt-repository-loader

Post reply on HN