I used ChatGPT to generate erotic stories. Now I want a model which can produce porn videos from prompts.
Have you tried KoboldAI? It can run, among other more mundane things, some pretty large ERP models. Its been making me lose sleep this week. :D
Unpredictable abilities emerging from large AI models
161–170 of 326 posts
Re: Unpredictable abilities emerging from large AI models
#162Earlier quoted context omitted.
Here's some things must be true if consciousness is an illusion: Qualia does not exist Subjective experience does not exist Consciousness does not exist There's nothing wrong with acting unethically or immoral because nobody actually experiences any harm because nobody experiences anything Does anyone really think that's true?
They (1-3) do not exist but they are psychically real- they are genuine illusions, as instantiated in the dynamic, split-second successive whiffs emerging from the processing of neurons. To think that they (1-3) "exist" in a classical sense is a reification error. The first three self-constrain impulses to the contrary on morality behaviors.
I guess this comes down to how you define exist and illusion. I don't think I'd agree on your definition of illusion at least.
I'm not sure what you mean that it doesn't exist in a classical sense. That qualia, subjective experience and consciousness are not concrete entities? That something doesn't exist if its an emergent property or that something doesn't exist if its a process?
Re: Unpredictable abilities emerging from large AI models
#163Earlier quoted context omitted.
Can you elaborate on fundamental limits?
> According to NVidia, LLM sizes have been increasing 10X per year for the last few years. Clearly this cannot continue, as the training costs will exceed all the compute capacity in existence. The other limit is training data, eventually you run out of cheap sources.
They may also run out of data if they already consumed most of the internet. Or start producing so much of the internet's content that LLMs start consuming what they write in a closed loop.
Re: Unpredictable abilities emerging from large AI models
#164Earlier quoted context omitted.
What's most interesting to me, is that this is how I would expect a human to approach the problem if presented with the code and asked for the output. The LLM didn't run the code, it tried to predict the output based on its knowledge of python and primes.
Sorry, did it try to predict the output, or did it only predict the output based on what it has seen people say about similar code online?
Is your objection to the use of the word "try"?
Re: Unpredictable abilities emerging from large AI models
#165Nice write up! I have been using classic back-prop neural networks since the 1980s, and deep learning for the last 8 years. This tech feels like a rocket ship that is accelerating exponentially! I am in my 70s and I don't work much anymore. That said, I find myself spending many hours in a typical day doing what I call "gentleman scientist" activities around Large Language Models. I was walking this morning with a no…
> Emotionally and psychologically I think that some tech and other highly paid knowledge workers just can't accept the sea-change that we are living through. This is a good way to frame it. As a mid-career person, I’m trying to figure out how to respond to these developments in my own career. I think there’s a good chance that software development as a career looks very different in 10 years in terms of the day to da…
I think it'll end at using chatgpt as a great tool. And that seems fine. I think much of the anxiety here is in the unknown.
You have to learn your IDE, but it doesn't make programming harder. It makes it more fun actually.
Chatgpt is going to require that devs are even better IMO because you have to catch its errors and know how to work with it.
Re: Unpredictable abilities emerging from large AI models
#166This caught my attention as I found it implausible: > One DeepMind engineer even reported being able to convince ChatGPT that it was a Linux terminal and getting it to run some simple mathematical code to compute the first 10 prime numbers. Remarkably, it could finish the task faster than the same code running on a real Linux machine. Following the link, there's a screenshot to a screenshot [0] of a code-golf solutio…
Gpt is never calculating anything!!
Re: Unpredictable abilities emerging from large AI models
#167Earlier quoted context omitted.
What's most interesting to me, is that this is how I would expect a human to approach the problem if presented with the code and asked for the output. The LLM didn't run the code, it tried to predict the output based on its knowledge of python and primes.
Sorry, did it try to predict the output, or did it only predict the output based on what it has seen people say about similar code online?
The second one
Re: Unpredictable abilities emerging from large AI models
#168I write this as a sceptic who always leaned towards the symbolic side of this debate. First seeing Open AI inventing tactics in Dota and now using GPT and other recent AI product has changed my mind. The rate of progress in the field is just staggering and seems to be still accelerating. Overall, I'd say we are running into too many "unkowns". We don't know our own cognition works which makes all arguments along the…
>We don't know our own cognition works which makes all arguments along the lines of "LLMs are just .." Sure, but there are very binary tests we can do to understand the first principles of what LLMs are vs. what they are not. Ask an LLM to play tic-tac-toe and it does great. Ask it to play tic-tac-toe on a 100x100 board, it get's confused. This is a very easy test to examine the limits of it's ability to do symbolic…
hey that's pretty cool. Yeah, for sure it's worthwhile talking about what they are doing, I agree. I guess I just wish people would update their mental model to the new reality a bit quicker :)
Re: Unpredictable abilities emerging from large AI models
#169Earlier quoted context omitted.
Okay, but you have another post in this thread with: > When these LLMs get normalized probably 5 years from now I'm going go back to these old threads and contact these people who are in self denial and throw it in their face. I'll just link this comment and be like I TOLD YOU, I TOLD YOU, YOU WERE WRONG.
My bad. It's the caps. I'll remove the caps. Just picture me saying it a nicer way.
Gloating over people being wrong is rarely nice
Re: Unpredictable abilities emerging from large AI models
#170Earlier quoted context omitted.
OP has a good point I think, even if it does not refer to LLM, which to me is too strict of a requirement. I think emergent behaviour happens in a lot of videogames. Famously in Dwarf Fortress, with the cat getting drunk, but also in general, where game designers play the game to see if emergent behaviour of the game rules "feels" good. Yesterday I was reading a book about designing games, and it literally has a sect…
>I think emergent behaviour happens in a lot of videogames. Famously in Dwarf Fortress, with the cat getting drunk, but also in general, where game designers play the game to see if emergent behaviour of the game rules "feels" good. Depends. Dwarf fortress and games are sort of a contradiction. Emergent behavior is emergent because the behavior was not designed explicitly. However for games like DF the game was expli…
My thought of what "emergent behavior" is, isn't that it is necessarily "unintended", but rather that it isn't really present in the small scale stuff, and isn't an obvious consequence of the small scale stuff? Like, a qualitative difference between the base level stuff, and the consequences when it all fits together.
Like, if God intended for the universe to have something which acts like water, when designing subatomic physics, that doesn't make the behavior of water "not emergent behavior".