w
The Singularity will occur on a Tuesday
581–590 of 800 posts
Re: The Singularity will occur on a Tuesday
#582what?
Re: The Singularity will occur on a Tuesday
#583Earlier quoted context omitted.
I didn't ask for your help so it's probably better for everyone if you spend your time & efforts elsewhere. Good luck.
Well don't ask me to help you then. I read your profile and it has this snippet in there: "Address the substance of my arguments or just save yourself the keystrokes." The substance of your argument was complete ignorance about the topic, so I addressed it as you requested. Please remove that sentence from your profile if that is not what you want. Thank you.
I don't see how you interpreted it that way so I recommend you make fewer assumptions about online content instead of asserting your interpretation as the one & only truth. It's generally better to assume as little as possible & ask for clarifications when uncertain.
Re: The Singularity will occur on a Tuesday
#584Earlier quoted context omitted.
>So obviously, error correction with inputs/outputs is not the way we get to intelligence. This doesn't seem to follow at all let alone obviously? Humans are able to reason through code without having to become a completely discrete computer, but probably can't reason through any length of assembly code, so why is that requirement necessary and how have you shown LLMs can't achieve human levels of competence on this…
> but probably can't reason through any length of assembly code Uh what? You can sit there step by step and execute assembly code, writing things down on a piece of paper and get the correct final result. The limits are things like attention span, which is separate from intelligence. Human brains operate continuously, with multiple parts being active at once, with weight adjustment done in real time both in the style…
So humans can get pen and paper and sleep and rest, but LLMs can't get files and context resets?
Give the LLM the ability to use a tool that looks up instructions and records instructions from/to files, instead of holding it in context window, and to actively manage its context (write a new context and start fresh), and I think you would find the LLM could probably do it about as reliable as a human?
Context is basically "short term memory". Why do you set the bar higher for LLMs than for humans?
Re: The Singularity will occur on a Tuesday
#585Re: The Singularity will occur on a Tuesday
#586Earlier quoted context omitted.
I don't understand. In this hypothesis, in the elite's view, what is the purpose of the rest of society? If everyone has little to no productive output, why would they support us with a UBI? They could just hire whatever human skeleton crew they'd need to sustain their activities (if needed). The rest of humanity could be either mercifully left alone with absolutely nothing, or annihilated.
I'm definitely making certain assumptions, such as: (1) democratic rule endures, (2) even absent true democratic rule, the populace can still resort to violent rebellion as a failsafe, (3) psychopathic tendencies amongst said elite are constrained enough such that mass genocide remains sufficiently psychologically unpalatable, (4) economic calamity substantially precedes the deployment of fully autonomous policing, e…
I agree. Although, looking at these assumptions, subjectively I think that all four of them are in question, and as time passes, their eventual long-term failure seems increasingly likely. Even if one of these four pillars persists, I would expect an overall worsening by default. If democratic rule persists in places, the most powerful would occupy places where it does not exist, or create fully private states, still wielding enormous power over democratic states through wealth and military might. If violent rebellion is technically possible, a middle ground will be carefully calculated where the lower classes are kept on life support with the minimum amount of resources required to dissuade unrest. If the trillionaires of tomorrow suddenly start caring about other people, they could employ second-order measures to effectively reduce the population, thereby safeguarding themselves - massively constraining or removing the supply of food, water, medicine, any vital technology that would be only available to them. I don't see how an economic crisis would prevent automated enforcement, it may only delay it a bit.
Hope is kind of in short supply nowadays. Even if your hypothesis of absolute-automation doesn't happen within our lifetimes, things seem to be guaranteed to get worse for people like us. If it does happen... we'll likely never reap any real rewards from it, barring a complete restructuring of our whole society to an extent that has never happened and likely would never be allowed to happen.
Re: The Singularity will occur on a Tuesday
#587Earlier quoted context omitted.
In what sense is this true? We understand the theory of what is happening and we can painstakingly walk through the token generation process and understand it. So in what sense do we not understand LLMs?
We wrote it. Every line. Every function. Every tensor shape and update rule. We chose the architecture. We chose the loss. We chose the data. There is no hidden chamber in the machine where something slipped in without our consent. It is multiplication and addition, repeated at scale. It is gradients flowing backward through layers, shaving away error a fraction at a time. It is as mechanical as anything we have ever…
Beautiful. My brain now questions if this was written by LLM, but it's fine. Today is Tuesday.
Re: The Singularity will occur on a Tuesday
#588Earlier quoted context omitted.
>Even if interpretability of specific models or features within them is an open area of research, the mechanics of how LLMs work to produce results are observable and well-understood, and methods to understand their fundamental limitations are pretty solid these days as well. If you train a transformer on (only) lots and lots of addition pairs, i.e '38393 + 79628 = 118021' and nothing else, the transformer will, duri…
It's pattern matching, likely from typography texts and descriptions of umbrellas. My understanding is that the model can attempt some permutations in its thinking and eventually a permutation's tokens catch enough attention to attempt to solve, and that once it is attending to "everyday object", "arc", and "hook", it will reply with "umbrella". Why am I confident that it's not actually doing spatial reasoning? At le…
> I feel like I have a pretty good intuition of what's happening here based on my understanding of the underlying mathematical mechanics.
You should write a paper and release it and basically get rich.
Re: The Singularity will occur on a Tuesday
#589Are people in San Francisco that stupid that they're having open-clawd meetups and talking about the Singularity non stop? Has San Francisco become just a cliche larp?
There's all sorts of conversations like this that are genuinely exciting and fairly profound when you first consider them. Maybe you're older and have had enough conversations about the concept of a singularity that the topic is already boring to you. Let them have their fun. Related, some adults are watching The Matrix, a 26 year old movie , for the first time today. For some proof that it's not some common idea, I…
They're still profound topics but the high status signal is to be cynical and treat it as gauche
Re: The Singularity will occur on a Tuesday
#590Earlier quoted context omitted.
> prior to reforming society into one that does not predicate survival on continued employment and wages There's no way that'll happen. The entire history of humanity is 99% reacting to things rather than proactively preventing things or adjusting in advance, especially at the societal level. You would need a pretty strong technocracy or dictatorship in charge to do otherwise.
The UK seems to be prototyping that. We're changing to a society where everyone lives by claiming benefits. (eg. https://www.gbnews.com/money/benefits-claimants-earnings-rev... )
Ugh, GBNews, outrage fodder for idiots and the elderly with no ability to navigate the modern information landscape.
You can tell it's watched almost exclusively by old people because all the ads on the channel are for those funeral pre-pay services or retirement homes.
Safe to ignore anything they have to say.