Earlier quoted context omitted.
What’s an example of work that does not deal with actual problems?
Online influencers, podcasters, advertisers, social media product managers, political lobbyists, cryptocurrency protocol programmers, digital/NFT artists, most of the media production industry, those people w/ leaf blowers moving dust around, political commentators (e.g. fox & friends), super PACs, most NGOs, "professional" sports, various 3 letter agencies & their associated online "influence" campaigns, think tanks…
The Singularity will occur on a Tuesday
691–700 of 800 posts
Re: The Singularity will occur on a Tuesday
#692We need a function that hits infinity at a finite time. That's the whole point of a singularity: a pole, a vertical asymptote, the math breaking:
Also interesting that tokens/$ which represents the energy constraint is the shallowest slope, and also weird taking it out doesn't impact the date. That's a red flag, as you would think removing the energy constraint would bind.
Re: The Singularity will occur on a Tuesday
#693Earlier quoted context omitted.
The likely outcome is that 99.99% of humanity lives a basic subsistence lifestyle ("UBI") and the elite and privileged few metaphorically (and somewhat literally) ascend to the heavens. Around half the planet already lives on <= $7/day. Prepare to join them.
I don't understand. In this hypothesis, in the elite's view, what is the purpose of the rest of society? If everyone has little to no productive output, why would they support us with a UBI? They could just hire whatever human skeleton crew they'd need to sustain their activities (if needed). The rest of humanity could be either mercifully left alone with absolutely nothing, or annihilated.
Luckily we’re already most of the way there!
Over half of the population has been instrumented already to collect all their behavior data worldwide
That’s been the goal: persistent collection of training data should come out of your day-to-day life in order to bootstrap the action systems that are machine based
The challenge now is that most of that data is based on actions we don’t want machines to do
Re: The Singularity will occur on a Tuesday
#694The author does in fact note that only the arXiv data fits this curve better than a line, and yeah: that's the one dataset that genuinely looks a little curved. But 1) it's a very noisy sort of curved, and 2) I'll bet it would fit a quadratic or an exponential or, heck, a sine function just as well. Introducing their process of doing the hyperbolic fit, they say, "The procedure is straightforward, which should concern you." And yeah, it does concern me: why does the author think that their standard-but-oversimplified attempt to fit a hand-chosen function to this mess is worth talking about? (And why put all of that analysis in the article, complete with fancy animated graph, when they knew that even their most determined attempt to find a signal failed to produce even a marginally supportive result 80% of the time?)
In short: none of the mathematical arguments used here to lead in to the article's discussion of "The Singularity" are worth listening to at all. They're pseudo-technical window dressing, meant to lend an undeserved air of rigor to whatever follows. So why should we pay attention to any of it?
Re: The Singularity will occur on a Tuesday
#695Earlier quoted context omitted.
This world where everybody’s very concerned with that “refined form” is annoying and exhausting. It causes discussions to become about speculative guesses about everybody else’s beliefs, not actual facts. In the end it breeds cynicism as “well yes, the belief is wrong, but everybody is stupid and believes it anyway,” becomes a stop-gap argument. I don’t know how to get away from it because ultimately coordination dep…
On the other hand talking about those believes can also lead to real changes. Slavery used to be seen widely a necessary evil, just like for instance war.
Re: The Singularity will occur on a Tuesday
#696Earlier quoted context omitted.
>Do you think you could publish that in a paper for ext ? You seem to think it's not 'just' tensor arithmetic. Have you read any of the seminal papers on neutral networks, say? It's [complex] pattern matching as the parent said. If you want models to draw composite shapes based on letter forms and typography then you need to train them (or at least fine-tune them) to do that. I still get opposite (antonym) confusion…
>You seem to think it's not 'just' tensor arithmetic. If I asked you to explain how a car works and you responded with a lecture on metallic bonding in steel, you wouldn’t be saying anything false, but you also wouldn’t be explaining how a car works. You’d be describing an implementation substrate, not a mechanism at the level the question lives at. Likewise, “it’s tensor arithmetic” is a statement about what the com…
Imagine we put a kid in a huge library of book who doesn't know how to write/read and knows nothing about what letter means etc. That kid stayed in the library and had a change for X amount time which will be enough to look over all of them.
what this will do is that not like us but somehow this kid managed to create patterns in the books.
After that X amount of time, we asked this Kid a question. "What is the capital of Germany?"
That kid will just have it is on kind of map/pattern to say "Berlin". Or kid might say "Berlin is the capital of the Germany" or "Capital of Germany is Berlin." The issue here is that we do not have the understanding of how this kid came of with the answer or what kind of "understanding" or "mapping" being used to reach this answer.
The other part basically shows we do not fully understand how LLM works is: Ask a very complex question to an AI. Like "explain me the mechanics of quantum theory like I am 8 years old".
1- Everytime, it will create differnt answer. Main point is the same but the letters/words etc would be different. Like the example I give above.There are unlimited type of answer AI can give you. 2- Can anyone in the Earth - a human - without a technology access for have unlimited amount of book/paper to check whatever info he needs - tell us the exact sentence/words will LLM use? No.
Then we do not have fully understand of LLM.
You can create a linear regression model and give it 100 people data and all these 100 people are blue eyed. Then give 101 person and ask it to predict the eye color. You already know the exact answer. It will be %100.
Re: The Singularity will occur on a Tuesday
#697Re: The Singularity will occur on a Tuesday
#698Once men turned their thinking over to machines in the hope that this would set them free. But that only permitted other men with machines to enslave them. ... Thou shalt not make a machine in the likeness of a human mind. -- Frank Herbert, Dune You won't read, except the output of your LLM. You won't write, except prompts for your LLM. Why write code or prose when the machine can write it for you? You won't think or…
I like to think
(it has to be!)
of a cybernetic ecology
where we are free of our labors
and joined back to nature,
returned to our mammal
brothers and sisters,
and all watched over
by machines of loving grace.Re: The Singularity will occur on a Tuesday
#699Earlier quoted context omitted.
Honestly, you are just confused. With LLMs, The "knowing" you're describing is trivial and doesn't really constitute knowing at all. It's just the physics of the substrate. When people say LLMs are a black box, they aren't talking about the hardware or the fact that it's "math all the way down." They are talking about interpretability. If I hand you a 175-billion parameter tensor, your 'knowledge' of logic gates does…
It sounds like you're looking for something more than the simple reality that the math is what's going on. It's a complex system that can't simply be debugged through[1], but that doesn't mean it isn't "understood". This reminds me of Searle's insipid Chinese Room; the rebuttal (which he never had an answer for) is that "the room understands Chinese". It's just not satisfying to someone steeped in cultural traditions…
Incidentally, your description of LLMs also describes all software, ever. It's just math, man! That doesn't make you an expert kernel hacker.
Re: The Singularity will occur on a Tuesday
#700Earlier quoted context omitted.
What’s an example of work that does not deal with actual problems?
Online influencers, podcasters, advertisers, social media product managers, political lobbyists, cryptocurrency protocol programmers, digital/NFT artists, most of the media production industry, those people w/ leaf blowers moving dust around, political commentators (e.g. fox & friends), super PACs, most NGOs, "professional" sports, various 3 letter agencies & their associated online "influence" campaigns, think tanks…
In a world re-calibrated to pure problem-solving, presumably we'd ask a mime or other non-digital artist for news on what our government is doing (instead of the Fake News Media), and then an interpretive dancer, not a lobbyist, would intermediate between government and industry? The trombone players would investigate financial crimes, the bassists would monitor our airspace, and the guy currently painting a mural on a wall would be responsible for DoorDashing a cargo ship's worth of food and supplies to a disaster zone (not the bad NGOs)?
Yeah, this is just a list of jobs you don't understand and/or make you feel sad.