Live data from Hacker News

Bag of words, have mercy on us

experimental-history.com

71–80 of 362 posts

Re: Bag of words, have mercy on us

#71
post #16

Earlier quoted context omitted.

The first VHS sucked when compared to Beta video And it never got better, the superior technology lost, and the war was won through content deals. Lesson: Technology improvements aren't guaranteed.

Beta was not the superior technology, and it lost for very good reasons.

Beta was superior in everything but run length, and it lost because it was more expensive than VHS without being sufficiently superior to justify the cost.

Re: Bag of words, have mercy on us

#72
post #41

Everyone is out here acting like "predicting the next thing" is somehow fundamentally irrelevant to "human thinking" and it is simply not the case. What does it mean to say that we humans act with intent? It means that we have some expectation or prediction about how our actions will effect the next thing, and choose our actions based on how much we like that effect. The ability to predict is fundamental to our abili…

When you have a thought, are you "predicting the next thing"—can you confidently classify all mental activity that you experience as "predicting the next thing"? Language and society constrains the way we use words, but when you speak, are you "predicting"? Science allows human beings to predict various outcomes with varying degrees of success, but much of our experience of the world does not entail predicting things…

Boo LLM-generated comments!

Re: Bag of words, have mercy on us

#74
Is a brain not a token prediction machine?

Tokens in form of neural impulses go in, tokens in the form of neural impulses go out.

We would like to believe that there is something profound happening inside and we call that consciousness. Unfortunately when reading about split-brain patient experiments or agenesis of the corpus callosum cases I feel like we are all deceived, every moment of every day. I came to realization that the confabulation that is observed is just a more pronounced effect of the normal.

Re: Bag of words, have mercy on us

#75
post #41

Everyone is out here acting like "predicting the next thing" is somehow fundamentally irrelevant to "human thinking" and it is simply not the case. What does it mean to say that we humans act with intent? It means that we have some expectation or prediction about how our actions will effect the next thing, and choose our actions based on how much we like that effect. The ability to predict is fundamental to our abili…

I'm an LLMs are being used in workflows they don't make sense in-sayer. And while yes, I can believe that LLMs can be part of a system that actually does think, I believe that to achieve true "thinking", it would likely be a system that is more deterministic in its approach rather than probabilistic.

Especially when modeling acting with intent. The ability to measure against past results and think of new innovative approaches seems like it may come from a system that may model first and then use LLM output. Basically something that has a foundation of tools rather than an LLM using MCP. Perhaps using LLMs to generate a response that humans like to read, but not in them coming up with the answer.

Either way, yes, its possible for a thinking system to use LLMs (and potentially humans piece together sentences in a similar way), but its also possible LLMs will be cast aside and a new approach will be used to create an AGI.

So for me: even if you are an AI-yeasayer, you can still believe that they won't be a component in an AGI.

Re: Bag of words, have mercy on us

#76
post #67

Earlier quoted context omitted.

the anthropomorphization (say that 3 times quickly) is kinda weird, but also makes for a much more pleasant conversation imo. it's kinda tedious being pedantic all the time.

It also leads to fundamentally wrong conclusions: a related issue I have with this is the use of anthropomorphic shorthand when discussing international politics. You've heard a phrase like "the US thinks...", "China wants...", "Europe believes..." so much you don't even notice it. All useful shorthands, all which lead to people displaying fundamental misunderstandings of what they're talking about - i.e. expressing…

It seems obvious to me that entities have emergent needs and plans and so on, independent of any of the humans inside.

For example, if you've worked at a large company, one of the little tragedies is when someone everyone likes gets laid off. There were probably no people who actively wanted Bob to lose his job. Even the CEO/Board who pulled the trigger probably had nothing against Bob. Heck, they might be the next ones out the door. The company is faceless, yet it wanted Bob to go, because that apparently contributed to the company's objective function. Had the company consisted entirely of different people, plus Bob, Bob might have been laid off anyway.

There is a strong will to do ... things the emerges from large structures of people and technology. It's funny like that.

Re: Bag of words, have mercy on us

#77

Earlier quoted context omitted.

> The issue is that prediction is "part" of the human thought process, it's not the full story... Do you have a proof for this? Surely such a profound claim about human thought process must have a solid proof somewhere? Otherwise who's to say all of human thought process is not just a derivative of "predicting the next thing"?

Use your brain and use an LLM for 6 months, you’ll work it out.

Let's go the other route.

What would change your mind? It's an exercise in feasibility.

For example, I don't believe in time travel. If someone made me time travel, and made it undeniable that I was transported back to 1508, then I would not be able to argue against it. In fact, no one in such position would.

What is that equivalent for your conviction? There must be something, otherwise, it's just an opinion that can't be changed.

You don't need to present some actual proof or something. Just lay out some ideas that demonstrate that you are being rational about this and not just sucking up to LLM marketing.

Re: Bag of words, have mercy on us

#78
post #62

Earlier quoted context omitted.

I'm a neurologist, and as a consequence of my profession, I understand how humans work under the hood. The average human is so easily convinced that humans "know", "think", "lie", "want", "understand", etc. But really it's all just a probabilistic chain reaction of electrochemical and thermal interactions. There is literally nowhere in the brain's internals for anything like "knowing" or "thinking" or "lying" to happ…

There are no properties of matter or energy that can have a sense of self or experience qualia. Yet we all do. Denying the hard problem of consciousness just slows down our progress in discovering what it is.

We need a difference to discover what it is. How can we know that all LLMs don't?

Re: Bag of words, have mercy on us

#79

Is a brain not a token prediction machine? Tokens in form of neural impulses go in, tokens in the form of neural impulses go out. We would like to believe that there is something profound happening inside and we call that consciousness. Unfortunately when reading about split-brain patient experiments or agenesis of the corpus callosum cases I feel like we are all deceived, every moment of every day. I came to realiza…

> Is a brain not a token prediction machine?

I would say that, token prediction is one of the things a brain does. And in a lot of people, most of what it does. But I dont think its the whole story. Possibly it is the whole story since the development of language.

Re: Bag of words, have mercy on us

#80
post #41

Everyone is out here acting like "predicting the next thing" is somehow fundamentally irrelevant to "human thinking" and it is simply not the case. What does it mean to say that we humans act with intent? It means that we have some expectation or prediction about how our actions will effect the next thing, and choose our actions based on how much we like that effect. The ability to predict is fundamental to our abili…

> Everyone is out here acting like "predicting the next thing" is somehow fundamentally irrelevant to "human thinking" and it is simply not the case.

Nobody is. What people are doing is claiming that "predicting the next thing" does not define the entirety of human thinking, and something that is ONLY predicting the next thing is not, fundamentally, thinking.

Post reply on HN