Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Intelligence is a commodity. Context is the real AI Moat

adlrocha.substack.com

Post reply on HN
Print view View original

91–100 of 114 posts

Re: Intelligence is a commodity. Context is the real AI Moat

#91

Post by ileonichwiesz »

hirvi74 wrote: post #40
keiferski wrote: post #26

Earlier quoted context omitted.

Right now, 30 seconds ago, I asked ChatGPT to tell me about a book I found that was written in the 60s. It made up the entire description. When I pointed this out, it apologized and then made up another description. The idea that this is going to lead to superintelligence in a few years is absolutely nonsense.

The other day I asked Claude Opus 4.6 one of my favorite trivia pieces: What plural English word for an animal shares no letters with its singular form? Collective nouns (flock, herd, school, etc.) don't count. Claude responded with: "The answer is geese -- the plural of cow." Though, to be fair, in the next paragraph of the response, Claude stated the correct answer. So, it went off the rails a bit, but self-correct…

Of course it’s important to remember that the ability of an LLM to answer an obscure riddle like that has nothing to do with its reasoning abilities, but rather depends on whether the answer was included in its training dataset.

Re: Intelligence is a commodity. Context is the real AI Moat

#92

Post by zkmon »

This seems assumes coding as the usecase. A lot of business activity expects software outputs be precise, reproducible and can be held liable for accuracy. Imagine excel spreadsheet showing approximate numbers as formula outputs. "Caution: AI might make mistakes" is basically saying that I'm not responsible for correctness of my outputs. Does speed compensate for accuracy loss? Maybe, in some cases. But a lot of AI stories pretend that it is acceptable in all cases.

Re: Intelligence is a commodity. Context is the real AI Moat

#94

Post by dworks »

pjsousa79 wrote: post #64

One thing that seems to be missing in most discussions about "context" is infrastructure. The dream system for AI agents is probably something like a curated data hub: a place where datasets are continuously ingested, cleaned, structured and documented, so agents can query it to obtain reliable context. Right now most agents spend a lot of effort stitching context together from random APIs, web scraping, PDFs, etc. T…

Data should not be ingested. Data should originate from the same environment that you want to activate it in. That means you need build a system from the ground up for your searches, your document creation etc, so that this data is native to your system and then easily referenced in your commands to the llm interface.

The best example of this is probably CrewAI and Alibaba CoPaw. CoPaw has a demo up.

Re: Intelligence is a commodity. Context is the real AI Moat

#95

Post by doomslayer999 »

stanford_labrat wrote: post #50
simianwords wrote: post #28

Earlier quoted context omitted.

Let’s ask in good faith. Can you suggest something that it can’t do? Functional things. I’ll reply in good faith and consider it.

every few months i like to ask chatgpt to do the "thinking" part of my job (scientist) and see how the responses stack up. at the beginning 2022 it was useless because the output was garbage (hallucinations and fake data). nowadays its still useless, but for different reasons. it just regurgitates things already known and published and is unable to come up with novel hypotheses and mechanisms and how to test them. wh…

I am also a scientist and had the same conclusion. I just use it to summarize papers, occasionally write boilerplate, and sometimes do some google search primitives if its an easy question.

Re: Intelligence is a commodity. Context is the real AI Moat

#96

Post by jononor »

energy123 wrote: post #43
WarmWash wrote: post #21

Earlier quoted context omitted.

>- 'Automation will lead to immediate devaluation of human labor that is routine. Society needs to decouple a person's "worth" from their "utility as a tool".' I have this vision that in absence of the ability for people to form social hierarchies on the back of their economic value to society, there will be this AI fueled class hierarchy of people's general social ability. So rather than money determining your neigh…

If we have post scarcity due to AI, everything becomes so uncertain. Why would we still have violent and crazy people? Surely the ASI could figure it out and fix whatever is going on in their brains. It's so fuzzy after that event horizon I have no confidence in any predictions.

There are easy fixes to get rid of violent and crazy people. Why would a powerful ASI bother with fixing them? A rabid dog just gets put down by humans. Why would we expect anything better of our overlords?

Re: Intelligence is a commodity. Context is the real AI Moat

#97

Post by jsw97 »

baxtr wrote: post #54

For anyone worried about AGI coming soon. Today I asked Claude to stop using em dashes. That was his/her answer: Noted — I'II avoid em dashes going forward and use other punctuation or restructure sentences instead.

This seems like the most intelligent response, in some ways, because it’s funny and tweaks the user. I could see myself replying like this.

Re: Intelligence is a commodity. Context is the real AI Moat

#98

Post by hirvi74 »

ileonichwiesz wrote: post #91
hirvi74 wrote: post #40

Earlier quoted context omitted.

The other day I asked Claude Opus 4.6 one of my favorite trivia pieces: What plural English word for an animal shares no letters with its singular form? Collective nouns (flock, herd, school, etc.) don't count. Claude responded with: "The answer is geese -- the plural of cow." Though, to be fair, in the next paragraph of the response, Claude stated the correct answer. So, it went off the rails a bit, but self-correct…

Of course it’s important to remember that the ability of an LLM to answer an obscure riddle like that has nothing to do with its reasoning abilities, but rather depends on whether the answer was included in its training dataset.

The word is in most online dictionaries for what it is worth. It's also used in Biblical texts, albeit only a handful of times. I do agree it's not a true assessment of an LLM's overall reasoning. No person I have ever asked that riddle to has gotten it correct. Then again, that is probably partly the point of the riddle.

I would like to reiterate that both Claude and GPT answered correctly. It was just bizarre how Claude got a initial, minor detail incorrect, but reasoned enough to get the more difficult answer correct.

Re: Intelligence is a commodity. Context is the real AI Moat

#99

Post by keiferski »

i_think_so wrote: post #86
keiferski wrote: post #26

Earlier quoted context omitted.

Right now, 30 seconds ago, I asked ChatGPT to tell me about a book I found that was written in the 60s. It made up the entire description. When I pointed this out, it apologized and then made up another description. The idea that this is going to lead to superintelligence in a few years is absolutely nonsense.

Is that because this book is obscure and no human has yet written a description that could be scraped?

No it was just an anthology of papers by a reasonably well-known academic.

The problem is more that instead of reasoning and realizing it didn’t actually know about the book, it just looked up a description of the author and then invented what this book was supposedly about based on the title.

A more intelligent reply would have been something like, “the author appears to be an academic in international relations, but I cannot find this exact book title.” Instead it just repeatedly gave me fake answers.

Re: Intelligence is a commodity. Context is the real AI Moat

#100

Post by itemize123 »

baxtr wrote: post #84
skeptic_ai wrote: post #57

Earlier quoted context omitted.

I know some very smart guys that don’tknow how to use a microwave. And what? Doesn’t mean much

Are you afraid of them?

if he's in competition for a job with them, probably yes.
Post reply on HN