Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Intelligence is a commodity. Context is the real AI Moat

adlrocha.substack.com

Post reply on HN
Print view View original

61–70 of 114 posts

Re: Intelligence is a commodity. Context is the real AI Moat

#61

Post by jopsen »

zurfer wrote: post #25

whenever i worry that AI will eventually do all the work I remind myself that the world is full of almost infinite problems and we'll continue to have a choice to be problem solvers over just consumers.

10 years ago self-driving EVs were going to make it so nobody owns a car.

There was a lot of hype. We are possibly still on track to get to that world. But it might easily take another 10-20 years :)

AI will change things, but don't underestimate the timeline.

Also even if we get a super intelligence in a box, it probably won't fold my laundry. Super intelligence might not unlock as much as we dream.

Re: Intelligence is a commodity. Context is the real AI Moat

#62

Post by testdummy13 »

freediver wrote: post #56

As much as I use AI in daily workflows, I do not think an AI-first society will ever be a thing. Historically there is no evidence of that happening with tech revolutions - or rather perhaps you could say to some extent - you can not say that we are an internet-first society, or cars-first society or mobile phone - first society despite these being profound technological revolutions. And more importantly, the only sc…

"Historically there is no evidence of that happening with tech revolutions - or rather perhaps you could say to some extent - you can not say that we are an internet-first society, or cars-first society or mobile phone - first society despite these being profound technological revolutions."

I'm... not actually sure I agree. The US *has* become a more cars first society. Our cities are designed around cars: parking space requirements for business, lacking of biking infrastructure in favor of more lanes, even the introduction of jaywalking as a crime. We've become much more of an internet first society too, we don't use books for research, our banking is largely done online, even humans social circles have moved much more online (probably to the detriment of society).

None of those technologies are as powerful/disruptive as where it seems that AI and LLMs are headed, so it's possible that societies shift towards "AI-first" will be more profound that it was for any of the other technologies listed.

Re: Intelligence is a commodity. Context is the real AI Moat

#63

Post by simianwords »

stanford_labrat wrote: post #50
simianwords wrote: post #28

Earlier quoted context omitted.

Let’s ask in good faith. Can you suggest something that it can’t do? Functional things. I’ll reply in good faith and consider it.

every few months i like to ask chatgpt to do the "thinking" part of my job (scientist) and see how the responses stack up. at the beginning 2022 it was useless because the output was garbage (hallucinations and fake data). nowadays its still useless, but for different reasons. it just regurgitates things already known and published and is unable to come up with novel hypotheses and mechanisms and how to test them. wh…

It is used in pure math research already

Re: Intelligence is a commodity. Context is the real AI Moat

#64

Post by pjsousa79 »

One thing that seems to be missing in most discussions about "context" is infrastructure.

The dream system for AI agents is probably something like a curated data hub: a place where datasets are continuously ingested, cleaned, structured and documented, so agents can query it to obtain reliable context.

Right now most agents spend a lot of effort stitching context together from random APIs, web scraping, PDFs, etc. The result is brittle and inconsistent.

If models become interchangeable, the real leverage might come from shared context layers that many agents can query.

Re: Intelligence is a commodity. Context is the real AI Moat

#65

Post by qsera »

simianwords wrote: post #14

I have my own challenge: I think LLMs can do everything that a human can do and typically way better if the context required for the problem can fit in 10,000 tokens. For now this challenge is text only. Can we think of anything that LLMs can’t do?

> For now this challenge is text only.

That is like saying, "My program is better than any human, but binary inputs only!"..

Even restricted to text, the LLMs are not better than a human who is expert in a domain. Try talking to it regarding any topic. Even in topics that I am not an expert it, the responses from LLMs quickly becomes bland and uninteresting and devoid of additional information..

This is true even in tech things that after a certain point, I stop talking to it and search for a blog/post/so answer written by a human, which if found, would immediately break the plateau of progress that I was facing with the LLM.

Re: Intelligence is a commodity. Context is the real AI Moat

#66

Post by stanford_labrat »

simianwords wrote: post #63
stanford_labrat wrote: post #50

Earlier quoted context omitted.

every few months i like to ask chatgpt to do the "thinking" part of my job (scientist) and see how the responses stack up. at the beginning 2022 it was useless because the output was garbage (hallucinations and fake data). nowadays its still useless, but for different reasons. it just regurgitates things already known and published and is unable to come up with novel hypotheses and mechanisms and how to test them. wh…

It is used in pure math research already

sadly it looks like seanhunter was correct, shame.

Re: Intelligence is a commodity. Context is the real AI Moat

#68

Post by rhubarbtree »

simianwords wrote: post #14

I have my own challenge: I think LLMs can do everything that a human can do and typically way better if the context required for the problem can fit in 10,000 tokens. For now this challenge is text only. Can we think of anything that LLMs can’t do?

LLMs without tooling can not do most tasks. It’s the tools and skills that enable them to do things.

So you may as well ask “is there anything a python script can’t do”. It’s just not a meaningful question.

Post reply on HN