the thing is, you can't know if i'm an ai generated comment or not. this is the thing.
Looks like you were trained on data without any capital letters.
Rodney Brooks on limitations of generative AI
121–130 of 202 posts
Re: Rodney Brooks on limitations of generative AI
#122Earlier quoted context omitted.
Okay, interesting, but I meant nobody actually ended up sending thousands of little robots to other planets. No doubt the research led to some nice things. Edit: the direct sensory-action coupling idea makes sense from a control perspective (fast interaction loops can compensate for chaotic dynamics in the environment), but we know these days that brains don't work that way, for instance. I wonder how that perspectiv…
About four years before Rodney Brooks proposed Subsumption Architecture, some Terrapin Logo hackers from the MIT-AI Lab wrote a proposal for the military to use totally out-of-control Logo Turtles in combat, in this article they published on October 1, 1982 in ACM SIGART Bulletin Issue 82, pp 23–25: https://dl.acm.org/doi/10.1145/1056602.1056608 https://donhopkins.com/home/TurtlesAndDefense.pdf >TURTLES AND DEFENSE >…
This is too great. Thanks for the link!
Re: Rodney Brooks on limitations of generative AI
#123Earlier quoted context omitted.
> integrate an LLM into Slack They are already training their models https://slack.com/intl/en-gb/trust/data-management/privacy-p... > Microsoft to integrate an LLM into outlook Unlikely to happen. Orgs that use MS products do not want content of emails leaking and LLMs leak. There is a real danger that an LLM will include information in the summary that does not come from the original email thread, but from other em…
>>Microsoft to integrate an LLM into outlook Didn't they already do this? A friend of mine showed me his outlook where he could search all emails, docs, and video calls and ask it questions. To be fair, he and I asked it questions about a video call and a doc - but not any emails, we only searched emails. This was last week amd it worked "mostly OK," but having a q/a conversation with a long email feels inevitable
Asking questions about a document is one thing; asking questions that synthesize information across many documents — the human-intelligent equivalent of doing a big OLAP query with graph-search and fulltext-search parts on your email database — is quite another.
Right now AFAICT the latter would require the full text of all the emails you've ever sent, to be stuffed into the context window together.
Re: Rodney Brooks on limitations of generative AI
#124Earlier quoted context omitted.
ChatGPT makes mistakes doing basic arithmetic or sorting numbers. Pretty sure we have enough data for these fundamental tasks.
It's more than enough data for a specialized tool, yes. It's not even remotely enough data for a statistical language processor.
Why are young children able to quickly surpass state-of-the-art ML models at arithmetic tasks, from only a few hours of lecturing and a "training dataset" (worksheets) consisting of maybe a thousand total examples?
What is happening in the human learning process from those few thousand examples, to deduce so much more about "the rules of math" per marginal datapoint?
Re: Rodney Brooks on limitations of generative AI
#125Earlier quoted context omitted.
Okay, interesting, but I meant nobody actually ended up sending thousands of little robots to other planets. No doubt the research led to some nice things. Edit: the direct sensory-action coupling idea makes sense from a control perspective (fast interaction loops can compensate for chaotic dynamics in the environment), but we know these days that brains don't work that way, for instance. I wonder how that perspectiv…
About four years before Rodney Brooks proposed Subsumption Architecture, some Terrapin Logo hackers from the MIT-AI Lab wrote a proposal for the military to use totally out-of-control Logo Turtles in combat, in this article they published on October 1, 1982 in ACM SIGART Bulletin Issue 82, pp 23–25: https://dl.acm.org/doi/10.1145/1056602.1056608 https://donhopkins.com/home/TurtlesAndDefense.pdf >TURTLES AND DEFENSE >…
See why today's hackers aren't real hackers? Where are the mischievous hackers hacking Roombas to raise and lower a pen and scrawl dirty messages on their owners' clean floors? Instead what we get is an ELIZA clone that speaks like a Roomba sucked all the soul out of the entire universe.
Re: Rodney Brooks on limitations of generative AI
#126Earlier quoted context omitted.
There will never be, and can never be, "artificial intelligence". (The creation of consciousness is impossible.) It's a fun/interesting device in science fiction , just like the concept of golems (animated beings) are in folk tales. But it's complete nonsense to talk about it as a possibility in the real world so yes, the label of 'machine learning' is a far, far better label to use for this powerful and interesting…
> There will never be, and can never be, "artificial intelligence". And machines can't learn.
Can machines fly by themselves?
Re: Rodney Brooks on limitations of generative AI
#127Earlier quoted context omitted.
> integrate an LLM into Slack They are already training their models https://slack.com/intl/en-gb/trust/data-management/privacy-p... > Microsoft to integrate an LLM into outlook Unlikely to happen. Orgs that use MS products do not want content of emails leaking and LLMs leak. There is a real danger that an LLM will include information in the summary that does not come from the original email thread, but from other em…
>>Microsoft to integrate an LLM into outlook Didn't they already do this? A friend of mine showed me his outlook where he could search all emails, docs, and video calls and ask it questions. To be fair, he and I asked it questions about a video call and a doc - but not any emails, we only searched emails. This was last week amd it worked "mostly OK," but having a q/a conversation with a long email feels inevitable
The definitely added it to the web version n LinkedIn, you can see it when you want to write or reply to a message and it gives you an option to "Write with AI".
Re: Rodney Brooks on limitations of generative AI
#128Earlier quoted context omitted.
I’m still waiting for SalesForce to integrate an LLM into Slack so I can ask it business logic and decisions long lost. Still waiting for Microsoft to integrate an LLM into outlook so I can get a summary of a 20 email long chain I just got CCed into. I don’t think the iPod comparison is a valid one. People only have so much time to listen to music. Past a certain point, no one has enough good music they like to put i…
Haha, I'd be happy if outlook just integrated a search that actually works. Most of outlook search results aren't even relevant, and it regularly misses things I know are there. Literally the most useless search I've ever had to use.
That’s exactly my thoughts. If search is broken, expecting LLMs to fix that sounds naive or just disingenious.
Re: Rodney Brooks on limitations of generative AI
#129Earlier quoted context omitted.
> integrate an LLM into Slack They are already training their models https://slack.com/intl/en-gb/trust/data-management/privacy-p... > Microsoft to integrate an LLM into outlook Unlikely to happen. Orgs that use MS products do not want content of emails leaking and LLMs leak. There is a real danger that an LLM will include information in the summary that does not come from the original email thread, but from other em…
> There is a real danger that an LLM will include information in the summary that does not come from the original email thread, but from other emails the model was trained on. You could learn from the summary that you are going to get fired, even though that was not a part of the original conversation. HR doesn't like that. There could be separate personal fine-tunes per user, trained (in the cloud) on the contents o…
> There could be separate personal fine-tunes per use
Yes, but that contradicts the earlier claim that giving AI more info makes it better. If fact, those who send few emails or just joined may see worse results due to the lack of data. LLMs really make us hard to come up with ideas on how to solve problems that did not exist without LLMs.
Re: Rodney Brooks on limitations of generative AI
#130Earlier quoted context omitted.
> we would have an iPod with 160TB of storage by 2017, but of course we didn’t. 160 Tera Bytes to store what? I probably would never listen to more than a few GBs of high fidelity music in my life time. Why would anyone keep investing in exponential growth or even linear growth beyond a point of utility and economic sense. This can be extrapolated to miniaturization also ... why is a personal computer not smaller tha…
> I probably would never listen to more than a few GBs of high fidelity music in my life time. FWIW, I currently have about 100 GB of music on my phone. And that is in a fairly high quality AAC format. Converted to lossless, it might be about five times that size? I don't even think of my music collection as all that extensive. But still, 160 TB would be a different ball game altogether. For sure, there is no mass ma…
You have a collection. Do or will you ever listen to it all end to end? I doubt it.