The New Moat: Memory
jeffmorrisjr.substack.com
The New Moat: Memory
1–10 of 25 posts
Re: The New Moat: Memory
#2I haven't been able to figure out how there's a moat for AI products that, if they work as advertised, can build a bridge over any most with near zero user effort.
Re: The New Moat: Memory
#3Sorry, but the OP is all fluffy hype, zero substance. There are no explanations, no links to research, and no links to code.
When the author mentions "memory," what does that mean? Is this about RAG-style memory? I'm not sure that's a "moat."
Re: The New Moat: Memory
#4[deleted]
Re: The New Moat: Memory
#5I haven't been able to figure out how there's a moat for AI products that, if they work as advertised, can build a bridge over any most with near zero user effort.
The article is about exactly that.
The moat for AI products will be, as is so often the case, user data. In this case, your personal history of interactions with a given AI.
The author predicts a land grab where AI companies try to scoop up as much personal data on you as they can as fast as they can, which renders them significantly more personalized to you than other AIs. That's the moat.
Analogous to Facebook managing to scoop up your entire social graph. Other social networks popped up, but there was no incentive to use them because you didn't have your social graph setup there and it was really hard to rebuild.
Re: The New Moat: Memory
#6Sorry, but the OP is all fluffy hype, zero substance. There are no explanations, no links to research, and no links to code. When the author mentions "memory," what does that mean? Is this about RAG-style memory? I'm not sure that's a "moat."
Was there supposed to be? The article isn't technical in nature. It's predicting upcoming business shifts in the AI industry.
Re: The New Moat: Memory
#7Does anyone really like and enjoy LLM products with memory at this point? To me this seems to be a case where the technical ability to do memory vastly exceeds its actual usefulness (for most people).
Re: The New Moat: Memory
#8Can't speak for anyone else, but my own AI chat history has low/no relevance to the quality of response to the next question I ask. This is not a moat any more than search history is.
My email and work documents are obviously important if I'm querying for information about them, but that is self evident and also not a moat (I could grant another tool access to these things).
Computational efficiency is a moat. If Google can provide an AI response for $0.05 of infrastructure and electricity, but it takes OpenAI $0.57, that's bad news for OpenAI.
Re: The New Moat: Memory
#9Does anyone really like and enjoy LLM products with memory at this point? To me this seems to be a case where the technical ability to do memory vastly exceeds its actual usefulness (for most people).
Absolutely, to the point where I don’t know if I’d use AI tools at all without memory. It is critical for working on long-term projects whose complexity I don’t want to repeat every time I ask a question or explore an idea.
But I am using ChatGpt mostly as a way to flesh out ideas, question my assumptions, and do similar things, so YMMV.
Re: The New Moat: Memory
#10Does anyone really like and enjoy LLM products with memory at this point? To me this seems to be a case where the technical ability to do memory vastly exceeds its actual usefulness (for most people).
Yeah, it keeps me having to explain a lot of context every time i ask a question, particularly what tech stack i use