[deleted]
The New Moat: Memory
11–20 of 25 posts
Re: The New Moat: Memory
#12Can't speak for anyone else, but my own AI chat history has low/no relevance to the quality of response to the next question I ask. This is not a moat any more than search history is. My email and work documents are obviously important if I'm querying for information about them, but that is self evident and also not a moat (I could grant another tool access to these things). Computational efficiency is a moat. If Goo…
Does that mean you never engage in multi-question dialogues exploring / trying to solve a particular problem? In other words, every query you have is unrelated to all others?
If that’s the case, it mostly just seems like you’re not working on sufficiently complex problems to find the AI useful. Or are just keeping that complexity in your head, and just bringing in the AI “as a consultant,” as it were.
If that’s the case, I recommend trying to organize your project with the AI from the start. I’ve had a lot of productive benefits from treating ChatGPT folders as ongoing conversations about a particular project, questions I have on it, random ideas, etc. Memory is absolutely crucial for my use case.
Re: The New Moat: Memory
#13Can't speak for anyone else, but my own AI chat history has low/no relevance to the quality of response to the next question I ask. This is not a moat any more than search history is. My email and work documents are obviously important if I'm querying for information about them, but that is self evident and also not a moat (I could grant another tool access to these things). Computational efficiency is a moat. If Goo…
Does that mean you never engage in multi-question dialogues exploring / trying to solve a particular problem? In other words, every query you have is unrelated to all others? If that’s the case, it mostly just seems like you’re not working on sufficiently complex problems to find the AI useful. Or are just keeping that complexity in your head, and just bringing in the AI “as a consultant,” as it were. If that’s the c…
Also that memory (and your conversations, your interactions) are the actual moat.
There's plenty of code out there, but there's not a lot of "how does a developer interact with a code base" outside of commits.
The interaction data is the actual interesting but, but there's no guarantee that its the refinement that's best needed.
Re: The New Moat: Memory
#14This is a great reason to learn from our mistakes of the 2010s and not give ourselves away to OpenAI and other cloud AI providers.
I would like to see a memory provider/system that allows us to own this data and put OpenAI et al on the customer end. They should be paying US for that.
Re: The New Moat: Memory
#15Can't speak for anyone else, but my own AI chat history has low/no relevance to the quality of response to the next question I ask. This is not a moat any more than search history is. My email and work documents are obviously important if I'm querying for information about them, but that is self evident and also not a moat (I could grant another tool access to these things). Computational efficiency is a moat. If Goo…
Does that mean you never engage in multi-question dialogues exploring / trying to solve a particular problem? In other words, every query you have is unrelated to all others? If that’s the case, it mostly just seems like you’re not working on sufficiently complex problems to find the AI useful. Or are just keeping that complexity in your head, and just bringing in the AI “as a consultant,” as it were. If that’s the c…
I run into this all the time with chatgpt, we hit a roadblock on A, go down path B, we solve B which solves A, now it cant rewind to keep solving A so i have to start over.
OR it keeps telling me one thing or another
"X didnt work, heres the output"
OK try "X"
ok buddy.
Re: The New Moat: Memory
#16This is a great reason to learn from our mistakes of the 2010s and not give ourselves away to OpenAI and other cloud AI providers. I would like to see a memory provider/system that allows us to own this data and put OpenAI et al on the customer end. They should be paying US for that.
But I want their models to know as much as possible about me - it should improve my experience using them.
Re: The New Moat: Memory
#17I haven't been able to figure out how there's a moat for AI products that, if they work as advertised, can build a bridge over any most with near zero user effort.
The article is about exactly that. The moat for AI products will be, as is so often the case, user data. In this case, your personal history of interactions with a given AI. The author predicts a land grab where AI companies try to scoop up as much personal data on you as they can as fast as they can, which renders them significantly more personalized to you than other AIs. That's the moat. Analogous to Facebook mana…
When I want to try a new AI, it can offer to import my data by using my computer and reading the screen.
Re: The New Moat: Memory
#18Earlier quoted context omitted.
The article is about exactly that. The moat for AI products will be, as is so often the case, user data. In this case, your personal history of interactions with a given AI. The author predicts a land grab where AI companies try to scoop up as much personal data on you as they can as fast as they can, which renders them significantly more personalized to you than other AIs. That's the moat. Analogous to Facebook mana…
When I want to try a new AI, it can offer to import my data by using my computer and reading the screen.
> import my data by using my computer
You're under the mistaken impression that you will own this data. What you are describing is akin to saying you will just export your friends list, posts, messages, pictures, etc from facebook to some other social network.
Maybe you are technically able to run your own AIs (and I guess they would somehow be supported by these other platforms?). But most people are not.
Re: The New Moat: Memory
#19Can't speak for anyone else, but my own AI chat history has low/no relevance to the quality of response to the next question I ask. This is not a moat any more than search history is. My email and work documents are obviously important if I'm querying for information about them, but that is self evident and also not a moat (I could grant another tool access to these things). Computational efficiency is a moat. If Goo…
Does that mean you never engage in multi-question dialogues exploring / trying to solve a particular problem? In other words, every query you have is unrelated to all others? If that’s the case, it mostly just seems like you’re not working on sufficiently complex problems to find the AI useful. Or are just keeping that complexity in your head, and just bringing in the AI “as a consultant,” as it were. If that’s the c…
> Does that mean you never engage in multi-question dialogues exploring / trying to solve a particular problem?
No. Iterative interrogation is the main way these tools are used, hence "Chat" GPT. It is rare that I'm revising queries from a week ago.
More useful AI context comes from permanent (and portable) artifacts like a code repo. Having a 2 million token context window is much more useful than being able to continue a chat session from a week or more ago.
Re: The New Moat: Memory
#20Does anyone really like and enjoy LLM products with memory at this point? To me this seems to be a case where the technical ability to do memory vastly exceeds its actual usefulness (for most people).
Yeah, it keeps me having to explain a lot of context every time i ask a question, particularly what tech stack i use
In my experience, if I create a ChatGPT project or a Gemini Gem, it seems to remember everything I put in the instructions, which includes my tech stack, specific packages I'm using, preferences, and so on. ChatGPT remembers some of these things across chats that aren't within a project, but it's hit or miss. Gemini remembers absolutely nothing from one chat to another unless you're working in a Gem, but inside a Gem it's been very good at remembering quite a lot of stuff, particularly when using Gem 2.5. YMMV.