Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Open source memory layer so any AI agent can do what Claude.ai and ChatGPT do

alash3al.github.io

Post reply on HN
Print view View original

11–20 of 87 posts

Re: Open source memory layer so any AI agent can do what Claude.ai and ChatGPT do

#11

Post by dwb »

I’m certainly on the lookout for something like this and I’m happy to see your account has published software from before the LLM boom as well. I guess I’d like some kind of LLM-use-statement attached to projects: did you use an LLM to generate this, and if so, how much and what stages (design, build, test)? How carefully did you review the output? Do you feel the quality is at least what you could have produced by yourself? That sort of thing.

Not casting aspersions on you personally, I’d really like this from every project, and would do the same myself.

Re: Open source memory layer so any AI agent can do what Claude.ai and ChatGPT do

#12

Post by Incipient »

I still haven't found useful "memory". It's either an agents.md with a high level summary, which is fairly useless for specific details (eg "editing this element needs to mark this other element as a draft") or something detailed and explaining the nitty gritty, which seems to give too much detail such that it gets ignored, or detail from one functional area contaminates the intended changes in another functional area.

The only approach I've found that works is no memory, and manually choosing the context that matters for a given agent session/prompt.

Re: Open source memory layer so any AI agent can do what Claude.ai and ChatGPT do

#13

Post by clutter55561 »

Incipient wrote: post #12

I still haven't found useful "memory". It's either an agents.md with a high level summary, which is fairly useless for specific details (eg "editing this element needs to mark this other element as a draft") or something detailed and explaining the nitty gritty, which seems to give too much detail such that it gets ignored, or detail from one functional area contaminates the intended changes in another functional are…

All the memories Claude created for me fell in the category remember-to-not-forget, so I disabled it altogether.

Re: Open source memory layer so any AI agent can do what Claude.ai and ChatGPT do

#14

Post by dennisy »

dwb wrote: post #11

I’m certainly on the lookout for something like this and I’m happy to see your account has published software from before the LLM boom as well. I guess I’d like some kind of LLM-use-statement attached to projects: did you use an LLM to generate this, and if so, how much and what stages (design, build, test)? How carefully did you review the output? Do you feel the quality is at least what you could have produced by y…

This is a fair question, but not one I feel we can let people self answer.

I doubt many people will honestly admit they did no design, testing and that they believe the code is sub par.

It does give me an idea that maybe we need a third party system which can try and answer some of the questions you are asking… of course it too would be LLM driven and quite subjective.

Re: Open source memory layer so any AI agent can do what Claude.ai and ChatGPT do

#15

Post by awestroke »

dennisy wrote: post #5
great_psy wrote: post #3

LLM Memeory (in general, any implementation) is good in theory. In practice, as it grows it gets just as messy as not having it. In the example you have on front page you say “continue working on my project”, but you’re rarely working on just one project, you might want to have 5 or 10 in memory, each one made sense to have at the time. So now you still have to say, “continue working on the sass project”, sure there’…

True! But this is a very naive implementation, a proper implementation could surpass these challenges.

Well let's talk again when the problems have been solved, then. Until then, manually curated skills and documentation will beat this

Re: Open source memory layer so any AI agent can do what Claude.ai and ChatGPT do

#16

Post by jvwww »

Incipient wrote: post #12

I still haven't found useful "memory". It's either an agents.md with a high level summary, which is fairly useless for specific details (eg "editing this element needs to mark this other element as a draft") or something detailed and explaining the nitty gritty, which seems to give too much detail such that it gets ignored, or detail from one functional area contaminates the intended changes in another functional are…

Yeah I feel the same way. Wonder when/if we'll get continual learning from these models. I feel like they are smart enough already but their lack of real memory makes them a pain to deal with.

Re: Open source memory layer so any AI agent can do what Claude.ai and ChatGPT do

#18

Post by dwb »

dennisy wrote: post #14
dwb wrote: post #11

I’m certainly on the lookout for something like this and I’m happy to see your account has published software from before the LLM boom as well. I guess I’d like some kind of LLM-use-statement attached to projects: did you use an LLM to generate this, and if so, how much and what stages (design, build, test)? How carefully did you review the output? Do you feel the quality is at least what you could have produced by y…

This is a fair question, but not one I feel we can let people self answer. I doubt many people will honestly admit they did no design, testing and that they believe the code is sub par. It does give me an idea that maybe we need a third party system which can try and answer some of the questions you are asking… of course it too would be LLM driven and quite subjective.

> I doubt many people will honestly admit they did no design, testing and that they believe the code is sub par.

Well no, but if people want to see a statement like this, and given that most people will want to be at least halfway honest and not admit to slop, maybe it will help nudge things in the right direction.

Re: Open source memory layer so any AI agent can do what Claude.ai and ChatGPT do

#19

Post by embedding-shape »

dennisy wrote: post #14
dwb wrote: post #11

I’m certainly on the lookout for something like this and I’m happy to see your account has published software from before the LLM boom as well. I guess I’d like some kind of LLM-use-statement attached to projects: did you use an LLM to generate this, and if so, how much and what stages (design, build, test)? How carefully did you review the output? Do you feel the quality is at least what you could have produced by y…

This is a fair question, but not one I feel we can let people self answer. I doubt many people will honestly admit they did no design, testing and that they believe the code is sub par. It does give me an idea that maybe we need a third party system which can try and answer some of the questions you are asking… of course it too would be LLM driven and quite subjective.

> I doubt many people will honestly admit they did no design, testing and that they believe the code is sub par

I'd doubt any engineer that doesn't call most of their own code subpar after a week or two after looking back. "Hacking" also famously involves little design or (automated) testing too, so sharing something like that doesn't mean much, unless you're trying to launch a business, but I see no evidence of that for this project.

Re: Open source memory layer so any AI agent can do what Claude.ai and ChatGPT do

#20

Post by chickensong »

dwb wrote: post #11

I’m certainly on the lookout for something like this and I’m happy to see your account has published software from before the LLM boom as well. I guess I’d like some kind of LLM-use-statement attached to projects: did you use an LLM to generate this, and if so, how much and what stages (design, build, test)? How carefully did you review the output? Do you feel the quality is at least what you could have produced by y…

What's the point? You can make good or bad software, with or without LLMs. Do you ask a carpenter if they use a hammer or nail gun? Did they only use the nail gun for the roof and the deck?

If you care that much and don't have a foundation of trust, you need to either verify the construction is good, or build it yourself. Anything else is just wishful thinking.

Post reply on HN