Viewing profile — zby

I think it is now or close to now - and not because there is no more to be gained - but rather because it is now clear that you can gain more with the right agent environment. But …

to be frank - mostly because they are now good enough to unlock the other learning paradigms

I know it is overused on tweeter - but all this really seems to be about status. Like Robin Hanson said - people read stuff because it seems prestigious.

IMHO training weights has peaked and now it is time for a training paradigm for prompts and code. We don't have the gradient descent here - but I think it can be more sample effici…

It's a pity that the Perl6 saga killed the new regex ideas - I wish the raku regexes were adopted elsewhere (like the Perl5 regexes were): https://docs.raku.org/language/regexes

There are programs with proofs that they work - but that does not make them reducible. I double checked it with ChatGPT if anyone is interested in more details: https://chatgpt.com…

I have made an experiment with 'idea generation' last year (with much worse llms): https://github.com/zby/DayDreamingDayDreaming The results were promising: https://zzbbyy.substack…

If I remember well, the starting point was that memory is only useful if it changes the system behaviour. There are many ideas of automatic 'tips' or 'rules' that are injected into…

Thanks!

I am not sure if this is sarcasm - but just in case - https://github.com/sshwarts/skillscript does not offer a unified namespace for functions and prompts (agents) like https://git…

I did an automatic review of over 140 such systems. There are comparisons and stuff: https://zby.github.io/commonplace/agent-memory-systems/ Deja-vu is here: https://zby.github.io/…

I believe there should be easy ways to move logic between prompts and code in a smooth ways. Moving from prompts to code is for getting deterministic, fast, well defined and cheap …

Frankly I just skimmed that article, and still commented, bad me. I was also confused by the tag menu - I thought they are sections in the article - I completely failed here :( By …

It is interesting to compare this to LLMs - they also have the bounded context that you can see as the analogue to our working memory. It can contain enormously more bits of inform…

select text and comment on it - then let the llm read all comments

The feature I am waiting for in all of these editors is integrating 'red lining' as a channel for LLM input. This is the best interface for working on a text. https://www.roughdraf…

If the action is decided by code based on metadata - then what is really the LLM task? And if you say that it is only the type of action that is decided by code - then this is mayb…

They do predict what injections might be effective - so it is a theory. I don't know how novel it is and it is not very deep (as you noted the general mechanism is quite obvious) -…

The video seems to be about mushrooms.

The fact that programmers can be nerd sniped into yak shaving some random libraries is the only thing that keeps Open Source running.

I would love to hear from someone knowledgeable - is that bad for the company or good?

I am open to changing my mind and I am looking forward for answers to your question - but I think it is like a click bait - looks interesting - but not really useful.

I am building my self-hosting llm-wiki system ( https://gist.github.com/karpathy/442a6bf555914893e9891c11519... ). My approach is to start with a theory of how such systems could w…

I think I fixed this in a later revision. Does that persist?

There is also https://github.com/Dicklesworthstone/pi_agent_rust I vibed a comparison/review of these two systems using my llm wiki: https://zby.github.io/commonplace/work/pi-agent…