Earlier quoted context omitted.
> Contrast with the way a human learns skills - as we gain experience with a skill, we get better at understanding when it's the right tool for the job. Which is precisely why Richard Sutton doesn't think LLMs will evolve to AGI[0]. LLMs are based on mimicry, not experience, so it's more likely (according to Sutton) that AGI will be based on some form of RL (reinforcement learning) and not neural networks (LLMs). Mor…
It's a false dichotomy. LLMs are already being trained with RL to have goal directedness. He is right that non-RL'd LLMs are just mimicry, but the field already moved beyond that.
Claude Skills
121–130 of 443 posts
Re: Claude Skills
#122Just me or is anthropic doing a lot better of a job at marketing than openai and google?
Re: Claude Skills
#123Earlier quoted context omitted.
> Contrast with the way a human learns skills - as we gain experience with a skill, we get better at understanding when it's the right tool for the job. Which is precisely why Richard Sutton doesn't think LLMs will evolve to AGI[0]. LLMs are based on mimicry, not experience, so it's more likely (according to Sutton) that AGI will be based on some form of RL (reinforcement learning) and not neural networks (LLMs). Mor…
It's a false dichotomy. LLMs are already being trained with RL to have goal directedness. He is right that non-RL'd LLMs are just mimicry, but the field already moved beyond that.
Re: Claude Skills
#124Earlier quoted context omitted.
IMO this is a context window issue. Humans are pretty good are memorizing super broad context without great accuracy. Sometimes our "recall" function doesn't even work right ("How do you say 'blah' in German again?"), so the more you specialize (say, 10k hours / mastery), the better you are at recalling a specific set of "skills", but perhaps not other skills. On the other hand, LLMs have a programatic context with c…
I commented here already about deli-gator ( https://github.com/ryancnelson/deli-gator ) , but your summary nailed what I didn’t mention here before: Context. I’d been re-teaching Claude to craft Rest-api calls with curl every morning for months before i realized that skills would let me delegate that to cheaper models, re-using cached-token-queries, and save my context window for my actual problem-space CONTEXT.
what the fuck, there is absolutely no way this was cheaper or more productive than just learning to use curl and writing curl calls yourself. Curl isn't even hard! And if you learn to use it, you get WAY better at working with HTTP!
You're kneecapping yourself to expend more effort than it would take to just write the calls, helping to train a bot to do the job you should be doing
Re: Claude Skills
#125I'm a little confused.
Re: Claude Skills
#126Does anyone know how skills relate to subagents? Seems that subagents have more capabilities (e.g. can access the internet) but seems that there's a lot of overlap. I've asked Claude and this it answered this: Skills = Instructions + resources for the current Claude instance (shared context) Subagents = Separate AI instances with isolated contexts that can work in parallel (different context windows) Skills make Clau…
How this reads to me is that a skill is "just" a bundle of prompts, scripts, and files that can be read into context as a unit. Having a sub-agent "execute" a skill makes a lot of sense from a context management, perspective, but I think the way to think about it is that a sub-agent is an "execution-level" construct, whereas a skill is a "data-level" construct.
Re: Claude Skills
#127Re: Claude Skills
#128Earlier quoted context omitted.
I commented here already about deli-gator ( https://github.com/ryancnelson/deli-gator ) , but your summary nailed what I didn’t mention here before: Context. I’d been re-teaching Claude to craft Rest-api calls with curl every morning for months before i realized that skills would let me delegate that to cheaper models, re-using cached-token-queries, and save my context window for my actual problem-space CONTEXT.
>I’d been re-teaching Claude to craft Rest-api calls with curl every morning for months what the fuck, there is absolutely no way this was cheaper or more productive than just learning to use curl and writing curl calls yourself. Curl isn't even hard! And if you learn to use it, you get WAY better at working with HTTP! You're kneecapping yourself to expend more effort than it would take to just write the calls, helpi…
Re: Claude Skills
#129getting hard to keep up with skills, plugins, marketplaces, connectors, add-ons, yada yada
Yep. Now I need an AI to help me use AI
Re: Claude Skills
#130Earlier quoted context omitted.
> Contrast with the way a human learns skills - as we gain experience with a skill, we get better at understanding when it's the right tool for the job. Which is precisely why Richard Sutton doesn't think LLMs will evolve to AGI[0]. LLMs are based on mimicry, not experience, so it's more likely (according to Sutton) that AGI will be based on some form of RL (reinforcement learning) and not neural networks (LLMs). Mor…
It's a false dichotomy. LLMs are already being trained with RL to have goal directedness. He is right that non-RL'd LLMs are just mimicry, but the field already moved beyond that.