Viewing profile — sjmaplesec

Full set of models tested: claude-opus-4-7 claude-opus-4-6 claude-sonnet-4-6 claude-haiku-4-5 gpt-5.4 gpt-5.3-codex gpt-5-codex cursor-composer-2 11 Skills used were here: https://…

Pass in a skill and it'll roast the contents: "This is not just useless - it is an insult to the very concept of functionality."

I ran some evals to see which Anthropic models use skills the best, between Opus, Sonnet and Haiku. I was pretty impressed how good Haiku was with skills at completing various task…

Link to all the review scans is here - mostly in the 50-70% range https://tessl.io/registry/skills/github/googleworkspace/cli

There's so much more we can do around activation and skills creation. Looking at the eval results, there are even cases where the context makes the agent worse. Scenario 5, test 1 …

The review eval tests language, activation etc of skills. I guess you could move it all to a skill quick and then run an eval on that if using Tessl. This checks if the way you wri…

An eval is to an LLM as a test is to code.

Tessl can generate the evals, both to test anthropic best practices as well as running scenarios with and without the skill to check if it's helping

Can add this as a skill or as part of a skill, and so you don't need to keep prompting the same things.

No, the context can be human created as much as it could be llm generated. The suggestions are based on Anthropic best practices and allow the agents to activate, and use the skill…

This resonates with my experience: we have dozens of internal “playbooks” and prompt snippets floating around, and nobody knows which ones still work after model changes. If you ca…

This is so true!

I'm pretty sure Olivier Pomel rarely does podcasts, but this was a pretty good one. Some of my thoughts: - Customers "lie to themselves" saying they prefer noise to missed issues, …

Page title: Armon Dadgar, Hashicorp co-founder, on AI Native DevOps: Can AI shape the future of Autonomous DevOps workloads? Link is to an interesting podcast episode about Gen AI …