Viewing profile — robbomacrae

Benchmarking public agent skills: Oh My ClaudeCode, Superpowers, Git Ship Done, (previously Get Shit Done), and the Karpathy ones against Swebench-Pro and SlopCodeBench. I have a J…

FYI the GitHub URL is 404ing I’ve been integrating benchmarks into OrcaBot either locally on the app or online at orcabot.com. Mostly as a way of giving an easy way to verify my ow…

Thats right and to go even further I'm judging them on a metric they didn't necessarily target. A client I work with uses skills such as these to apply their own processes on the a…

Yep that was interesting but imho not completely unexpected. My original hypothesis was that these agent skills are castles built on sand and that the models would quickly adapt an…

SCB is definitely an underrated benchmark. For me the unique selling point is that it more closely mirrors software development by not stopping after a single task. The agent has t…

OrcaBot is a virtualized sandbox for securely orchestrating your AI tools. Its secrets broker keeps credentials hidden from agents. Network egress controls help prevent data exfilt…

I think I'm more on your side on that rather than letting agents go wild like Steve Yegge/Pete Steinberger do. In fact OrcaBot quickly adapted into a knee jerk reaction to OpenClaw…

This looks really interesting and a unique take on the AI agent orchestration. I think we need a bunch of experiments in this area as it's clear we are entering a new paradigm and …

https://orcabot.com OrcaBot was my Jan+Feb attempt to defeat the lethal trifecta whilst offering all the bells and whistles of a claw like sandbox: https://orcabot.com/blog#breakin…

AAPL and MSFT have a P/E an order of magnitude lower than TSLA whilst both having revenue growth % yoy in the teens. They both make over a $100b in PROFIT a year. TSLA's? $4b and s…

I've been working on addressing the exfiltration leg as well as the other legs of the lethal trifecta in my OrcaBot [0][1] platform and I thought I had it mostly covered with the h…

I believe it's the way the HN algorithm works. In order to give new and obscure posts a shot, it will add them to peoples feeds in their front page and see how they measure. Otherw…

I'm trying to do this with orcabot.com A figma like dashboard for turning ClaudeCode, Gemini Cli, Codex into an OpenClaw but with security measures to break the lethal trifecta whi…

I don't think that is entirely fair.. I don't see them stating anywhere they are measuring coding capabilities... "Using complex games to probe real intelligence." And this seems v…

You could have the actual output of the agent turned into TTS using the model of your choice with TalkiTo… or listen to whatever weird sounds this makes. Seems like this is copying…

You sound like you’ve never been disdainfully stared at by a cat.. Really interesting article though. I’m very hopeful AI can help work out how all these things interact.

"Let's be honest here: there is no benefit to alcohol (for example wine) and is only detrimental." - That is a pretty extreme statement and easily falsifiable. There are many studi…

OrcaBot does this with the VM but whereas the author mentions the risk of GitHub keys being leaked, OrcaBot uses a key broker to ensure the LLM doesn’t have access to any keys. It …

Genuinely surprised they didn't try to get away with department of peace.

Thanks for mentioning that. The bot filter has been causing trouble so I def need to go and look at it. Debated disabling it but any basic bot that starts a dashboard is spinning u…

Really cool. A tangential task that seems to be coming up more and more is masking sensitive data in these calls for security and privacy. Is that something you considered as a fea…

“so the API use is in addition to the subscription, but it can't be helped.” - I beg to differ. OrcaBot.com is a claws that runs using vanilla Claude Code so you can do all that wi…

Thank you! Great feedback. Again agree with you on all points. Will take it onboard!