Viewing profile — esafranchik

Wouldn't NDCG/token results vary wildly depending on the agent's query and the number of returned items? e.g. agents often run `grep -m 5 "QUERY"` with different queries, instead o…

Two follow-ups: 1) How do you compare accuracy? by checking if the answer is in any of the returned grep/bm25/semble snippets? 2) How do you measure token use without the agent, pr…

Is the benchmark measuring one-shot retrieval accuracy, or Coding agent response accuracy?

I built cush because coding agents can be helpful to diagnose and troubleshoot server issues. The problem is that getting said agents onto a remote server, especially one you don't…

Does this work with any tool calls that make an HTTP request? e.g. calling `curl` directly vs writing a script to make the request, then calling it

Have you noticed an relationship between recall and the number of files/memories?

The new API2MCP

Hello HN! I built Cubyc to manage my ML research in grad school. It lets you store all your experiment metadata with cloud-based repo providers like GitHub, GitLab, and Bitbucket. …