Viewing profile — ashater

Do you want to monitor what an Al agent is about to do before it acts? In our new paper, Beyond the Black Box: Interpretability of Agentic Al Tool Use, we explore how mechanistic i…

Likely reasoning is part of the original model. It is well known that it is not possible to get a 1bn parameter model to reason, even with RL.

We want to do both. In finance, highly regulated industry, understanding how models work is critical. In addition, mech interp will allow us to understand which current or new arch…

Thank you for reading. One of the main reasons we've written the paper is to help with model validation of LLM usage in our highly regulated industry. We are also engaging with reg…

Our paper provides evidence of features in Finance but I would suggest reading seminal papers from Anthropic https://www.anthropic.com/news/golden-gate-claude and https://transform…

Thank you. Agreed, we are exploring different ways to apply these interpretability methods to a wide range of transformer based methods, not just decoder based generative applicati…

Paper introduces AI explainability methods, mechanistic interpretation, and novel Finance-specific use cases. Using Sparse Autoencoders, we zoom into LLM internals and highlight Fi…

Our paper introduces AI explainability methods, mechanistic interpretation, and novel Finance-specific use cases. Using Sparse Autoencoders, we zoom into LLM internals and highligh…

My younger daughter, who is pretty good at making games in Scratch is not that interested in jumping into text/code based programming. I do think Scratch makes things a lot easier …

Another piece of evidence that LLMs are plateauing

Terrence Tao has a very healthy view of what AI can and cannot achieve shorter term. It is refreshing to hear more grounded views from a top mathematician who is clearly well verse…

Good article, steps one level below container managers like Docker or k8s. Obviously not the indepth of how Linux kernel manages container processes but a good write-up.

pynq is a good starting board. What's really good is the software environment connected to the fpga logic via Python ecosystem. There are lots of examples via Jupyter notebooks.

how do I modify the link?

The paper describes the rise of “tech entrepreneurship as a lifestyle” and how more entrepreneurship seems primarily motivated by people wanting to “be entrepreneurs” rather than b…