Viewing profile — mattcollins

On the other hand, AI coding tools make it relatively easy to set and apply policies that can help with this sort of thing. I like to have something like the following in AGENTS.md…

Results from some further tests here: https://www.improvingagents.com/blog/toon-benchmarks

FWIW, I ran a test comparing LLM accuracy with TOON versus JSON, CSV and a variety of other formats when using them to represent tabular data: https://www.improvingagents.com/blog/…

This is a follow-up to previous work looking at which format of TABULAR data LLMs understand best: https://www.improvingagents.com/blog/best-input-data-format-... (There was some g…

Here you go: https://www.improvingagents.com/blog/best-input-data-format-...

Author here. This has made me chuckle several times - thanks!

I did a small test with just a couple of formats and something like 100 records, saw that the accuracy was higher than I wanted, then increased the number of records until the accu…

I'm the person who ran the test. To hopefully clarify a bit... I intentionally chose input data large enough that the LLM would be scoring in the region of 50% accuracy in order to…

I'm the person who ran the test. To explain the 60% a bit more... With small amounts of input data, the accuracy is near 100%. As you increase the size of the input data, the accur…

I'm the person who ran the test. The context I used in the test was pretty large. You'll see much better (near 100%) accuracy if you're using smaller amounts of context. [I chose t…

"This feature is available to all customers, meaning anyone can enable this today from the Cloudflare dashboard." https://blog.cloudflare.com/control-content-use-for-ai-train...

I wondered about this, too. Cloudflare have some recent data about traffic from bots ( https://blog.cloudflare.com/from-googlebot-to-gptbot-whos-cr... ) which indicates that, for t…

I noticed that, too. It does seem 'odd'.