Something about having a very fast, very small harness written in C only to drive LLMs amuses me. Like putting a big ass spoiler on a minivan or something.
Well, you'd think so but given how slow and resource hungry the ones written in javascript are it makes a lot of sense.
[flagged]