Live data from Hacker News

Viewing profile — benchwright

benchwright

HN member
Joined
Wed, Apr 08, 2026, 8:57 PM UTC
HN karma
12
Public activity
16 items

About benchwright

consulting on AI benchmarking, characterization, explainability. benchwright.io

Recent public activity

  1. story
  2. comment
    Comment #48026907

    You said: "and support expectations clear," Therein lies the rub. By not honouring the trademark, the fork made the association of service, support, otherwise to Notepad++ making i…

  3. comment
    Comment #48022209

    In the grand scheme of things, this isn't shocking. The push for OSS weights and outputs (looking at you, GPT-OSS) is great and all but the SOTA still sits within proprietary, clos…

  4. comment
    Comment #48017834

    Can agree with this (to a certain extent). Spending time in both America and Ireland, there's a definite difference in the extent to which "I can only get there by car versus publi…

  5. comment
    Comment #48017812

    That's not a transaction fee, that's dropped change.

  6. comment
    Comment #48016628

    almost like NOAA, had it not been savaged by this current anti-science admin, would be able to lend further credibility here. As it stands, several researchers that I know of, form…

  7. comment
    Comment #48016494

    So, curious application especially given the work that Benchwright.io, MLCommons, ArizeAI, and others have provide regarding drift, etc. How do you differentiate yourself from thos…

  8. comment
    Comment #48000149

    One of my customers actually requires attribution to agents if they're used, not only for tracking purposes but also for understanding potential vectors for slopcode. It's been use…

  9. comment
    Comment #47999732

    Great article and something that I've envisioned myself: a forge combined with a libary (of sorts). Looking forward to the forcing-function of GitHub's changes recently pushing fol…

  10. comment
    Comment #47997894

    I managed to build this the other day. Looking good! As noted by other authors, there does seem to be a wide surface area for attacks so, security remediation does seem to be a top…

  11. comment
    Comment #47997803

    Tends to be a problem. I've tried to mitigate these problems by using either external harnesses (aka GitHub actions that are "fixed" based on known-good) or by using n-number of wi…

  12. comment
    Comment #47988632

    I don't see that at all. There is certainly a multi-causality/multi-maintenance problem here but in a grossly capitalist market, Spirit's ability to thrive was curtailed not only b…

  13. comment
    Comment #47988581

    "Bad" is relative. It can be more difficult in compressed markets where talent is either in surplus (read: SV, Dub, etc) or where there's a distinct lack of enterprises/startups/wh…

  14. comment
    Comment #47988549

    PII in plain text is a problem. Glad there's a level of accountability here.

  15. comment
    Comment #47988538

    They can be. I've done some drift detection work against local models and for the most part, they do ok. I think there's always room for an augmented approach where local models ca…

  16. comment
    Comment #47988506

    https://www.transportation.gov/briefing-room/trumps-transpor...