At this point, articles about LLMs paired with meaningless metrics have become a classic combo. I get that it's typical corporate BS, but publishing this widely is just weird. "Look, my productivity is skyrocketing according to a chart that only my manager cares about!"
Mitchell Hashimoto put it well: https://xcancel.com/mitchellh/status/2071971627748020409