Viewing profile — joshuamoyers

YMMV but I think its going to always be important to acquire almost all the knowledge necessary to go to the metal, then allow the tactical to bits to atrophy over time. What remai…

I think it'd be very hard to achieve viable tokens/s or get arithmetic intensity to be high enough in general, since many cases in existing training and inference are memory bandwi…

it seems to be something that’s similar to the class of optimizations associated with with linear or state space attention when things models often do is once they figure out an op…

I think the primary reason it works is because the difference between K and Q, which is not all that obvious is that it’s allowing the model to have an asymmetric relationship betw…

article points out a real problem - simplicity is one of the hardest things to achieve. the act of reduction is important. buts its a refreshing that there is an initial list of ha…

we’ve been struggling with review throughput. this actually seems worthwhile to build at this point though i remain fairly skeptical of workflows that are agent-only, at a point it…

> But for me, it becomes the event my whole day starts to revolve around. I have to break out of my flow, put my tasks on hold, take the call, and then get back into context. In th…

except agentic engineering mostly invalidates this with regard to marketing websites. nothing is really all that hard to implement on mostly static site.

i appreciate the sentiment to a certain extent - its not going away, skate to where the puck is if you care to do so. but the writing is repetitive and theres an entire repeated pa…

i love how half the comments are literally doubling down and simultaneously angrily complaining about auto-scroll. hacker news has become worse than mid 2000s irc.

you cringe while simultaneously posting a github link with your “current setup” - do you see the irony?

I think this is the right take. I usually am aligned with most of what Anthropic is doing, but cutting off OAuth login from open harnesses was a bad move. My guess is there is some…

I really like this approach. Nice job! > We also plan to compile solved steps into micro‑policies. If you're running something like a RPA task or similar workflow as before, you ca…

This was pretty wild. Veers deeply into broad generalizations that have the potential to be dangerous in some way I cannot name - but if you stop and consider each archetype as a v…

> For all that, GPT-5 is not a terrible model. I played with it for about an hour, and it actually got several of my initial queries right (some initial problems with counting “r’s…

100% agree. I feel like this is a symptom of Dead Internet Theory as well - as a negative take starts to spiral out of control, we start to get an absolute deluge of a repurposing …

> By being particularly bad at anything outside of the most popular languages and frameworks, LLMs force you to pick a very mainstream stack if you want to be efficient. Almost lik…

> companies often over-index on crystallized knowledge over fluid intelligence. another way to say this: focus on aptitude. in my hiring funnel, this is a core tenet. you need to b…

Its not at all imo. Franchised businesses are not in the habit of employing low skill workers as a public service. This data is interacting with both covid effects and infrastructu…

Meanwhile, current administration gutting the clean air act: https://www.npr.org/2025/07/29/nx-s1-5463771/epa-greenhouse-...

two good points there are very intuitive - a fresh perspective yields better results and once you are stuck (e.g. 80 iterations) its better to just start fresh. i've seen the same …

In light of recent light controversy around Andrew Ng's talk, I thought I'd submit this long form article I wrote over the last few weeks. By contrast, its my very tactical and spe…