Viewing profile — marviel

It's meant to replace the BPE tokenizer piece, so it isn't a full Language Model by itself. In fact in Gu's blog post (linked in a post below) it's mentioned that they created a Ma…

Thanks for sharing this blog post is a great speculative deep-dive.

it mentions native multimodality somewhere in either the Arxiv or post -- seems like it might handle it well?

No problem! I'm still parsing it myself, but it seems promising in theory, and the result curves are impressive.

https://arxiv.org/pdf/2507.07955 paper

> H-Net demonstrates three important results on language modeling: > 1. H-Nets scale better with data than state-of-the-art Transformers with BPE tokenization, while learning direc…

nice! Can't agree more on Vibe Speccing. I wrote more about Spec Driven AI development here: https://lukebechtel.com/blog/vibe-speccing

how do you account for the success of reasoning models? I agree these things don't think like we do, and that they have weird gaps, but to claim they can't reason at all doesn't fe…

have often wanted something like "liquid types", but didn't know what it was called! Thanks for this

there is now I suppose! ;) Yeah it isn't a panacea but it has afforded me less frustration than the alternative of jumping straight in. > Since what I've been working on is just a …

I'm almost to this one in my read through! I'm excited to get to the "information age" arc

I totally agree! this is the idea behind my recent post actually[1] where I recommend people use AI to write specs before they code. If all you have to do is a human is edit the sp…

Identifying a problem is the first step to solving it. Changing these buttons to "Rent" would force people to acknowledge what they're getting for their $60 bucks -- effectively a …

def cleanup inactive specs over time. it's only useful if it'll be used!

Yeah just learned about this! The md files are actually pretty great for shareability, versioning, and picking up where you left off.

I need to try Claude Code's plan mode! Definitely feels useful.

Totally. Yeah I think your approach is a solid take!

Thanks for the writeup! I talked about a similar, but slightly simpler workflow in my post on "Vibe Specs". https://lukebechtel.com/blog/vibe-speccing I use these rules in all my c…

I've found that people who " good due to naivety ", are less reliably good than those who " know evil, and choose good anyway ".

don't mind me I'm just moloch posting https://slatestarcodex.com/2014/07/30/meditations-on-moloch/