11–20 of 25 posts
Fun project, easy to understand and nice looking results, everything one could ask for! I played around with it locally, did some optimizations of low hanging fruits without making it much more complicated, and was gonna send over a PR. But then I noticed there is no license attached to the project. What are your plans regarding the licensing for this?
Why do these text diffusion demos always look like the number of allowed tokens is fixed for a specific unfilled region? Is this the case? Ie. if the region only has four tokens(here characters) but calculates the best word is “forget” does it just abandon the best fit or truncate it to fit? Are there text diffusion models with lax infill directives?
Why do these text diffusion demos always look like the number of allowed tokens is fixed for a specific unfilled region? Is this the case? Ie. if the region only has four tokens(here characters) but calculates the best word is “forget” does it just abandon the best fit or truncate it to fit? Are there text diffusion models with lax infill directives?
Students looking for a project to break into AI - please!
The basic MLP block in this model uses a ReLU^2 activation function (x <- ReLU(x)^2). That seems to be copied from the nanochat project, and it's not present in nanoGPT. Is there some documentation on the choice of this activation function?
One year later and there is still no inference engine for diffusion LLMs Students looking for a project to break into AI - please!
Earlier quoted context omitted.
Actually NVIDIA made one earlier this year, check out their Fast-dLLM paper
Thanks I’ll check it out!
That’s inference code, but where is the high perf web server?