Viewing profile — lucrbvi

https://www.pangram.com/history/c2abdcf5-c52b-41cc-a8fb-0c59...

Mistral has the capability of training such models. Take a look at Poolside[1], they are claiming to pre-train their Laguna series of models on 4,096 NVIDIA H200 GPUs[2]. Mistral h…

"world model" is, sadly, a new buzzword; most of the world models we are seeing are video generative models (like GPT-Image), they receive an action vector and previous frames and …

Seems like MAI models from Microsoft are not going to be open-weight soon, but they are sharing a lot of details in the making of these models, which is a weird position.

Such a gem, thanks to the author for sharing it's findings :) The only problem I have with planing in latent space is that it can be really noisy and not representative of the posi…

Anthropic theorize that middle layers in an LLM is a "J-Space" used to "think" about the future answer or about abstract concepts. Their method is used to identify which tokens can…

http://archive.today/1YRCE

https://xkcd.com/927/

In the article the author says they are doing reinforcement learning with LLMs.

How does this differ from dottxt's Outlines[0] on the technical level? Are you using some JSON grammar to force the LM head distribution to follow it? [0]: https://github.com/dottx…

it's using webgpu kernels, probably a false positive

I really like QBE but I hope they will make it a true library because I don't want to launch a subprocess to compile a program.

Cool but why would anyone write an agent in C? Since the language is verbose it seems to be a painful choice to use C for this task.

They have added a lot of optimization focussing on the KV-cache, so they can have a much larger window without eating all the VRAM. The 1M window might be usable, but it will proba…

Mollie seems to only provide services to business based in European Economic Area, Switzerland and the UK [0], so yes? [0]: https://help.mollie.com/hc/en-us/articles/115002116105-C…

Mollie might be a direct competitor

Is there anyone that feels that LLMs are wrong for computer use? It's like robotic, if find LLMs alone are really slow for this task

Some people are speculating that Opus 4.7 is distilled from Mythos due to the new tokenizer (it means Opus 4.7 is a new base model, not just an improved Opus 4.6)

Hi! I share my first blog post ever about the definition on AGI following the annoucement of Claude Myhtos Preview. I hope some of you might found this interesting.

Sounds like Multi-Head Latent Attention (MLA) from DeepSeek

I wouldn't be surprised if Vercel were bought by Anthropic/OAI (but maybe it would be too expensive?)