Viewing profile — radq

I'm disappointed with the commentary here. "GPU bubble" is an industry standard term, and literally how I would describe this to my colleagues in the industry. Look for example at …

This is what people in the field call it. I'm sorry you're offended.

Appreciate you saying the blog was nice. Not sure what you mean by "CODEX fingerprints", but I'll engage with the other points. We work on small models, and our customers want real…

Thank you for the kind words. We will write and share more of these.

The 'point' skill is trained on a ton of UI data; we've heard of a lot of people using it in combination with a bigger driver model for UI automation. We are also planning on post-…

Thanks! If you could shoot me a note at vik@m87.ai with any examples of the precision/recall issues you saw I'd appreciate it a ton.

Cool project! The codebase is simple and well documented, a good starting point for anyone interested in how to implement a high-performance inference engine. The prefix sharing is…

Hello folks, I work on moondream. Posted a demo video on twitter for this release: https://x.com/vikhyatk/status/1864727630093934818 Happy to answer any questions!

Not true, H100s cost $2-3/GPU/hr on the open market.

Have you considered sponsoring an open-source project? ;)

1/3rd "activated parameters", while also requiring 2x the VRAM.

The training technique used here (fitting something similar to a NeRF to different views of the same image) is pretty similar to this paper which uses a similar technique to denois…

I've been working on training this small vision language model for the last month - excited to release the first prototype today! It is based on SigLIP (image encoder), Phi-1.5 (te…

I'm confused - you posted in the "who wants to be hired" thread, and then got an email from this company asking if you'd be interested?

Do outlier features emerge in sub-100M parameter models? I haven't seen any research discuss it below the 124M scale (bert-base). At that scale training a model takes ~4 days on an…

I found the mixed reactions to Llama 2 interesting, with some people concerned about the safety implications of open-sourcing a powerful LLM, while others were finding the chat RLH…

The plugin is supposed to ask for confirmation, according to OpenAI's documentation at least. > When a user asks a relevant question, the model may choose to invoke an API call fro…

Literally happened to me, though it was during COVID lockdown so it's possible things have gotten better.

Looks like you're right, there was a recommendation to increase it but I don't see anything about it taking effect.

I don't expect a lot of people to take this up. Express Entry was already an option for these folks and you get permanent residency from the start under that program.

As someone that's used to live in Canada and is currently in the USA, this is not true. Six month wait time to get an x-ray for a hairline fracture, people dying because of long wa…