Viewing profile — mattnewton

I think efficiency is unlikely to result in lower demand for compute, instead more useful compute per watt increases the value of that compute; and we are not going to run out of e…

If China keeps releasing LLMs with such permissive licenses it probably works better since the pretraining rnd is subsidized and de-risked - but that’s a big if.

The exception being the token embeddings and lm head (which scale with the number of tokens the model knows and presumably you need a smaller number in the tokenizer for only Engli…

Honestly the 27b dense one punches way above its weight in a lot of domains, especially coding in my testing, so I think you will probably be disappointed.

I agree. 27b dense really did seem like the sweet spot.

There was a 3.5 122B 10A release - https://huggingface.co/Qwen/Qwen3.5-122B-A10B

Because demand for inference tokens is above supply

This was a big concern for earlier models, but with modern CoT trained models they should be able to come to the conclusion entirely in the thinking trace.

I think a) the labs are releasing very fast and b) why would they implement the long tail of app features when they can effectively sell tokens to every user to write their own ver…

It’s not that poor people can’t afford a stamp it’s that they aren’t going to spend money on an automated service or stamp if there are other places to apply to that don’t require …

Why do your think Meta doesn’t make money? Their ad platforms are incredibly lucrative.

There are plenty of services to send mail form the internet for a small fee, so this will only discourage the most poor candidates and add friction for the best ones.

I’m saying there is basically no way to both make vlms able to understand the long tail of PDFs where the layout conveys information (like charts and tables) and to make it as toke…

Because PDFs are a nightmare of a format and the only thing that’s is reasonably guaranteed about them is they will render to an image that people can read, the parsing of which wi…

But then I close my laptop and it’s not running on the headless host anymore right

I read point 19 as Palantir’s goal being to import Chinese and Russian style surveillance, and the comment saying effectively “it can’t happen here” and “taking them less seriously…

How hot does the water need to be before you raise the alarm? I think there is value in pointing out trend lines and voicing opposition even if there are other countries that have …

In the US, I think we are being intentionally DDOS-ed. This strategy was laid out by Steve Bannon in the old frontline PBS interview where he called the media “the opposition party…

Yeah people are overdoing it, and not everyone is being motivated to do something by feeling mad, but maybe instead of throwing up your hands that you can’t care about soybean tari…

_in a polling place_ no less

Definitely encourage you to test the models. We tried to optimize for realistic focus and not over-sharpening, which leads to a "hyper" AI-look. It's hard to benchmark because peop…

Krea 2 Large (on the website and api) was trained with the FLUX 2 VAE, if you want to test it out and push realism. After working with both I think the flux VAE has a slight edge i…

You can find some links and details in the GitHub readme for finetuning / LoRA support. Ostiris, musubi tuner, fal and hugging face diffusers are all day-0 supported :) https://git…

Hi HN, we're releasing weights for our latest text to image model and publishing this writeup on how we trained it in quite a bit of depth. I hope there is something in the report …