Viewing profile — DreamGen

From what I have heard, getting license from them is also far from guaranteed. They are selective about who they want to do business with -- understandable, but something to keep i…

That would be misleading. They aren't open weight (3B is not available). They aren't compared to Qwen 2.5 which beats them in many of the benchmarks presented while having more per…

Also, the 3B model, which is API only (so the only thing that matters is price, quality and speed) should be compared to something like Gemini Flash 1.5 8B which is cheaper than th…

Why I use Llama: - Ability to self host. This unlocks few things: (1) Customized serving stack with various logit processors, etc. (2) More cost efficient inference. - Ability to f…

This could have grave impact on AI development. Here are some responses: - EFF: https://www.context.fund/policy/2024-03-26SB1047EFFSIA.pdf - Answer AI: https://www.answer.ai/posts/…

They were released under Apache 2.0 and there are backups in case they decide to not release them, or to only release them after further alignment: https://huggingface.co/dreamgen/…

Engaging. But starting over from stage 0 gets old pretty fast.

We are in agreement -- that's exactly what I am saying :)

What's your source on this? They just very recently reached 100K downloads on Android and according to various SEO tools, they get maybe ~4M visits per-month (and these tend to ove…

A big distinction is that you can built on top (fine-tune) thus released models as well as if they released the pre-training data.

Mistral Instruct v0.2 is 32K.

I am not seeing any race-to-zero in the hosted offering space. Most charge multiples of what you would pay on GCP, and the public prices on GCP are already several times what you w…

Great, more competition for the price-gouging platforms like Replicate and Modal is needed. As always with these, I would be curious about the cold-start time -- are you doing anyt…

ChatGPT Vision will do well with this kind of OCR stuff. Just give it the header and a few example rows to get back consistently formatted output. Or use JSON mode with the API.

Curious how this is on the front-page, despite falling down to the second page for a while, and having so many more comments than upvotes (which usually results in demotion of the …

I would not be so quick to jump to conclusions. GPT-4 beats it easily in this simple logic puzzle: https://www.reddit.com/r/singularity/comments/1altttv/bard_a... We need more data…

> Like say the Internet It's not so clear cut ;) "Research at CERN in Switzerland by the British computer scientist Tim Berners-Lee in 1989–90 resulted in the World Wide Web, linki…

When talking about memory requirements one also needs to mention the sequence length. In case of Mixtral, which supports 32000 tokens, this can be a significant chunk of the memory…