Live data from Hacker News

Releasing weights for FLUX.1 Krea

krea.ai

41–50 of 112 posts

Re: Releasing weights for FLUX.1 Krea

#41
post #26

I usually use https://github.com/axolotl-ai-cloud/axolotl on Lambda/Together for working with these types of models. Curious what others are using? What is the quickest way to get started? They mention Pre-training and Post-training but sadly didnt provide any reference starter scripts.

We actually have a GitHub repository to help with inference code. Check this out: https://github.com/krea-ai/flux-krea Let me see if we can add more details on the blog post and thanks for the flag!

Thanks! Yes, the inference is pretty straightforward, but the real opportunity IMHO is the custom pre-training and post-training opportunities given the open weights.

Re: Releasing weights for FLUX.1 Krea

#43

I'd recommend you offer a clearly documented pathway for companies to license commercial output usage rights if they get the results they seek (i'll know soon enough!)

You can find details about the license here: https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/mai...

In a nutshell, it follows the same license as BFL Flux-dev model.

Re: Releasing weights for FLUX.1 Krea

#44
Tried a simple prompt, and got some pretty interesting results:

"Octopus DJ spinning the turntables at a rave."

The human like hands the DJ sprouts are interesting, and no amount of prompting seems to stop them.

Opinionated, as the paper says.

Re: Releasing weights for FLUX.1 Krea

#45
post #21

Earlier quoted context omitted.

I've never seen a 32 bit model. There's bound to be a few of them, but it's hardly a normal precision.

Some of the most famous models were distributed as F32, e.g. GPT-2. As things have shifted more towards mass consumption of model weights it's become less and less common to see.

And on the topic of image generation models, I think all the Stable Diffusion 1.x models were distributed in f32.

Re: Releasing weights for FLUX.1 Krea

#46
post #44

Tried a simple prompt, and got some pretty interesting results: "Octopus DJ spinning the turntables at a rave." The human like hands the DJ sprouts are interesting, and no amount of prompting seems to stop them. Opinionated, as the paper says.

Describing it as "Octopus DJ with no fingers" got rid of the hands for me, but interestingly, also removed every anthropomorphized element of the octopus, so that it was literally just an octopus spinning turntables.

Re: Releasing weights for FLUX.1 Krea

#47
post #2

Hello everyone. I’m the Co-founder and CTO of Krea. We’re excited because we wanted to release the weights for our model and share it with the HN community for a long time. My team and I will try to be online and try to answer any questions you may have throughout the day.

Hi. Thanks for this. What is your goal of doing so? From a business standpoint. Or is it purely altruistic?

Re: Releasing weights for FLUX.1 Krea

#50

Hi! I'm lead researcher on Krea-1. FLUX.1 Krea is a 12B rectified flow model distilled from Krea-1, designed to be compatible with FLUX architecture. Happy to answer any technical questions :)

The model looks incredible!

Regarding this part: > Since flux-dev-raw is a guidance distilled model, we devise a custom loss to finetune the model directly on a classifier-free guided distribution.

Could you go more into detail on the specific loss used for this and any other possible tips for finetuning this that you might have? I remember the general open source ai art community had a hard time with finetuning the original distilled flux-dev so I'm very curious about that.

Post reply on HN