I usually use https://github.com/axolotl-ai-cloud/axolotl on Lambda/Together for working with these types of models. Curious what others are using? What is the quickest way to get started? They mention Pre-training and Post-training but sadly didnt provide any reference starter scripts.
We actually have a GitHub repository to help with inference code. Check this out: https://github.com/krea-ai/flux-krea Let me see if we can add more details on the blog post and thanks for the flag!
Releasing weights for FLUX.1 Krea
41–50 of 112 posts
Re: Releasing weights for FLUX.1 Krea
#42Re: Releasing weights for FLUX.1 Krea
#43I'd recommend you offer a clearly documented pathway for companies to license commercial output usage rights if they get the results they seek (i'll know soon enough!)
In a nutshell, it follows the same license as BFL Flux-dev model.
Re: Releasing weights for FLUX.1 Krea
#44"Octopus DJ spinning the turntables at a rave."
The human like hands the DJ sprouts are interesting, and no amount of prompting seems to stop them.
Opinionated, as the paper says.
Re: Releasing weights for FLUX.1 Krea
#45Earlier quoted context omitted.
I've never seen a 32 bit model. There's bound to be a few of them, but it's hardly a normal precision.
Some of the most famous models were distributed as F32, e.g. GPT-2. As things have shifted more towards mass consumption of model weights it's become less and less common to see.
Re: Releasing weights for FLUX.1 Krea
#46Tried a simple prompt, and got some pretty interesting results: "Octopus DJ spinning the turntables at a rave." The human like hands the DJ sprouts are interesting, and no amount of prompting seems to stop them. Opinionated, as the paper says.
Re: Releasing weights for FLUX.1 Krea
#47Hello everyone. I’m the Co-founder and CTO of Krea. We’re excited because we wanted to release the weights for our model and share it with the HN community for a long time. My team and I will try to be online and try to answer any questions you may have throughout the day.
Re: Releasing weights for FLUX.1 Krea
#48Re: Releasing weights for FLUX.1 Krea
#49yoo i'm also a researcher on the krea 1 project and happy to answer any questions :)
Re: Releasing weights for FLUX.1 Krea
#50Hi! I'm lead researcher on Krea-1. FLUX.1 Krea is a 12B rectified flow model distilled from Krea-1, designed to be compatible with FLUX architecture. Happy to answer any technical questions :)
Regarding this part: > Since flux-dev-raw is a guidance distilled model, we devise a custom loss to finetune the model directly on a classifier-free guided distribution.
Could you go more into detail on the specific loss used for this and any other possible tips for finetuning this that you might have? I remember the general open source ai art community had a hard time with finetuning the original distilled flux-dev so I'm very curious about that.