robotlogo
robotlogo

The Rapid Development of FLUX's Ecosystem

Not long ago, due to issues with SD3, the development of the open-source image ecosystem came to a standstill, with almost no new projects or models worth noting. The situation changed rapidly after the release of FLUX last week. Its excellent image quality has not been hindered by the high training costs, and the open-source community has been quick to respond.

article image

Moreover, due to its realistic aesthetic tuning style, the realistic images generated by its press releases have exploded in popularity on Twitter, making the FLUX model quickly gain mainstream attention. Additionally, Runway's transformation of an AI-generated photo into a video has given more people an understanding of the current progress in image and video model development.

Currently, Xlabs has released training scripts for the Controlnet model and Lora model based on FLUX.

They also released a Canny Controlnet model based on FLUX, and here is a Canny model trained by Instant ID's new organization, InstantX, which you can try.

Xlabs also released several Loras along with the Lora training script, including the realistic Lora that went viral on Twitter.

The specific Loras include mjv6_lora, anime Lora, realistic Lora, Disney Lora, landscape_lora, and art Lora.

Xlabs Lora Download: Download Xlabs Lora

Additionally, the community has started training Loras using these training scripts, such as this anime Lora.

The SD model training tool, simpletuner, supports the training of FLUX Loras, so if you want to train a FLUX Lora model, you can use this.

A comprehensive FLUX Comfyui workflow supports the loading of FLUX Loras and ControlNets, and supports text-to-image and image-to-image generation.

Please note that the link provided for Xlabs Lora download may not be accessible due to network issues. If you encounter any issues, please check the legitimacy of the web link and try again.