The OpenFLUX project is derived from Schnell, as such it's also Apache 2.0. Unlike regular Schnell, it can be further fine-tuned and can use a proper CFG sampling.
Context: FLUX is state of the art text-to-image generator. It has very strong prompt adherence, and is able to render complex scenes, though it somewhat lacks in terms of ability to produce classical art and a few other areas.
When FLUX launched, they released 3 models:
FLUX Pro: Weights not available.
FLUX Dev: Distilled (guidance distilled) version of FLUX Pro. Requires >20 steps for good image. Weights available. Non-commercial license.
FLUX Schnell: Distilled (timestep distilled) version of FLUX Pro. Requires ~1-4 steps for good image. Weights available. Apache 2.0.
---
The thing is that Schnell is very hard to fine-tune due to the distillation applied, and is kneecapped as it's not using true CFG based sampling and being limited to ~4 steps. This is likely why BFL (the company behind FLUX) felt comfortable releasing it under Apache 2.0.
The OpenFLUX project fixes both issues and since it's derived from Schnell, it's also Apache 2.0.
I just tried generating on the new 1.1 pro model using the camera raw file name hack, and it spews something you would expect in a persons phone camera roll (I put these images here https://vm.tiktok.com/ZGdJr9T5g/ ). Along with occasional watermark. I wonder how much this will work on such distilled/undistilled/redistilled models (if they will release dev/schnell 1.1 version at all), and how much about training data can be inferred this way.
This is very cool and I am dying to use Flux with ComfyUI but I have an AMD card. It can run SDXL without any issues but I want to know if anyone has had success running Flux on AMD and if so how did you do it?
The OpenFLUX project is derived from Schnell, as such it's also Apache 2.0. Unlike regular Schnell, it can be further fine-tuned and can use a proper CFG sampling.
Context: FLUX is state of the art text-to-image generator. It has very strong prompt adherence, and is able to render complex scenes, though it somewhat lacks in terms of ability to produce classical art and a few other areas.
When FLUX launched, they released 3 models:
FLUX Pro: Weights not available.
FLUX Dev: Distilled (guidance distilled) version of FLUX Pro. Requires >20 steps for good image. Weights available. Non-commercial license.
FLUX Schnell: Distilled (timestep distilled) version of FLUX Pro. Requires ~1-4 steps for good image. Weights available. Apache 2.0.
---
The thing is that Schnell is very hard to fine-tune due to the distillation applied, and is kneecapped as it's not using true CFG based sampling and being limited to ~4 steps. This is likely why BFL (the company behind FLUX) felt comfortable releasing it under Apache 2.0.
The OpenFLUX project fixes both issues and since it's derived from Schnell, it's also Apache 2.0.
I just tried generating on the new 1.1 pro model using the camera raw file name hack, and it spews something you would expect in a persons phone camera roll (I put these images here https://vm.tiktok.com/ZGdJr9T5g/ ). Along with occasional watermark. I wonder how much this will work on such distilled/undistilled/redistilled models (if they will release dev/schnell 1.1 version at all), and how much about training data can be inferred this way.
This is very cool and I am dying to use Flux with ComfyUI but I have an AMD card. It can run SDXL without any issues but I want to know if anyone has had success running Flux on AMD and if so how did you do it?
absolutely, i'm running the full flux.1-dev model on an amd 7900xtx. i had to disable smart model loading in comfyui to avoid out-of-memory issues.
So can load it like SDXL and use a Flux workflow and should work without any other modifications?
the flux workflow is different from SDXL, but as long as you have enough VRAM the same workflow should work on an AMD card.
note: depending on whether you're using the official unet models from black forest labs, or a quantized checkpoint, the workflows are different. see: https://comfyui-wiki.com/tutorial/advanced/flux1-comfyui-gui...
I wonder how much compute was required to remove the distillation.