instructions for lora training?

#22
by PineAmbassador - opened

I tried kohya_ss using the same settings that work for flux dev, but it has errors with the vae.

Have you tried to route /pipeline in the regular FLUX vae? It's not like you're training the vae anyways. Depending on what you're using to launch/config the Kohya training and how, you might be able to either add a path to the original vae as a training argument (if, say, you're training on the Diffusers format weights from here). Alternately you could try that with the transformer only OpenFlux Safetensors of OpenFlux. Here's a link to it: https://huggingface.co/Kijai/OpenFLUX-comfy/blob/main/OpenFlux-fp8_e4m3fn.safetensors (For extra clarity: the larger Safetensors in Ostris' repo is all-in-one, I believe. Which makes it harder to replace the vae on the fly. Try it with the Unet though. Perhaps try to launch the trainer through ComfyUi.)

Sign up or log in to comment