Fusing existing LoRAs

[charlieguo0610]

Thanks for your code release and clear instructions on reproducing the code. I wonder if we can directly use pretrained LoRA, say from Kohya and fuse them together? What are some details or configs that I need to modify accordingly?

[chWangdd]

Did you mean center node concept fusion? Couldn't you run it by using fuse.sh? I run into killing process problem using that scripts.Got killed in step 6, merging spatial attension.
Edit : You just need more memory for fusion, it takes me a A100 GPU.