If you need further info on how Stable Diffusion works, I suggest you to read my notes on LoRA and also the following links:
- LoRa paper: Hu, E. J.,et al. (2021). LoRA: Low-Rank Adaptation of Large Language Models.
- A HuggingFace post indicating why you should use LoRa. Using LoRA for Efficient Stable Diffusion Fine-Tuning
- Tuning an LLM with LoRa, somehow related to images: Parameter-Efficient LLM Finetuning With Low-Rank Adaptation (LoRA)
- Intuition behind Unet: You Can’t Spell Diffusion without U | by Sairam Sundaresan | Towards Data Science
Different Stable Diffusion techniques you should learn about: