Lora

What it does

Using Low-rank adaptation to quickly fine-tune diffusion models.

In their own words: An important paradigm of natural language processing consists of large-scale pre-training on general domain data and adaptation to particular tasks or domains. As we pre-train larger models, full fine-tuning, which retrains all model parameters, becomes less feasible. Using GPT-3 175B as an example -- deploying independent instances of fine-tuned models, each with 175B parameters, is prohibitively expensive. We propose Low-Rank Adaptation, or LoRA, which freezes the pre-trained model weights and injects trainable rank decomposition matrices into each layer of the Transformer architecture, gre…

It's a image & design tool from Arxiv. A free tier lets you try it before paying — useful when you're keeping costs low. Visit the website for the latest features and pricing.