LoRa in AI image generators

This stands for Low Rank adaptation. In AI terms, this is a small add-on to the model that makes it do specific things. It is usually used in the context of stable diffusion. A large model takes very long to train with significant resources. However, sometimes, you need specific details – for example you could have a model that needs to do better image generation of the hands, in which case you train a small subset with hands and that is the LoRa that will be used specifically for hands. Remember, LoRa does not do the full model but just freezes weights and parameters. Then it adds matrices which are applied to new inputs to get specific results in the context that is needed.

LoRa is used sometimes to create images in a specific style.


In the picture above that image was generated with an image generator in the drawing style. Whereas in the fantasy or other styles it looks very different with the same prompt.

Similar Posts

  • Text from Image

    Starting with a base image, it is possible to generate a description. An AI (Qwen-3-VL) simple description : This is a simple, hand-drawn black-and-white sketch of a person’s upper body. Here’s a breakdown of the key elements: Hair: Long, flowing hair depicted with two smooth, curved lines extending from the top of the head down…

  • Sparql tool – connect LLM to knowledge graphs

    Talk to knowledge graph – sparql-tool Use LLM.: Hallucinations (sometimes good for creativity), Outdated knowledge, no access to your data ( trained on public knowledge). Solutions: Fine tuning – retrain the model on domain data RAG – Search: look things up in real time. Claude code looks at searched doc. Vector embeddings: semantic similarity search…

  • |

    Virtual cell

    Hani Goodrazi – Arc institute has been working on virtual cell. Drugs fail due to overfit experimental models, You need screen drugs with better models of human biology. Geneva is platfrom that brings tumor models into perturbation model – that is a transcriptomics assay that deconvolves into effect. Take multiple cell line and then treat…

  • |

    Fitness landscape for antibodies (Flab2)

    There have been many AI models to predict the structure of proteins, especially antibodies. There are several key aspects to developing antibodies as drugs beyond binding to the target of interest. These are : thermostability, expression, aggregation, binding affinity, pharmacokinetics, polyreactivity and immunogenicity. There have been many models available such as IgLM, ProGen2, Chai-1, ESM2,…

  • Language of Graphics

    Key IDEA: Chart types are great shortcuts but graphics are really sophisticated visual structures GoFish language for python using the Gestalt grouping principle. It can make graphics or chart that can display the messages that are intentional. .mark() – what shape to draw at each postion and what channels to encode part to whole relationships…