# Stable Diffusion is released

Date: 22 August 2022 · Era: VI · Everyone · Category: model · Significance: 5/5
People: Robin Rombach, Björn Ommer, Emad Mostaque
Organisations: LMU Munich, Stability AI, Runway

Canonical: https://shapeofintelligence.com/timeline/2022-stable-diffusion/ · Dataset and text CC BY 4.0

> A text-to-image diffusion model that runs on a gaming GPU is released with its weights under an open licence; anyone can generate anything, and the argument about that begins.

## What had to happen

40 events back to 1943, oldest first. Direct influences are marked *direct*.

- [1943 · A logical calculus of nervous activity](https://shapeofintelligence.com/md/timeline/1943-mcculloch-pitts-neuron/)
- [1949 · Cells that fire together wire together](https://shapeofintelligence.com/md/timeline/1949-hebb-organization-of-behavior/)
- [1958 · The perceptron learns](https://shapeofintelligence.com/md/timeline/1958-perceptron/)
- [1960 · ADALINE and the least-mean-squares rule](https://shapeofintelligence.com/md/timeline/1960-adaline-lms/)
- [1965 · Moore's law](https://shapeofintelligence.com/md/timeline/1965-moores-law/)
- [1969 · Perceptrons](https://shapeofintelligence.com/md/timeline/1969-perceptrons-book/)
- [1970 · Reverse-mode automatic differentiation](https://shapeofintelligence.com/md/timeline/1970-linnainmaa-backprop/)
- [1974 · Werbos applies backpropagation to neural networks](https://shapeofintelligence.com/md/timeline/1974-werbos-backprop/)
- [1980 · The Neocognitron](https://shapeofintelligence.com/md/timeline/1980-neocognitron/)
- [1982 · The Hopfield network](https://shapeofintelligence.com/md/timeline/1982-hopfield-network/)
- [1985 · The Boltzmann machine](https://shapeofintelligence.com/md/timeline/1985-boltzmann-machine/)
- [1986 · Backpropagation](https://shapeofintelligence.com/md/timeline/1986-backpropagation/)
- [1989 · LeNet reads handwritten postcodes](https://shapeofintelligence.com/md/timeline/1989-lenet/)
- [1990 · Finding structure in time](https://shapeofintelligence.com/md/timeline/1990-elman-network/)
- [1991 · The vanishing gradient problem](https://shapeofintelligence.com/md/timeline/1991-vanishing-gradient/)
- [1997 · Long short-term memory](https://shapeofintelligence.com/md/timeline/1997-lstm/)
- [1998 · MNIST and LeNet-5](https://shapeofintelligence.com/md/timeline/1998-mnist-lenet5/)
- [1999 · The first GPU](https://shapeofintelligence.com/md/timeline/1999-geforce-256/)
- [2003 · A neural probabilistic language model](https://shapeofintelligence.com/md/timeline/2003-neural-language-model/)
- [2006 · Deep belief networks and the word 'deep'](https://shapeofintelligence.com/md/timeline/2006-deep-belief-nets/)
- [2007 · CUDA](https://shapeofintelligence.com/md/timeline/2007-cuda/)
- [2009 · Deep learning moves to GPUs](https://shapeofintelligence.com/md/timeline/2009-gpu-deep-learning/)
- [2009 · ImageNet](https://shapeofintelligence.com/md/timeline/2009-imagenet/)
- [2010 · Rectified linear units](https://shapeofintelligence.com/md/timeline/2010-relu/)
- [2012 · Google Brain's network discovers cats](https://shapeofintelligence.com/md/timeline/2012-google-brain-cat/)
- [2012 · Dropout](https://shapeofintelligence.com/md/timeline/2012-dropout/)
- [2012 · AlexNet wins ImageNet](https://shapeofintelligence.com/md/timeline/2012-alexnet/)
- [2014 · Attention](https://shapeofintelligence.com/md/timeline/2014-bahdanau-attention/)
- [2014 · Sequence to sequence learning](https://shapeofintelligence.com/md/timeline/2014-seq2seq/)
- [2015 · Batch normalisation](https://shapeofintelligence.com/md/timeline/2015-batchnorm/)
- [2015 · Diffusion models](https://shapeofintelligence.com/md/timeline/2015-diffusion-thermodynamics/)
- [2015 · Residual networks](https://shapeofintelligence.com/md/timeline/2015-resnet/)
- [2017 · Attention is all you need](https://shapeofintelligence.com/md/timeline/2017-attention-is-all-you-need/)
- [2018 · GPT: generative pre-training](https://shapeofintelligence.com/md/timeline/2018-gpt-1/)
- [2019 · GPT-2 and the model too dangerous to release](https://shapeofintelligence.com/md/timeline/2019-gpt-2/)
- [2020 · Scaling laws for neural language models](https://shapeofintelligence.com/md/timeline/2020-scaling-laws/)
- [2020 · GPT-3](https://shapeofintelligence.com/md/timeline/2020-gpt-3/)
- [2020 · Denoising diffusion probabilistic models](https://shapeofintelligence.com/md/timeline/2020-ddpm/) *direct*
- [2020 · An image is worth 16×16 words](https://shapeofintelligence.com/md/timeline/2020-vision-transformer/)
- [2021 · CLIP and DALL·E](https://shapeofintelligence.com/md/timeline/2021-clip-dalle/) *direct*

Robin Rombach and Björn Ommer's group at LMU Munich had shown in December 2021 that diffusion could be run not on pixels but in the compressed latent space of an autoencoder, which made it roughly fifty times cheaper. Trained on LAION-5B, a public dataset of five billion image–text pairs scraped from the web, with compute paid for by Stability AI, the resulting model fitted in the memory of a consumer graphics card. On 22 August 2022 it was released with its weights, under a licence that allowed almost any use.

Within days it was running on laptops, in browsers and, crudely, on phones. Within weeks it had been fine-tuned to draw particular people, styles and products, extended with ControlNet to follow sketches and poses, and wrapped in a hundred interfaces. It was also used to make sexual images of real people, to imitate living artists by name, and to flood art sites with output. Getty Images and a group of artists sued in January 2023.

Stable Diffusion is on this timeline at the top level because it settled a question. DALL·E 2 had shown what the technology could do and had kept it behind a waiting list and a filter. Stable Diffusion showed that once a model existed it would be free, and everything since, in images and then in language, has had to assume that.

## What it led to

1 events downstream, through 2024.

Built on it directly:

- [2024 · Sora](https://shapeofintelligence.com/md/timeline/2024-sora/)

## Sources

- [Stable Diffusion Public Release (Stability AI, 22 August 2022)](https://stability.ai/news/stable-diffusion-public-release) — announcement
- [High-Resolution Image Synthesis with Latent Diffusion Models (arXiv:2112.10752)](https://arxiv.org/abs/2112.10752) — paper
- [High-Resolution Image Synthesis with Latent Diffusion Models (CVPR, 2022)](https://doi.org/10.1109/CVPR52688.2022.01042) — paper

---

The Shape of Intelligence by Jamie McKaye (https://jamiemckaye.com) · Markdown mirror of https://shapeofintelligence.com/timeline/2022-stable-diffusion/

Before: [2022 · Midjourney opens its beta](https://shapeofintelligence.com/md/timeline/2022-midjourney/) · After: [2022 · Galactica lasts three days](https://shapeofintelligence.com/md/timeline/2022-galactica/)
