# GitHub Copilot writes code

Date: 29 June 2021 · Era: V · Transformers · Category: product · Significance: 4/5
People: Nat Friedman, Mark Chen, Wojciech Zaremba
Organisations: GitHub, OpenAI, Microsoft

Canonical: https://shapeofintelligence.com/timeline/2021-github-copilot/ · Dataset and text CC BY 4.0

> A GPT-3 descendant trained on public code completes whole functions from a comment inside the editor; programming is the first profession to get an AI colleague.

## What had to happen

36 events back to 1943, oldest first. Direct influences are marked *direct*.

- [1943 · A logical calculus of nervous activity](https://shapeofintelligence.com/md/timeline/1943-mcculloch-pitts-neuron/)
- [1949 · Cells that fire together wire together](https://shapeofintelligence.com/md/timeline/1949-hebb-organization-of-behavior/)
- [1958 · The perceptron learns](https://shapeofintelligence.com/md/timeline/1958-perceptron/)
- [1960 · ADALINE and the least-mean-squares rule](https://shapeofintelligence.com/md/timeline/1960-adaline-lms/)
- [1965 · Moore's law](https://shapeofintelligence.com/md/timeline/1965-moores-law/)
- [1969 · Perceptrons](https://shapeofintelligence.com/md/timeline/1969-perceptrons-book/)
- [1970 · Reverse-mode automatic differentiation](https://shapeofintelligence.com/md/timeline/1970-linnainmaa-backprop/)
- [1974 · Werbos applies backpropagation to neural networks](https://shapeofintelligence.com/md/timeline/1974-werbos-backprop/)
- [1980 · The Neocognitron](https://shapeofintelligence.com/md/timeline/1980-neocognitron/)
- [1982 · The Hopfield network](https://shapeofintelligence.com/md/timeline/1982-hopfield-network/)
- [1985 · The Boltzmann machine](https://shapeofintelligence.com/md/timeline/1985-boltzmann-machine/)
- [1986 · Backpropagation](https://shapeofintelligence.com/md/timeline/1986-backpropagation/)
- [1989 · LeNet reads handwritten postcodes](https://shapeofintelligence.com/md/timeline/1989-lenet/)
- [1990 · Finding structure in time](https://shapeofintelligence.com/md/timeline/1990-elman-network/)
- [1991 · The vanishing gradient problem](https://shapeofintelligence.com/md/timeline/1991-vanishing-gradient/)
- [1997 · Long short-term memory](https://shapeofintelligence.com/md/timeline/1997-lstm/)
- [1998 · MNIST and LeNet-5](https://shapeofintelligence.com/md/timeline/1998-mnist-lenet5/)
- [1999 · The first GPU](https://shapeofintelligence.com/md/timeline/1999-geforce-256/)
- [2003 · A neural probabilistic language model](https://shapeofintelligence.com/md/timeline/2003-neural-language-model/)
- [2006 · Deep belief networks and the word 'deep'](https://shapeofintelligence.com/md/timeline/2006-deep-belief-nets/)
- [2007 · CUDA](https://shapeofintelligence.com/md/timeline/2007-cuda/)
- [2009 · Deep learning moves to GPUs](https://shapeofintelligence.com/md/timeline/2009-gpu-deep-learning/)
- [2009 · ImageNet](https://shapeofintelligence.com/md/timeline/2009-imagenet/)
- [2010 · Rectified linear units](https://shapeofintelligence.com/md/timeline/2010-relu/)
- [2012 · Google Brain's network discovers cats](https://shapeofintelligence.com/md/timeline/2012-google-brain-cat/)
- [2012 · Dropout](https://shapeofintelligence.com/md/timeline/2012-dropout/)
- [2012 · AlexNet wins ImageNet](https://shapeofintelligence.com/md/timeline/2012-alexnet/)
- [2014 · Attention](https://shapeofintelligence.com/md/timeline/2014-bahdanau-attention/)
- [2014 · Sequence to sequence learning](https://shapeofintelligence.com/md/timeline/2014-seq2seq/)
- [2015 · Batch normalisation](https://shapeofintelligence.com/md/timeline/2015-batchnorm/)
- [2015 · Residual networks](https://shapeofintelligence.com/md/timeline/2015-resnet/)
- [2017 · Attention is all you need](https://shapeofintelligence.com/md/timeline/2017-attention-is-all-you-need/)
- [2018 · GPT: generative pre-training](https://shapeofintelligence.com/md/timeline/2018-gpt-1/)
- [2019 · GPT-2 and the model too dangerous to release](https://shapeofintelligence.com/md/timeline/2019-gpt-2/)
- [2020 · Scaling laws for neural language models](https://shapeofintelligence.com/md/timeline/2020-scaling-laws/)
- [2020 · GPT-3](https://shapeofintelligence.com/md/timeline/2020-gpt-3/) *direct*

GitHub released Copilot as a technical preview on 29 June 2021. Inside Visual Studio Code, as a programmer typed, it proposed the rest of the line, or the whole function, in grey text, and a press of the tab key accepted it. The model behind it was Codex, a GPT-3 fine-tuned on billions of lines of public code from GitHub, described in a paper the following week that reported it solved about 29 percent of a set of programming problems on the first try and 70 percent given a hundred attempts.

It was the first product to put a large language model into the daily work of a profession, and programmers, who could check the output by running it, adopted it faster than anyone. By 2023 GitHub reported over a million paying users and claimed that Copilot wrote nearly half the code in files where it was enabled. The legal questions it raised, about training on licensed code and reproducing it, went to court in 2022 and largely failed.

Copilot is on this timeline as the beginning of the change that ChatGPT made general eighteen months later, and as the origin of the coding agents of 2025 and 2026, which write, run and fix programs on their own and are, by most measures, the most economically consequential use of the technology.

## What it led to

6 events downstream, through 2026.

Built on it directly:

- [2024 · Claude learns to use a computer](https://shapeofintelligence.com/md/timeline/2024-computer-use/)
- [2025 · Claude 4 and Claude Code](https://shapeofintelligence.com/md/timeline/2025-claude-4-claude-code/)

And, through them, by era:

- VI · Everyone: 1 events
- VII · Agents: 3 events

## Sources

- [Introducing GitHub Copilot: your AI pair programmer (GitHub, 29 June 2021)](https://github.blog/2021-06-29-introducing-github-copilot-ai-pair-programmer/) — announcement
- [Evaluating Large Language Models Trained on Code (arXiv:2107.03374)](https://arxiv.org/abs/2107.03374) — paper

---

The Shape of Intelligence by Jamie McKaye (https://jamiemckaye.com) · Markdown mirror of https://shapeofintelligence.com/timeline/2021-github-copilot/

Before: [2021 · Anthropic is founded](https://shapeofintelligence.com/md/timeline/2021-anthropic-founded/) · After: [2022 · InstructGPT](https://shapeofintelligence.com/md/timeline/2022-instructgpt/)
