Gemini
Google merges Brain and DeepMind and releases a model trained from the start on text, images, audio and video together; the search company catches up to GPT-4.
what had to happen · 53 events back to 1943
Every event this one built on, transitively, in order. Direct influences are marked.
00 · One neuron · 1
I · Foundations · 11
- 1948A mathematical theory of communication
- 1949Cells that fire together wire together
- 1950Programming a computer for playing chess
- 1950Computing machinery and intelligence
- 1958The perceptron learns
- 1959Samuel's checkers program coins 'machine learning'
- 1960ADALINE and the least-mean-squares rule
- 1965Moore's law
- 1966ELIZA
- 1969Perceptrons
- 1970Reverse-mode automatic differentiation
W1 · The first winter · 2
II · Connection · 3
W2 · The second winter · 6
III · Statistics and data · 9
IV · Deep learning · 9
V · Transformers · 7
VI · Everyone · 5
- 2022InstructGPT
- 2022Chain-of-thought prompting
- 2022PaLMdirect
- 2022ChatGPT
- 2023GPT-4direct
Google had invented the transformer, run the largest models in the world and been caught flat-footed by ChatGPT. In April 2023 it merged Google Brain and DeepMind into one organisation under Demis Hassabis, and on 6 December it released the result. Gemini came in three sizes, Ultra, Pro and Nano, was trained on TPU v4 and v5 pods, and was natively multimodal: rather than bolting an image encoder onto a language model, it had been trained from the beginning on interleaved text, code, images, audio and video. Ultra was the first model to beat human experts on the MMLU benchmark, at 90 percent, and matched or exceeded GPT-4 on most others.
The launch also included a demonstration video that had been edited to look like real-time interaction, and the criticism it drew set the tone for a year in which Google's models were judged harshly. Gemini 1.5 in February 2024 introduced a million-token context window, which changed what the models could be asked to read.
Gemini is on this timeline as the moment the three-laboratory frontier settled, OpenAI, Anthropic and Google DeepMind, and as the model family that in 2025 achieved gold-medal performance at the mathematical olympiad and, as Gemini 3, took the lead on most benchmarks.
what it led to · 1 events downstream, through 2025
Built on it directly:
- 2025Gemini 3VII