Skip to content
The Shape of Intelligence

Gemini

Google merges Brain and DeepMind and releases a model trained from the start on text, images, audio and video together; the search company catches up to GPT-4.

category
model
significance
3 of 5
people
Demis Hassabis, Sundar Pichai, Oriol Vinyals
organisations
Google DeepMind

what had to happen · 53 events back to 1943

Every event this one built on, transitively, in order. Direct influences are marked.

VI · Everyone · 5

  1. 2022InstructGPT
  2. 2022Chain-of-thought prompting
  3. 2022PaLMdirect
  4. 2022ChatGPT
  5. 2023GPT-4direct

Google had invented the transformer, run the largest models in the world and been caught flat-footed by ChatGPT. In April 2023 it merged Google Brain and DeepMind into one organisation under Demis Hassabis, and on 6 December it released the result. Gemini came in three sizes, Ultra, Pro and Nano, was trained on TPU v4 and v5 pods, and was natively multimodal: rather than bolting an image encoder onto a language model, it had been trained from the beginning on interleaved text, code, images, audio and video. Ultra was the first model to beat human experts on the MMLU benchmark, at 90 percent, and matched or exceeded GPT-4 on most others.

The launch also included a demonstration video that had been edited to look like real-time interaction, and the criticism it drew set the tone for a year in which Google's models were judged harshly. Gemini 1.5 in February 2024 introduced a million-token context window, which changed what the models could be asked to read.

Gemini is on this timeline as the moment the three-laboratory frontier settled, OpenAI, Anthropic and Google DeepMind, and as the model family that in 2025 achieved gold-medal performance at the mathematical olympiad and, as Gemini 3, took the lead on most benchmarks.

what it led to · 1 events downstream, through 2025

Built on it directly:

  1. 2025Gemini 3VII

sources · 1

See this era in the exhibition →Back to the timeline