# GPT-4o talks

Date: 13 May 2024 · Era: VI · Everyone · Category: product · Significance: 3/5
People: Mira Murati, Mark Chen
Organisations: OpenAI

Canonical: https://shapeofintelligence.com/timeline/2024-gpt-4o/ · Dataset and text CC BY 4.0

> OpenAI's 'omni' model handles speech, vision and text in one network with conversational latency; a live demo of a flirtatious voice makes the film Her a product roadmap.

## What had to happen

51 events back to 1943, oldest first. Direct influences are marked *direct*.

- [1943 · A logical calculus of nervous activity](https://shapeofintelligence.com/md/timeline/1943-mcculloch-pitts-neuron/)
- [1948 · A mathematical theory of communication](https://shapeofintelligence.com/md/timeline/1948-shannon-information-theory/)
- [1949 · Cells that fire together wire together](https://shapeofintelligence.com/md/timeline/1949-hebb-organization-of-behavior/)
- [1950 · Programming a computer for playing chess](https://shapeofintelligence.com/md/timeline/1950-shannon-chess/)
- [1950 · Computing machinery and intelligence](https://shapeofintelligence.com/md/timeline/1950-turing-computing-machinery/)
- [1958 · The perceptron learns](https://shapeofintelligence.com/md/timeline/1958-perceptron/)
- [1959 · Samuel's checkers program coins 'machine learning'](https://shapeofintelligence.com/md/timeline/1959-samuel-machine-learning/)
- [1960 · ADALINE and the least-mean-squares rule](https://shapeofintelligence.com/md/timeline/1960-adaline-lms/)
- [1965 · Moore's law](https://shapeofintelligence.com/md/timeline/1965-moores-law/)
- [1966 · ELIZA](https://shapeofintelligence.com/md/timeline/1966-eliza/)
- [1969 · Perceptrons](https://shapeofintelligence.com/md/timeline/1969-perceptrons-book/)
- [1970 · Reverse-mode automatic differentiation](https://shapeofintelligence.com/md/timeline/1970-linnainmaa-backprop/)
- [1974 · Werbos applies backpropagation to neural networks](https://shapeofintelligence.com/md/timeline/1974-werbos-backprop/)
- [1980 · The Neocognitron](https://shapeofintelligence.com/md/timeline/1980-neocognitron/)
- [1982 · The Hopfield network](https://shapeofintelligence.com/md/timeline/1982-hopfield-network/)
- [1985 · The Boltzmann machine](https://shapeofintelligence.com/md/timeline/1985-boltzmann-machine/)
- [1986 · Backpropagation](https://shapeofintelligence.com/md/timeline/1986-backpropagation/)
- [1988 · Temporal-difference learning](https://shapeofintelligence.com/md/timeline/1988-temporal-difference-learning/)
- [1989 · Q-learning](https://shapeofintelligence.com/md/timeline/1989-q-learning/)
- [1989 · LeNet reads handwritten postcodes](https://shapeofintelligence.com/md/timeline/1989-lenet/)
- [1990 · Finding structure in time](https://shapeofintelligence.com/md/timeline/1990-elman-network/)
- [1991 · The vanishing gradient problem](https://shapeofintelligence.com/md/timeline/1991-vanishing-gradient/)
- [1992 · TD-Gammon reaches world-class backgammon](https://shapeofintelligence.com/md/timeline/1992-td-gammon/)
- [1997 · Long short-term memory](https://shapeofintelligence.com/md/timeline/1997-lstm/)
- [1998 · MNIST and LeNet-5](https://shapeofintelligence.com/md/timeline/1998-mnist-lenet5/)
- [1999 · The first GPU](https://shapeofintelligence.com/md/timeline/1999-geforce-256/)
- [2003 · A neural probabilistic language model](https://shapeofintelligence.com/md/timeline/2003-neural-language-model/)
- [2006 · Deep belief networks and the word 'deep'](https://shapeofintelligence.com/md/timeline/2006-deep-belief-nets/)
- [2007 · CUDA](https://shapeofintelligence.com/md/timeline/2007-cuda/)
- [2009 · Deep learning moves to GPUs](https://shapeofintelligence.com/md/timeline/2009-gpu-deep-learning/)
- [2009 · ImageNet](https://shapeofintelligence.com/md/timeline/2009-imagenet/)
- [2010 · Rectified linear units](https://shapeofintelligence.com/md/timeline/2010-relu/)
- [2012 · Google Brain's network discovers cats](https://shapeofintelligence.com/md/timeline/2012-google-brain-cat/)
- [2012 · Dropout](https://shapeofintelligence.com/md/timeline/2012-dropout/)
- [2012 · AlexNet wins ImageNet](https://shapeofintelligence.com/md/timeline/2012-alexnet/)
- [2013 · Deep Q-networks play Atari](https://shapeofintelligence.com/md/timeline/2013-dqn/)
- [2014 · Attention](https://shapeofintelligence.com/md/timeline/2014-bahdanau-attention/)
- [2014 · Sequence to sequence learning](https://shapeofintelligence.com/md/timeline/2014-seq2seq/)
- [2015 · Batch normalisation](https://shapeofintelligence.com/md/timeline/2015-batchnorm/)
- [2015 · Residual networks](https://shapeofintelligence.com/md/timeline/2015-resnet/)
- [2016 · WaveNet](https://shapeofintelligence.com/md/timeline/2016-wavenet/) *direct*
- [2017 · Attention is all you need](https://shapeofintelligence.com/md/timeline/2017-attention-is-all-you-need/)
- [2017 · Deep reinforcement learning from human preferences](https://shapeofintelligence.com/md/timeline/2017-rl-from-human-preferences/)
- [2018 · GPT: generative pre-training](https://shapeofintelligence.com/md/timeline/2018-gpt-1/)
- [2019 · GPT-2 and the model too dangerous to release](https://shapeofintelligence.com/md/timeline/2019-gpt-2/)
- [2020 · Scaling laws for neural language models](https://shapeofintelligence.com/md/timeline/2020-scaling-laws/)
- [2020 · GPT-3](https://shapeofintelligence.com/md/timeline/2020-gpt-3/)
- [2020 · Learning to summarise from human feedback](https://shapeofintelligence.com/md/timeline/2020-rlhf-summarisation/)
- [2022 · InstructGPT](https://shapeofintelligence.com/md/timeline/2022-instructgpt/)
- [2022 · ChatGPT](https://shapeofintelligence.com/md/timeline/2022-chatgpt/)
- [2023 · GPT-4](https://shapeofintelligence.com/md/timeline/2023-gpt-4/) *direct*

The day before Google's developer conference, OpenAI streamed a demonstration of a model that listened, looked and spoke. GPT-4o, for omni, took audio, images and text as one stream of tokens and produced audio directly, with a response time of about 320 milliseconds, the pace of a human conversation. Earlier voice modes had chained three models, speech to text, text to text, text to speech, and lost the tone, the laughter and the interruptions in between. This one sang, whispered, changed its accent on request, and, in the demo, sounded to many viewers like Scarlett Johansson's character in the film Her.

Johansson said she had declined OpenAI's request to voice the product and that the resemblance was deliberate; the company withdrew the voice. The model itself went to free users, the first time a GPT-4-class system had, and it became the base of ChatGPT for the following year.

GPT-4o is on this timeline as the point where the interface stopped being a text box. The assistants that Siri had promised in 2011 arrived thirteen years later as a model that could hold a spoken conversation, and the humanoid robots of 2025 talked with the same architecture.

## What it led to

4 events downstream, through 2026.

Built on it directly:

- [2025 · GPT-5](https://shapeofintelligence.com/md/timeline/2025-gpt-5/)

And, through them, by era:

- VII · Agents: 3 events

## Sources

- [Hello GPT-4o (OpenAI, 13 May 2024)](https://openai.com/index/hello-gpt-4o/) — announcement

---

The Shape of Intelligence by Jamie McKaye (https://jamiemckaye.com) · Markdown mirror of https://shapeofintelligence.com/timeline/2024-gpt-4o/

Before: [2024 · AlphaFold 3](https://shapeofintelligence.com/md/timeline/2024-alphafold-3/) · After: [2024 · The EU AI Act enters into force](https://shapeofintelligence.com/md/timeline/2024-eu-ai-act/)
