Room 5 · Transformers
Room 5: Transformers (2017–today)
Transformers (2017–today): 8 pieces of AI history you can walk in 3D at New Mind Museum.
Walk this room in 3D →- 2017 · Attention Is All You Need — Vaswani and seven other authors · Google. The architecture behind today's language models
- 2018 · BERT and GPT: Pretrain and Fine-tune — Google and OpenAI. First train on huge amounts of text, then adjust to a task
- 2020 · GPT-3 and the Scaling Laws — OpenAI. Bigger, and suddenly more capable
- 2020 · AlphaFold Solves Protein Folding — DeepMind. AI as a tool for scientific discovery
- 2022 · Learning from Human Preferences — OpenAI · InstructGPT. Teaching a model which answers we prefer
- 2022 · Images from Text — DALL·E 2, Midjourney and Stable Diffusion. From noise to an image that matches the description
- 2022 · ChatGPT — OpenAI. Conversational AI reaches everyone
- 2024 · Reasoning Models — OpenAI o1 · DeepSeek R1. More compute spent on intermediate steps before answering
Room 1 · The Dreamers · Room 2 · The Birth · Room 3 · The Winters · Room 4 · The Awakening · Room 6 · The Awards
Cite this: Nazareno, I. (2026). Room 5: Transformers (2017–today). New Mind Museum. Retrieved November 17, 2026, from https://newmindmuseum.com/museum/room-5-transformers/