Uncategorized
A Cosmic Collision Seen in Waves and Light
In 2017 LIGO and Virgo caught two neutron stars merging.
Uncategorized
Uncategorized
First Light: Gravitational Waves Confirm Einstein
LIGO announced the first direct detection of gravitational waves in 2016.
Uncategorized
Chinchilla and the Rethinking of Scaling Laws
DeepMind showed in 2022 that many large models were undertrained.
Uncategorized
Learning From Human Feedback: The InstructGPT Shift
OpenAI used reinforcement learning from human feedback to align models in 2022.
Uncategorized
BERT and the Bidirectional Turn in Language Understanding
Google's BERT read text in both directions at once, released in 2018.
Uncategorized
AlphaZero: Mastering Chess and Go From Scratch
AlphaZero learned chess, shogi, and Go through self-play alone in 2017.
Uncategorized
CLIP: Teaching Machines to Link Images and Words
OpenAI's CLIP learned from 400 million image-text pairs in 2021.
Uncategorized
Denoising the Future: The Rise of Diffusion Models
Denoising diffusion models learn to reverse a gradual noising process.
Uncategorized
GPT-3 and the Arrival of Few-Shot Language Models
OpenAI's GPT-3, with 175 billion parameters, debuted in 2020.
Uncategorized
AlphaFold and the 50-Year Protein-Folding Problem
DeepMind's AlphaFold2 predicted 3D protein structures at near-experimental accuracy in 2021.