Knowledge Distillation Shrinks Models Without Losing Much
A large model can teach a small one to nearly match it.
A large model can teach a small one to nearly match it.
Some networks abruptly generalize long after they seem done learning.
A clever trick makes big language models generate text faster without changing output.
Microscopic animals that endure the harshest conditions are giving up their secrets.
Printers that deposit living cells are constructing functional tissue.
Scientists mapped a cubic millimeter of mouse brain in extraordinary detail.
A powerful new solar telescope resolved features on the Sun smaller than ever seen.
Tiny devices lined with living cells mimic the function of human organs.
Ultra-thin engineered surfaces can replace bulky lenses.
Viruses tailored to kill specific bacteria saved patients when antibiotics failed.