Knowledge distillation trains a smaller model to imitate a stronger teacher model, reducing cost while retaining useful behavior.
Open the related AI concept, tools, and learning paths.