Pruning and Distillation
Making a model smaller by removing what it doesn't need, or by teaching a smaller model to imitate a larger one.
9 min readUpdated 2026-09-03ai-inferencemodel-optimizationdistillationpruning
Making a model smaller by removing what it doesn't need, or by teaching a smaller model to imitate a larger one.