Smart Shrinking: a Guide to Neural Network Pruning

Guide to Neural Network Pruning technique.

I still remember the heat radiating off my laptop fan during that first massive training run—a low, desperate hum that sounded like a jet engine about to fail. I was staring at a model that was technically “state-of-the-art,” but it was so bloated and computationally expensive that it was practically useless for anything outside of …