HOPE preserves expert cooperation in MoE pruning

HOPE preserves expert cooperation in MoE pruning

HOPE is a second-order expert-pruning method that accounts for pairwise interactions between experts in Mixture-of-Experts (MoE) layers. The authors report that HOPE improves benchmark ranks—especially at 40–50% pruning—and provide a three-step calibration, solve and prune workflow.