(22.07) 1 Oral Paper for ICML 2022 Workshop on Dynamic Neural Networks