Through ablation experiments, the paper shows that freezing the recurrent layer at a mid-stage is more effective than freezing throughout or freezing at a late stage.