The article's author argues that recurrent mechanisms are not the key to improving performance in next-generation Transformer designs.