Non-Autoregressive Architecture

A class of neural network architectures that do not rely on sequential token-by-token generation. By employing parallel sampling or other mechanisms to generate multiple outputs simultaneously, these architectures depart from the traditional autoregressive paradigm and can theoretically deliver significant improvements in inference speed and throughput.