Bidirectional Attention Encoder

A neural network architecture in which every position in a sequence can attend to all context on both its left and right sides during the forward pass. Compared to autoregressive unidirectional attention, this approach achieves higher information utilization and completes inference in a single forward pass with constant latency. It is well suited for comprehension-oriented tasks such as classification and semantic matching.