The key mechanisms that produce probabilistic outputs in the Transformer architecture are the temperature parameter and sampling strategies; when the temperature is set to 0, the output tends toward the highest-certainty choice but still cannot be guaranteed to be identical to the previous output.