The rule of no_repeat_ngram_size: 3 is to prohibit generating any 3-token sequence that has already appeared, and in the Transformers.js implementation it sets the scores of these tokens to negative infinity.