Prompt Lookup Decoding

A parameter-free variant of speculative decoding that requires no additional draft model. It retrieves n-gram fragments as candidate tokens through string matching directly within the existing input prompt and generated text. The approach is suited to high-text-repetition scenarios such as code editing, document summarization, and retrieval-augmented generation (RAG).