The larger the context window, the more cache is needed, the greater the memory footprint, and the slower the speed; taking Qwen 3.8 as an example, the cache for a 256K context window can reach 17 GB, making it twice as slow as a smaller window.