Concept
Long Decode
A large-model decoding feature that supports an extremely long output window, allowing a model to output up to 1M tokens in a single response. Fully exploiting it requires framework-level support, such as continuationToken or the Interactions API.
Timeline (last 90 days)
Oct 14
Long Decode allows output of up to 1M tokens, making it one of the implementations with the largest output window among current frontier models.
Unverified50%
Oct 14
The Interactions API supports a large number of new features, and can directly handle Long Decode in background mode.
Unverified50%
Oct 14
Both paths for LangChainJS to adapt to Long Decode (continuationToken and Interactions API) depend on issue 11879 landing first, and the project's current priority is to release that fix as soon as possible.
Expired50%