response ratio
The proportion of answer tokens in the total number of tokens in a sample, used to measure the density of the supervision signal.
Timeline (last 90 days)
Under a fixed fine-tuning budget, response density (response ratio) predicts the utility of instruction fine-tuning better than common proxy metrics such as language quality and instruction complexity.
Response ratio is defined as the number of answer tokens as a proportion of the sample's total token count.
The predictive power of response ratio is more portable and may prove more stable across different datasets and tasks.
The advantage of response ratio may stem partly from how it interacts with the training budget rather than from a pure quality signal.
The study does not provide a general threshold for response ratio or a combined metric with other filtering conditions.
All Facts (5)
Under a fixed fine-tuning budget, response density (response ratio) predicts the utility of instruction fine-tuning better than common proxy metrics such as language quality and instruction complexity.
50%UnverifiedResponse ratio is defined as the number of answer tokens as a proportion of the sample's total token count.
50%UnverifiedThe advantage of response ratio may stem partly from how it interacts with the training budget rather than from a pure quality signal.
50%UnverifiedThe study does not provide a general threshold for response ratio or a combined metric with other filtering conditions.
50%UnverifiedThe predictive power of response ratio is more portable and may prove more stable across different datasets and tasks.
50%