[KongchangAI]
Concept有效算力

Goodput

A measure of the proportion of a cluster's capacity actually used for effective computation per unit time. It equals peak computing power multiplied by utilization, minus losses such as throttling, idling, retries and communication waits.

Timeline (last 90 days)

Oct 19

The Goodput metric measures the volume of valid requests or valid tokens that meet SLOs (such as TTFT and ITL) per unit time, and can reflect the economic efficiency actually paid for in production environments.

Unverified50%

All Facts (1)

Source Articles