Cloud inference typically incurs network round-trip latency of tens to hundreds of milliseconds, which is unacceptable for scenarios with extremely high real-time requirements such as robot control and autonomous driving.