Latent Communication
A mode of communication in which models pass information directly through a continuous vector space (latent space) rather than through natural-language text, avoiding the overhead of tokenization and re-encoding.
Timeline (last 90 days)
Text communication discretizes continuous hidden states into vocabulary tokens, causing information loss and high token overhead; latent communication directly transmits continuous vectors or low-dimensional projections, preserving more intermediate computation information.
Latent communication refers to a communication method in which models transmit information directly in a continuous vector space rather than through natural-language text.
Latent communication directly transmits the hidden states inside a model, and one mainstream approach is KV-cache-based communication.
All Facts (3)
Text communication discretizes continuous hidden states into vocabulary tokens, causing information loss and high token overhead; latent communication directly transmits continuous vectors or low-dimensional projections, preserving more intermediate computation information.
50%UnverifiedLatent communication refers to a communication method in which models transmit information directly in a continuous vector space rather than through natural-language text.
50%UnverifiedLatent communication directly transmits the hidden states inside a model, and one mainstream approach is KV-cache-based communication.
50%