ConceptCross-modal Alignment
Cross-modal Alignment
The ability of a model to establish semantic correspondences between inputs of different modalities, such as audio events and visual content. It is a core technical challenge in omni-modal video understanding.
Timeline (last 90 days)
Oct 19
Cross-modal alignment refers to mapping representations of different modalities into the same semantic space so that similar content is close to each other in the vector space.
Unverified50%