首页>
外国专利>
SYSTEMS AND METHODS FOR UNIFYING STATISTICAL MODELS FOR DIFFERENT DATA MODALITIES
SYSTEMS AND METHODS FOR UNIFYING STATISTICAL MODELS FOR DIFFERENT DATA MODALITIES
展开▼
机译:用于统一不同数据模型的统计模型的系统和方法
展开▼
页面导航
摘要
著录项
相似文献
摘要
Techniques for performing a prediction task using a multi-modal statistical model configured to receive input data from multiple modalities including input data from a first modality and input data from a second modality different from the first modality. The techniques include: obtaining information specifying the multi-modal statistical model including values of parameters of each of multiple components of the multi-modal statistical model, the multiple components including first and second encoders for processing input data for the first and second modalities, respectively, first and second modality embeddings, a joint-modality representation, and a predictor; obtaining first input data for the first data modality; providing the first input data to the first encoder to generate a first feature vector; identifying a second feature vector using the joint-modality representation, the first modality embedding and the first feature vector; and generating a prediction for the prediction task using the predictor and the second feature vector.
展开▼