首页> 外文会议>International joint conference on natural language processing >Hyperspherical Query Likelihood Models with Word Embeddings
【24h】

Hyperspherical Query Likelihood Models with Word Embeddings

机译:带词嵌入的超球面查询似然模型

获取原文

摘要

This paper presents an initial study on hyperspherical query likelihood models (QLMs) for information retrieval (IR). Our motivation is to naturally utilize pre-trained word embeddings for probabilistic IR. To this end, key idea is to directly leverage the word embeddings as random variables for directional probabilistic models based on von Mises-Fisher distributions that are familiar to cosine distances. The proposed method enables us to theoretically take semantic similarities between document and target queries into consideration without introducing heuristic expansion techniques. In addition, this paper reveals relationships between hyperspherical QLMs and conventional QLMs. Experiments show document retrieval evaluation results in which a hyperspherical QLM is compared to conventional QLMs and document distance metrics using word or document embeddings.
机译:本文介绍了有关信息检索(IR)的超球面查询似然模型(QLM)的初步研究。我们的动机是自然地将预训练的单词嵌入用于概率IR。为此,关键思想是直接将单词嵌入作为随机变量,用于基于余弦距离熟悉的冯·米塞斯·费舍尔分布的定向概率模型。所提出的方法使我们能够在理论上考虑文档和目标查询之间的语义相似性,而无需引入启发式扩展技术。此外,本文还揭示了超球面QLM与常规QLM之间的关系。实验显示了文档检索评估结果,其中将超球形QLM与常规QLM和使用单词或文档嵌入的文档距离度量进行了比较。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号