Answer comparison in automated question answering

摘要

In the context of Question Answering (QA) on free text, we assess the value of answer comparison and information fusion in handling multiple answers. We report improvements in answer re-ranking using fusion on a set of location questions and show the advantages of considering candidates as allies rather than competitors. We conclude with some observations about answer modeling and evaluation methodology, arising from a more recent experiment with a larger set of questions and a greater diversity of question types and candidates.