In the following, I focus on one particular challenge: the integration of affective computing and multimedia information extraction. What are the critical technical challenges in multimedia information extraction (MMIE)? Work by Picard and others has created considerable awareness for the role of affect in human computer interaction. As key ingredients of affective computing Picard identifies recognizing, expressing, modelling, communicating, and responding to emotional information (Picard 2003). In the context of information extraction, methods of affective computing can be applied to enhance classical information extraction tasks by emotion and sentiment detection. In addition, the experience of users interacting with an information extraction system might be improved by recognizing and appropriately responding to the user's affective state (see also Belkin's keynote "Some(what) Grand Challenges for Information Retrieval" at ECIR 2008 which discusses the use of affective user interfaces to information retrieval systems). The availability of robust methods for emotion recognition is an important step in the development of information extraction systems that are sensitive to the user's emotional state. In addition, further research is required to shed light on the question of how to respond to the user's emotional state when he or she is interacting with an information extraction system. Finally, it is still unclear how to evaluate the potential benefits of an affect-aware information extraction system.
展开▼
