'Thanks for pointing that out.' Making Sarcasm Accessible For All

摘要

Television programs and films include emotional content which is intended to be captured and interpreted by the viewer. Auditory content such as sound effects, mood music, and vocal intonation cannot be perceived by those in the audience who cannot hear. The tone of voice used to communicate sarcasm is one such type of content. While captioning is designed to assist the deaf and hard of hearing in understanding this information, it has many weaknesses. This paper presents the results of a pilot study which applied user interface design principles to develop prototypes of enhanced captioning technology that can support the translation of sarcastic auditory emotional content into a visual modality.