Understand the City Better: Multimodal Aspect-Opinion Summarization for Travel

摘要

Every city has a unique taste, and attracts tourists from all over the world to experience personally. People like to share their opinions on scenic spots of a city via the Internet after a wonderful journey, which has become a kind of important information source for people who are going to make their travel planning. Confronted with the ever-increasing multimedia content, it is desirable to provide visualized summarization to quickly grasp the essential aspects of the scenic spots. To better understand the city, we propose a novel framework termed multimodal aspect-opinion summarization (MAOS) to discover the aspect-opinion about the popular scenic spots. We devolop a three-step solution to generate the multimodal summary in this paper. We first select important informative sentences from reviews and then identify the aspects from the selected sentences. Finally relevant and representative images from the travelogues are picked out to visualize the aspect opinions. We have done extensive experiments on a real-world travel and review dataset to demonstrate the effectiveness of our proposed method against the state-of-the-art approaches.