A novel sentiment analysis framework for monitoring the evolving public opinion in real-time: Case study on climate change

摘要

Smart city analytics involves tracking, interpreting, and evaluating the sentiments and emotions that are shared via online social media channels. Sentiment analysis of social media posts has become increasingly prominent in recent years as a means of gaining insights into how members of the public perceive current affairs. The ongoing research in this domain has leveraged multiple types of sentiment analysis. However, although the existing approaches enable researchers to acquire retrospective insights into public opinion, they do not enable a realtime evaluation. In addition, they are not readily scalable and necessitate the analysis of a significant amount of posts (in the millions) to facilitate a more in-depth evaluation. The study outlined in this paper was designed to address these shortcomings by presenting a framework that facilitates a real-time evaluation of the evolution of opinions shared by prominent public features and their respective followers; that is, high-impact posts. The developed solution encompasses a sophisticated Bi-directional LSTM classifier that was implemented and tested using a dataset consisting of 278,000 tweets related to the topic of climate change. The outcomes reveal that the proposed classifier achieved the following accuracies: 88.41% for discrimination; 89.66% for anger; 87.01% for inspiration; and 87.52% for joy - with negative emotions being more accurately classified than positive emotions. Similarly, the sentiment classification performance yielded accuracies of 89.32% for support and 89.80% for strong support, as well as 88.14% for opposition and 87.52% for strong opposition. In addition, the findings of the study indicated that geographic location, chosen topic, cultural sensitivities, and posting frequency all play a critical role in public reactions to posts and the ensuing perspectives they adopt. The solution stands out from existing retrospective analysis methods because it does not rely on the analysis of vast quantities of data records; rather, it can perform real-time, high-impact content analysis in a resource-efficient and sustainable manner. This framework can be used to generate insights into how public opinion is developing on a real-time basis. As such, it can have meaningful application within social media analysis efforts.