Extracting fine-grained information from social media is traditionally a challenging task, since the language used in social media messages is usually informal, with creative genre-specific terminology and expression. How to handle such a challenge so as to automatically understand the opinions that people are communicating has become a hot subject of research. In this paper, we aim to show that leveraging the pre-learned knowledge can help neural network models understand the creative language in Tweets. In order to address this idea, we present a transfer learning model based on BERT. We fine-turned the pre-trained BERT model and applied the customized model to two downstream tasks described in SemEval-2018: Irony Detection task and Emoji Prediction task of Tweets. Our model could achieve an F-score of 38.52 (ranked 1/49) in Emoji Prediction task and 67.52 (ranked 2/43) and 51.35 (ranked 1/31) in Irony Detection subtask A and subtask B. The experimental results validate the effectiveness of our idea.
展开▼
机译:style =“ font-size:11.0pt; font-family:” Times New Roman“,” serif“; mso-fareast-font-family:” Times New Roman“; mso-bidi-font-family:Mangal; mso-ansi-language:PL; mso-fareast-language:EN-US; mso-bidi-language:HI“ lang =” PL“> style =” font-size:11.0pt; font-family的腐蚀行为:“ Times New Roman”,“ serif”; mso-fareast-font-family:“ Times New Roman”; mso-bidi-font-family:Mangal; mso-ansi语言:EN-GB; mso-fareast-language :EN-US; mso-bidi-language:HI“ lang =” EN-GB“> Cu 24 sub> Zn 5 sub>铝合金在四硼酸钠溶液中存在1-苯基-5-巯基四唑 span> span>