Heterogeneity-entropy based unsupervised feature learning for personality prediction with cross-media data

摘要

Personality prediction has broad prospects of application in real life. It can be accomplished by analyzing massive and variant data in social networks, which conveys one's personal traits through user generated contents, user's social relationships and behaviors. However, it is difficult to design an effective feature representation from such complex data to predict user's personality as well as high-level and abstract psychological concepts. In this paper, we propose a novel unsupervised cross-modal feature learning algorithm, named Heterogeneity Entropy Neural Network (HENN), to extract the common information between modalities and map it to the user's personality. HENN is constructed hierarchically on Deep Belief Networks (DBNs) and Auto-encoder (AE) with a modified loss function, in which an additional term named Heterogeneity Entropy (HE) is added to measure common information among different modalities. Experiments on a cross-media dataset collected from two famous Chinese social network platforms, i.e., Renren and SinaMicroblog, demonstrate the superiority of our method over several existing algorithms.