RD in Collection and Representation of Non-structured Open-Source Data for Use in Decision-Making Systems

摘要

The paper covers the preparation and actual analysis of unstructured data sourced from social media (SM) by means of Big Data technology, which shall mean any dataset too large and complex to be processed by conventional methods. The researchers have analyzed highly functional data collection systems and services, including SM. Those include rather large systems as well as projects that legally collect information. Experiments have produced Python code to optimally collect open-access data from VK.com for specific applications. The paper presents the web interface of this software. It describes the intended use and functionality of the system, with extra details on the interface tabs. Note that the collected data can characterize any registered SM user to a certain extent. A person's interests can be suggested from their posts and subscriptions. The study is aimed to design tools to collect and represent unstructured open-source data so as to construct a person's social profile (SP). The conclusion is that the collected data can characterize SM users to this or that extent.