A method to detect data outliers from smart urban spaces via tensor analysis

摘要

With the increasing amount of data available nowadays, especially in urban spaces, it has become critical extracting knowledge to get insight from all this big data. This need becomes even more important and less obvious to supply when these data have discrepant events (i.e., outliers). Here we propose a method to explore the multiway nature of urban spaces data in outliers detection which includes three stages: (i) dimensionality reduction, where we model data as a 3rd-order tensor; from this reduction, we extract a set of latent factors to obtain the best fit for the next classification step; (ii) classification of latent factors, where the latent factors from the stage (i) are used to generate instances of similar events in monitoring smart urban spaces which result in high-quality clusters from the factorization; and (iii) combining steps (i) and (ii) to generate a refined urban space pattern identification model. We analyzed a real large-scale dataset with valuable data captured and streamed by urban sensors from 4 cities: Elda and Rois (Spain), Nuremberg (Germany), and Tallinn (Estonia). Our results allow us to conclude there is a kind of cyclic time patterns of urban sensing.