Handheld combat support tools utilising IoT technologies and data fusion algorithms as reconnaissance and surveillance platforms

摘要

This paper documents the idea and construction details of mobile support tools used for research in constructing innovative tools supporting selected range of reconnaissance and surveillance activities performed using handhelds and integrated or built-in sensors. In this research a mobile application such as SAME or mCOP serves as a communication and decision support node, exchanging and fusing data gathered from sensors (other handhelds), perimeter sensors, UAVs. The data gathering process is supplemented by the operator-soldier with additional information increasing data reliability. The task of recon data recognition, aggregation and deconfliction, in presented research, is performed by developed algorithms and operators. Introducing human-in-the-loop serves as complex-case solution and mechanisms for extending reconnaissance recognition features in the system, where an operator annotates gathered data and is able to aggregate, supplement, describe battlespace elements such as equipment, personnel, activities (tasks) and in result engaged units. The research contains also a mobile system architecture description, demonstrating proof-of-concept and implementation assumptions which led to deployment of highly specialised, service-based tactical support mobile application mCOP and its upgraded version SAME. Such applications serve as operational picture managers fusing data from command centre and available scenario participants. Both prototypes serve also as technology demonstrators for testing GIS-based decision support and augmented reality features indirectly supporting research on the efficiency of mobile tools introduction to support soldiers and low level commanders.