Development of Multiple Device Collaboration System Using Built-in Camera Image

摘要

In this paper, we introduce a multi-device collaboration system using the image obtained from the built-in camera. Users can use applications that utilize multiple devices in cooperation without needing special devices such as a touch panel sensor. Our system enables accurate position tracking of a smartphone any screen by obtaining an image from the device's front camera to recognize the device and measure the device's position by template matching. In many multi-device collaboration approaches, it was necessary to overlap the screens. However, our proposed method is capable of multi-device collaboration without overlapping the screens of the devices, and it can be applied using a wide range of off-screens. We implemented some of the applications using this technique. In addition, we showed the usefulness of this approach by evaluation experiments.