Development of a Telepresence System for Sharing 3D Physical Objects Using Real-time Point Clouds

摘要

We proposed an immersive telepresence system which is ableto share and manipulate 3D physical objects from a remotelocation. By using real-time point clouds captured by an RGB-Dcamera, a user wearing MR-HMD can observe and manipulate3D virtual objects in the real world through mixed reality. In theproposed system, point cloud segmentation classifies point cloudsinto individual clusters allowing a user to realize telepresencesuitable for sharing 3D physical objects.Since this system has sufficient processing speed for effectivetelepresence, the system can be used effectively. It is important toreduce the number of points rendered to speed up the processingspeed.Future works include the use of a different segmentationmethod.