System and method for synthesizing and preserving consistent relative neighborhood position in multi-perspective multi-point tele-immersive environments

摘要

An e-learning system has a classroom having a seating arrangement for students, a plurality of depth-sensing cameras, a session controller coupled to the depth-sensing cameras, executing software from a non-transitory medium, a presenter station, and a plurality of augmented-reality headsets, one each associated with each of the seats in the fixed-seating arrangement, and one associated with the presenter station. The software operates in one of an instruction mode, an interaction mode, and a discussion mode. The viewpoints and audio feeds to all of the headsets are controlled such that the students directly interacting see and hear one another directly, and the remainder of the headsets see and hear one or the other of the directly-engaged students according to which student is speaking.