Remote rendering based Second Life mobile client system to control smart home appliances

摘要

In this paper we propose the development details of a mobile client that allows virtual 3D avatar interaction and virtual 3D annotation control in Second Life. We established adaptation based virtual rendering of the Second Life client and encoded the real-time frames into video stream, which is suitable for mobile client rendering. Additionally, we re-mapped the touch based interaction of the user and feed that to the Second Life client in a form of keyboard and mouse interactions. As a proof of concept, we annotated a virtual environment object in Second Life and linked that with a real object by using X10 controllers. Further, we captured the mobile interaction of the user and provided controller interface to change states of the real object through the virtual object interaction. We argue that by using the mobile Second Life virtual interface the homeowner have a better look to monitor and control the home appliances. We present illustration of the prototype system and show its application in a smart environment setup.