Mobile augmented reality as a Chinese menu translator

摘要

This paper presents an application on mobile phones that translates Chinese menus into a 3D model of the menu and the name of the menu in English. The system runs on an android platform mobile phone. It uses image recognition to trace and register image markers (in this paper it is a Chinese word). Then, it processed the input into a pre-processed feature database of menu items using Features from Accelerated Segment Test (FAST) implemented by Vuforia Library. The system will check the database, and after the matching it will generate the 3D model of the food using the Unity 3D game engine. It is able to trace and render up to five 3D models of the dishes in realtime.