Three-dimensional sketching in mobile augmented reality

摘要

An enhanced multimodal interface and various enhanced tools are provided to enable a user to create 3-D augmented reality (AR) sketches using a mobile device. Mobile device can comprise a sketch generator component (SGC) that can integrate multiple sources of inputs with enhanced tools, comprising enhanced 3-D snapping and proxy creation tools. The inputs comprise touch screen data, motion data, and image data from a camera. SGC can provide the interface, which can support absolute and relative drawing. Via the interface, the user can select and use desired enhanced tools to create a 3-D AR sketch that augments visual content of a real-world environment captured by the camera with drawing content added by the user using the enhanced tools. SGC enables a user to create desired strokes, planar or curved surface proxies, snapping points, or other sketch features, wherein proxies can align with real-world surfaces.