3D modeling and augmented reality

摘要

In this talk, I will first introduce our research on 3D modeling. For 3D geometry modeling, we present a rapid method to align large sets of 3D scanned data automatically. We articulate a novel approach to geometric model completion via interactive sketches. For appearance modeling, we present a new method for modeling real-world surface reflectance, described with non-parametric spatially-varying bidirectional reflectance distribution functions (SVBRDF). Then I will show our Augmented Reality Aided Jet Engine Assembly and Disassembly Guidance System. In this system, context-aware text instructions, video clips and virtual assembly/disassembly demonstrations are displayed on demand as an overlay in head-mounted displays (HMD); hands-free voice interfaces are used for user interaction; operations are synchronized wirelessly among different technicians and controlled with a dedicated work flow server.