Visualization in Multimodal User Interfaces of Mobile Applications

摘要

Advanced user interfaces are an important aspect of mobile information systems. They should provide state-of-the-art visualization and interaction techniques tailored for specific tasks, while at the same time allow flexible deployment of these components on a multitude of (mobile) hardware platforms. Especially visualizations have to adapt to the platform capabilities in order to remain not only effective, but also adequate. Focus & Context techniques are one way to efficiently make use of displays with low resolution and size, as are lens techniques. Here, a good tradeoff between complexity and response time is important. Also, complex inputs are not feasible on most mobile devices. Simple, straightforward, context-driven interaction options must be presented to a user. This can be achieved by integrating a task model, user (role) and resource models as well as multimodal interaction facilities such as speech recognition, into the user interface component of mobile information systems.