MULTIMODAL INPUT USING SCRATCHPAD GRAPHICAL USER INTERFACE TO EDIT SPEECH TEXT INPUT WITH KEYBOARD INPUT

摘要

A system and method for multimodal input into an application program. The method may include performing speech recognition on speech audio input to thereby produce recognized speech text input for insertion into a document of an application program, the document having keyboard focus. The method may also include identifying the document as being text service framework unaware. The method may further include displaying the recognized speech text input in a scratchpad graphical user interface for editing the recognized speech text input. The method may further include reflecting keyboard input bound for the document to the scratchpad graphical user interface, while preserving the keyboard focus of the document. The method may also include displaying the reflected keyboard input on the scratchpad graphical user interface, to thereby effect edits in the recognized speech text input.