INTÉGRATION AUTOMATIQUE DE CAPTURE ET DE RECONNAISSANCE D'IMAGE DANS UNE INTERROGATION VOCALE POUR COMPRENDRE UNE INTENTION

摘要

Query understanding using integrated image capture and recognition is provided. A user is enabled to speak an utterance which is received by a digital assistant executing on a computing device. The utterance includes a spoken trigger, which is detected by the digital assistant and activates a camera integrated in or communicatively attached to the computing device. The camera captures an image of an object or person of interest. The utterance, the image, and temporally relevant context information are provided to an image integrated query system, which performs speech recognition and image processing on the utterance and the image for understanding the user intent. The understood intent is provided to the digital assistant, which operates to complete perform a search query or complete a task indicated in the integrated utterance and image data.